Sep 17 23:04:22.871401 ip-10-0-141-215 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 23:04:22.871411 ip-10-0-141-215 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 23:04:22.871418 ip-10-0-141-215 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 23:04:22.871562 ip-10-0-141-215 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 23:04:33.120549 ip-10-0-141-215 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 23:04:33.120563 ip-10-0-141-215 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1da73b33625e497aa3294749effdfb50 --
Sep 17 23:06:26.776802 ip-10-0-141-215 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 23:06:30.310364 ip-10-0-141-215 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 23:06:30.310364 ip-10-0-141-215 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 23:06:30.310364 ip-10-0-141-215 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 23:06:30.310364 ip-10-0-141-215 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 23:06:30.310364 ip-10-0-141-215 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 23:06:30.311152 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.310737    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 23:06:30.315202 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315182    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:30.315202 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315201    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315205    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315211    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315216    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315219    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315222    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315225    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315229    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315232    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315234    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315237    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315240    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315243    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315246    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315248    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315251    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315253    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315256    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315259    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:30.315273 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315261    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315264    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315266    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315269    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315271    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315274    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315276    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315279    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315282    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315285    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315288    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315290    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315293    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315296    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315299    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315301    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315304    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315306    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315309    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:30.315749 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315311    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315314    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315317    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315319    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315321    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315325    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315327    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315330    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315332    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315335    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315339    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315343    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315346    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315349    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315353    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315356    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315359    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315363    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315366    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315369    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:30.316211 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315372    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315374    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315378    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315380    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315383    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315385    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315388    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315390    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315393    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315396    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315399    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315403    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315407    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315410    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315413    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315415    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315418    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315421    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315424    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315428    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:30.316766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315431    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315433    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315436    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315438    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315441    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315444    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315446    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315450    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315453    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315456    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315470    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315473    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315476    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315478    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315481    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315484    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315486    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315489    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315492    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:30.317316 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.315494    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316207    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316214    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316217    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316221    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316223    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316226    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316229    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316232    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316235    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316237    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316242    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316246    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316249    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316252    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316255    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316258    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316261    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316264    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:30.317800 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316266    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316270    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316273    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316276    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316279    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316281    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316284    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316287    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316289    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316293    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316297    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316300    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316302    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316305    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316307    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316310    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316312    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316315    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316317    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:30.318278 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316320    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316323    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316326    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316328    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316331    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316334    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316336    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316339    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316341    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316344    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316346    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316349    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316352    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316354    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316359    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316362    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316365    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316367    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316370    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316372    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:30.318766 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316375    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316378    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316381    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316384    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316386    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316389    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316391    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316394    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316396    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316399    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316402    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316404    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316407    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316409    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316412    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316415    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316418    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316421    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316423    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316425    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:30.319263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316428    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316430    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316433    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316436    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316438    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316441    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316445    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316448    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316452    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316455    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316457    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316477    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316481    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316485    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316488    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316491    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316493    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316496    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316499    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:30.319775 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316501    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316504    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316507    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316888    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316894    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316897    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316900    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316903    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316906    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316908    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316911    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316914    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316917    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316919    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316922    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316927    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316929    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316932    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316935    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316939    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:30.320241 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316942    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316945    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316947    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316950    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316952    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316955    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316958    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316961    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316963    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316966    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316968    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316971    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316974    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316976    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316979    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316981    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316984    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316986    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316989    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316991    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:30.320753 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316995    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.316997    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317000    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317004    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317007    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317010    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317013    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317017    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317020    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317023    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317025    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317029    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317033    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317035    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317039    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317041    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317044    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317047    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317049    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:30.321255 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317052    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317054    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317057    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317060    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317062    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317065    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317068    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317070    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317072    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317075    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317079    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317082    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317085    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317088    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317091    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317093    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317096    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317099    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317101    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:30.321771 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317104    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317108    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317111    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317113    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317116    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317120    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317123    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317126    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317128    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317132    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317136    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317139    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317143    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317146    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317149    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317151    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317154    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317156    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317159    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:30.322221 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317162    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317164    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317167    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317170    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317172    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317251    2583 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317304    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317311    2583 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317315    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317321    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317324    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317329    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317334    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317337    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317342    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317346    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317349    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317352    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317357    2583 flags.go:64] FLAG: --cgroup-root=""
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317360    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317363    2583 flags.go:64] FLAG: --client-ca-file=""
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317366    2583 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317369    2583 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317374    2583 flags.go:64] FLAG: --cluster-domain=""
Sep 17 23:06:30.322699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317376    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317380    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317383    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317386    2583 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317390    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317393    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317396    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317399    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317403    2583 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317406    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317409    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317412    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317415    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317419    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317422    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317425    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317428    2583 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317432    2583 flags.go:64] FLAG: --enable-server="true"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317435    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317440    2583 flags.go:64] FLAG: --event-burst="100"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317443    2583 flags.go:64] FLAG: --event-qps="50"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317446    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317450    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317453    2583 flags.go:64] FLAG: --eviction-hard=""
Sep 17 23:06:30.323280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317457    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317474    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317478    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317482    2583 flags.go:64] FLAG: --eviction-soft=""
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317485    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317487    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317491    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317493    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317496    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317499    2583 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317502    2583 flags.go:64] FLAG: --feature-gates=""
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317506    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317510    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317513    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317516    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317520    2583 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317523    2583 flags.go:64] FLAG: --help="false"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317526    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317529    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317532    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317535    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317538    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317542    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317545    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 23:06:30.323913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317548    2583 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317551    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317553    2583 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317558    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317561    2583 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317564    2583 flags.go:64] FLAG: --kube-reserved=""
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317568    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317571    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317574    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317577    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317581    2583 flags.go:64] FLAG: --lock-file=""
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317584    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317587    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317590    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317596    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317614    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317617    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317620    2583 flags.go:64] FLAG: --logging-format="text"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317623    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317627    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317630    2583 flags.go:64] FLAG: --manifest-url=""
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317633    2583 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317638    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317641    2583 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317645    2583 flags.go:64] FLAG: --max-pods="110"
Sep 17 23:06:30.324977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317648    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317652    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317654    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317657    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317660    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317663    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317667    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317674    2583 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317677    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317680    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317683    2583 flags.go:64] FLAG: --pod-cidr=""
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317687    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317693    2583 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317696    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317700    2583 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317703    2583 flags.go:64] FLAG: --port="10250"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317706    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317711    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09a85c3e3204825b6"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317714    2583 flags.go:64] FLAG: --qos-reserved=""
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317717    2583 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317720    2583 flags.go:64] FLAG: --register-node="true"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317723    2583 flags.go:64] FLAG: --register-with-taints=""
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317727    2583 flags.go:64] FLAG: --registry-burst="10"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317729    2583 flags.go:64] FLAG: --registry-qps="5"
Sep 17 23:06:30.325766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317732    2583 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317736    2583 flags.go:64] FLAG: --reserved-memory=""
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317740    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317743    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317747    2583 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317749    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317752    2583 flags.go:64] FLAG: --runonce="false"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317755    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317758    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317761    2583 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317764    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317767    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317770    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317774    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317777    2583 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317779    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317783    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317786    2583 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317789    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317792    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317795    2583 flags.go:64] FLAG: --system-cgroups=""
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317798    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317806    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317809    2583 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317812    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 23:06:30.326715 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317817    2583 flags.go:64] FLAG: --tls-min-version=""
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317820    2583 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317823    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317826    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317829    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317832    2583 flags.go:64] FLAG: --v="2"
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317836    2583 flags.go:64] FLAG: --version="false"
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317840    2583 flags.go:64] FLAG: --vmodule=""
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317844    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.317847    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317991    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317995    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.317998    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318001    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318004    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318007    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318010    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318013    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318015    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318020    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318024    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:30.327788 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318027    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318030    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318033    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318036    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318038    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318041    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318044    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318060    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318064    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318067    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318071    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318074    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318078    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318082    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318085    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318088    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318091    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318094    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318097    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:30.328722 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318100    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318102    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318105    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318108    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318110    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318113    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318116    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318119    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318121    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318124    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318127    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318129    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318132    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318134    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318137    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318140    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318142    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318145    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318147    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:30.329580 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318150    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318152    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318162    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318165    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318168    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318171    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318173    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318181    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318184    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318187    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318190    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318192    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318195    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318198    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318200    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318203    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318205    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318208    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318210    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318213    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:30.330183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318215    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318218    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318221    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318223    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318226    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318228    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318231    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318234    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318236    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318239    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318241    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318244    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318246    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318249    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318253    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318261    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318263    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318267    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318269    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318272    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:30.330985 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318274    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318277    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318280    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318283    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318285    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318288    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318291    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318293    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318296    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.318299    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.318725    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.327719    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.327745    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.327776    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.327785    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 23:06:30.331863 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327890    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327898    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327903    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327908    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327913    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327918    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327922    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327926    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327934    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327940    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327945    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327950    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327954    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327959    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327963    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327967    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327971    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327975    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327979    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327983    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:30.332456 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327987    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327992    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.327996    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328000    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328005    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328009    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328013    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328017    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328022    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328035    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328040    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328045    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328049    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328053    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328057    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328062    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328066    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328071    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328075    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328080    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:30.333183 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328084    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328091    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328097    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328101    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328106    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328110    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328115    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328120    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328125    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328129    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328133    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328138    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328143    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328147    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328151    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328156    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328161    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328166    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328171    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:30.333872 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328176    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328180    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328185    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328197    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328203    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328207    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328212    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328216    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328220    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328224    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328228    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328233    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328236    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328240    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328245    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328249    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328253    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328258    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328262    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328266    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:30.334334 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328270    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328275    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328279    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328283    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328287    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328291    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328295    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328299    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328304    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328308    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328315    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328320    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328325    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328330    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328335    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328340    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328354    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328359    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328363    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:30.334975 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328368    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.328377    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328646    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328656    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328661    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328665    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328671    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328675    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328681    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328689    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328696    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328701    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328706    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328711    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:30.335440 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328716    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328720    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328724    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328729    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328733    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328737    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328740    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328745    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328750    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328754    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328759    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328763    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328767    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328771    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328776    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328780    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328792    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328797    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328801    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:30.335823 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328805    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328809    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328813    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328817    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328822    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328826    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328830    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328834    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328839    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328843    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328847    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328851    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328855    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328859    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328863    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328868    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328872    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328876    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328881    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328885    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:30.336289 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328889    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328893    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328897    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328902    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328907    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328911    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328916    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328920    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328926    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328932    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328945    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328951    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328955    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328959    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328963    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328967    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328972    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328976    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328980    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:30.336793 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328985    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328989    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328993    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.328997    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329001    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329006    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329010    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329014    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329018    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329022    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329026    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329030    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329034    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329039    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329043    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329047    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329051    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329056    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329061    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329067    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:30.337258 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329071    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329076    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329080    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329084    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329096    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329101    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329105    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329109    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:30.329113    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.329121    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.329328    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.333537    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.334440    2583 server.go:1019] "Starting client certificate rotation"
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.334553    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 23:06:30.337850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.334586    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 23:06:30.338204 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.337312    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 23:06:30.338663 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.338639    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 23:06:30.351125 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.351101    2583 log.go:25] "Validated CRI v1 runtime API"
Sep 17 23:06:30.352863 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.352848    2583 log.go:25] "Validated CRI v1 image API"
Sep 17 23:06:30.355939 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.355920    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 23:06:30.358272 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.358253    2583 fs.go:135] Filesystem UUIDs: map[43275fc0-37a3-48ef-a86f-c3ead0df7411:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7c322999-7c45-44e3-bdbb-0352fe78be6f:/dev/nvme0n1p3]
Sep 17 23:06:30.358340 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.358270    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 23:06:30.363036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.362927    2583 manager.go:216] Machine: {Timestamp:2026-09-17 23:06:30.362403672 +0000 UTC m=+1.969981323 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3082584 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eff85d23f9576c8dc7b54f46de16c SystemUUID:ec2eff85-d23f-9576-c8dc-7b54f46de16c BootID:1da73b33-625e-497a-a329-4749effdfb50 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f8:84:06:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f8:84:06:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:fc:08:83:18:fa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 23:06:30.363036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.363034    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 23:06:30.363149 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.363117    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 23:06:30.364614 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.364589    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 23:06:30.364770 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.364618    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 23:06:30.365795 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.365779    2583 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 23:06:30.365853 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.365800    2583 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 23:06:30.365853 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.365809    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 23:06:30.365853 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.365827    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 23:06:30.366922 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.366902    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 23:06:30.367691 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.367676    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 23:06:30.370717 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.370704    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 23:06:30.370833 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.370823    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 23:06:30.370867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.370853    2583 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 23:06:30.370897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.370866    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 23:06:30.370897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.370884    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 23:06:30.370897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.370897    2583 kubelet.go:398] "Adding apiserver pod source"
Sep 17 23:06:30.370974 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.370907    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 23:06:30.371266 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.371255    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 23:06:30.371266 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.371273    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 23:06:30.373153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.373138    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 23:06:30.375280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.375267    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 23:06:30.375317 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.375298    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 23:06:30.376164 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376153    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 23:06:30.376196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376170    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 23:06:30.376196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376176    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 23:06:30.376196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376183    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 23:06:30.376196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376192    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 23:06:30.376196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376197    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 23:06:30.376329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376211    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 23:06:30.376329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376216    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 23:06:30.376329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376223    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 23:06:30.376329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376228    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 23:06:30.376329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376238    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 23:06:30.376329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376243    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 23:06:30.376329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376266    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 23:06:30.376329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.376271    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 23:06:30.380030 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.380014    2583 server.go:1268] "Started kubelet"
Sep 17 23:06:30.380153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.380095    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 23:06:30.380153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.380104    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 23:06:30.380272 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.380186    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 23:06:30.381020 ip-10-0-141-215 systemd[1]: Started Kubernetes Kubelet.
Sep 17 23:06:30.381634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.381370    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 23:06:30.382104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.382031    2583 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 23:06:30.382764 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.382742    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 23:06:30.382764 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.382745    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 23:06:30.382878 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.382757    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 23:06:30.385730 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.385712    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 23:06:30.388495 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.388479    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 23:06:30.388561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.388496    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 23:06:30.388627 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.388580    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:30.389222 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389198    2583 factory.go:55] Registering systemd factory
Sep 17 23:06:30.389222 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389225    2583 factory.go:223] Registration of the systemd container factory successfully
Sep 17 23:06:30.389450 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389434    2583 factory.go:153] Registering CRI-O factory
Sep 17 23:06:30.389533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389454    2583 factory.go:223] Registration of the crio container factory successfully
Sep 17 23:06:30.389533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389459    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 23:06:30.389533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389500    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 23:06:30.389533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389472    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 23:06:30.389733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389540    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 23:06:30.389733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389559    2583 factory.go:103] Registering Raw factory
Sep 17 23:06:30.389733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389573    2583 manager.go:1196] Started watching for new ooms in manager
Sep 17 23:06:30.389733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389586    2583 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 23:06:30.389733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389595    2583 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 23:06:30.390007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.389968    2583 manager.go:349] Starting recovery of all containers
Sep 17 23:06:30.409686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.409655    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gqmkv"
Sep 17 23:06:30.409686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.409688    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gqmkv"
Sep 17 23:06:30.409846 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.409809    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 23:06:30.409930 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.409908    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 23:06:30.417478 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.415732    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 23:06:30.422139 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.422112    2583 manager.go:354] Recovery completed
Sep 17 23:06:30.426255 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.426240    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:30.428162 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.428147    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:30.428218 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.428174    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:30.428218 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.428184    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:30.428696 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.428678    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 23:06:30.428758 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.428697    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 23:06:30.428758 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.428681    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:30.428758 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.428716    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 23:06:30.429366 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.429355    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:30.429407 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.429376    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:30.429407 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.429387    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:30.430770 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.430757    2583 policy_none.go:49] "None policy: Start"
Sep 17 23:06:30.430812 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.430774    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 23:06:30.430812 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.430786    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 23:06:30.432799 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.432781    2583 policy_none.go:47] "Start"
Sep 17 23:06:30.478250 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.478222    2583 manager.go:337] "Starting Device Plugin manager"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.478267    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.478278    2583 server.go:87] "Starting device plugin registration server"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.478601    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.478620    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.478707    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.478839    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.478851    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.479443    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.479507    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.480030    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.480073    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.480598    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.480650    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 23:06:30.487926 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.482282    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:30.579484 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.579390    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:30.580396 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.580377    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:30.580510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.580415    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:30.580510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.580430    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:30.580510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.580479    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.580736 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.580711    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"]
Sep 17 23:06:30.580785 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.580777    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:30.581928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.581913    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:30.582010 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.581940    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:30.582010 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.581955    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:30.584103 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.584093    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:30.584235 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.584223    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.584267 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.584250    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:30.584770 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.584757    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:30.584834 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.584768    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:30.584834 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.584777    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:30.584834 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.584787    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:30.584834 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.584801    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:30.584955 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.584788    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:30.586980 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.586965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.587057 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.586991    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:30.587757 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.587739    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:30.587841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.587767    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:30.587841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.587777    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:30.589025 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.589010    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.589105 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.589030    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-215.ec2.internal\": node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:30.590440 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.590419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2a8d187de3034f51c9752cc1f41717d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"e2a8d187de3034f51c9752cc1f41717d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.590520 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.590441    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eab2e6eb3aed73f0fd06af8490099cf1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"eab2e6eb3aed73f0fd06af8490099cf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.590520 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.590458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eab2e6eb3aed73f0fd06af8490099cf1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"eab2e6eb3aed73f0fd06af8490099cf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.606155 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.606135    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:30.618139 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.618122    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-215.ec2.internal\" not found" node="ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.621895 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.621878    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-215.ec2.internal\" not found" node="ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.690986 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.690954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2a8d187de3034f51c9752cc1f41717d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"e2a8d187de3034f51c9752cc1f41717d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.690986 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.690984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eab2e6eb3aed73f0fd06af8490099cf1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"eab2e6eb3aed73f0fd06af8490099cf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.691205 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.691001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eab2e6eb3aed73f0fd06af8490099cf1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"eab2e6eb3aed73f0fd06af8490099cf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.691205 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.691027    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eab2e6eb3aed73f0fd06af8490099cf1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"eab2e6eb3aed73f0fd06af8490099cf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.691205 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.691059    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eab2e6eb3aed73f0fd06af8490099cf1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"eab2e6eb3aed73f0fd06af8490099cf1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.691205 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.691059    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2a8d187de3034f51c9752cc1f41717d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"e2a8d187de3034f51c9752cc1f41717d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.706398 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.706366    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:30.806713 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.806673    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:30.907584 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:30.907509    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:30.921700 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.921664    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:30.924812 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:30.924795    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:31.007914 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:31.007874    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:31.108449 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:31.108418    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:31.208997 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:31.208918    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:31.309537 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:31.309501    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:31.334684 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.334649    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 23:06:31.335190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.334832    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 23:06:31.409901 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:31.409743    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:31.418936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.418896    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 23:01:30 +0000 UTC" deadline="2028-04-05 21:04:54.57728218 +0000 UTC"
Sep 17 23:06:31.418936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.418926    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13581h58m23.158359579s"
Sep 17 23:06:31.510814 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:31.510724    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:31.557363 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:31.557328    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a8d187de3034f51c9752cc1f41717d.slice/crio-5d3d185868af357e1910fc5b3cdaa649bff4ce68a6cf24916f2346bbb8efe3a6 WatchSource:0}: Error finding container 5d3d185868af357e1910fc5b3cdaa649bff4ce68a6cf24916f2346bbb8efe3a6: Status 404 returned error can't find the container with id 5d3d185868af357e1910fc5b3cdaa649bff4ce68a6cf24916f2346bbb8efe3a6
Sep 17 23:06:31.557598 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:31.557582    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab2e6eb3aed73f0fd06af8490099cf1.slice/crio-385f4f8b69614d98132521b32ff7d28057630cecba9933a986dda76135ecf28a WatchSource:0}: Error finding container 385f4f8b69614d98132521b32ff7d28057630cecba9933a986dda76135ecf28a: Status 404 returned error can't find the container with id 385f4f8b69614d98132521b32ff7d28057630cecba9933a986dda76135ecf28a
Sep 17 23:06:31.562536 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.562520    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:06:31.611054 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:31.611013    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:31.685695 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.685664    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:31.707235 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.707200    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:31.711517 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:31.711497    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Sep 17 23:06:31.779653 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.779594    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:31.788789 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.788765    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:31.800091 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.800056    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 23:06:31.800946 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.800931    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Sep 17 23:06:31.811178 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:31.811156    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 23:06:32.372245 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.372202    2583 apiserver.go:52] "Watching apiserver"
Sep 17 23:06:32.382003 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.381976    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 23:06:32.382395 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.382371    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal","openshift-multus/multus-lkdzw","openshift-multus/network-metrics-daemon-d8wwk","openshift-network-diagnostics/network-check-target-zsdgk","openshift-network-operator/iptables-alerter-mrkhc","kube-system/global-pull-secret-syncer-fvjmj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc","openshift-cluster-node-tuning-operator/tuned-2mjrz","openshift-dns/node-resolver-wzlbb","openshift-multus/multus-additional-cni-plugins-h42tf","openshift-ovn-kubernetes/ovnkube-node-2nzwr","kube-system/konnectivity-agent-qw68s","kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal","openshift-image-registry/node-ca-skqrh"]
Sep 17 23:06:32.384966 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.384944    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.387987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.387398    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 23:06:32.387987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.387408    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 23:06:32.387987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.387560    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.387987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.387712    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hskzb\""
Sep 17 23:06:32.387987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.387719    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 23:06:32.389530 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.389509    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 23:06:32.390598 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.389706    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 23:06:32.390598 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.389783    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 23:06:32.390598 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.389974    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 23:06:32.390598 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.390061    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wcj72\""
Sep 17 23:06:32.390598 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.390149    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 23:06:32.390598 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.390263    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:32.390598 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.390334    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:32.391037 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.391020    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 23:06:32.391709 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.391688    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 23:06:32.393953 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.393932    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:32.394040 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.394015    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:32.396699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.396353    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398547    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398655    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398684    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398760    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-registration-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398811    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lcv7t\""
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkw9r\" (UniqueName: \"kubernetes.io/projected/0a48005d-f884-4cdc-94dd-66f406cbc610-kube-api-access-xkw9r\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-run-systemd\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-log-socket\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398900    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398906    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:32.398951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398935    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs6ql\" (UniqueName: \"kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql\") pod \"network-check-target-zsdgk\" (UID: \"d759aa46-0c62-4f7b-90e1-e8ed71a3a079\") " pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.398984    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-etc-openvswitch\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399036    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zckn2\" (UniqueName: \"kubernetes.io/projected/8a69d421-fd13-4891-aca0-89a67b766906-kube-api-access-zckn2\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.399184    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-cni-bin\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-device-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399436    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-sys-fs\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399457    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-kubelet\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399500    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-var-lib-openvswitch\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-node-log\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.399561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399567    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a69d421-fd13-4891-aca0-89a67b766906-env-overrides\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399590    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-etc-selinux\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-socket-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399647    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-systemd-units\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-slash\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-run-openvswitch\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-cni-netd\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a69d421-fd13-4891-aca0-89a67b766906-ovnkube-config\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvgk8\" (UniqueName: \"kubernetes.io/projected/e32a70e6-4684-4db1-9047-07504bd11322-kube-api-access-zvgk8\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399828    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-run-netns\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-run-ovn\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a69d421-fd13-4891-aca0-89a67b766906-ovn-node-metrics-cert\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.400092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.399915    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a69d421-fd13-4891-aca0-89a67b766906-ovnkube-script-lib\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.401271 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.401173    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.403207 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.403186    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-frpq6\""
Sep 17 23:06:32.403301 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.403231    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 23:06:32.403477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.403450    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 23:06:32.403546 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.403487    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.405891 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.405848    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 23:06:32.405891 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.405855    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 23:06:32.406077 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.405889    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h67vq\""
Sep 17 23:06:32.406077 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.405946    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 23:06:32.406299 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.406284    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.409143 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.408665    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 23:06:32.409143 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.408690    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 23:06:32.409143 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.408778    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 23:06:32.409143 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.408665    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9wxxw\""
Sep 17 23:06:32.409143 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.408986    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 23:06:32.409143 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.409027    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.411078 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.411025    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 23:06:32.412735 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.412364    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 23:06:32.412735 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.412438    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.413199 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.413166    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ppcd7\""
Sep 17 23:06:32.414616 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.414550    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:32.415152 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.415130    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:06:32.415362 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.415154    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 23:06:32.415362 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.415272    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k9brr\""
Sep 17 23:06:32.417063 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.417040    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 23:06:32.417063 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.417053    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 23:06:32.417306 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.417179    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jhjbj\""
Sep 17 23:06:32.419389 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.419045    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z84d9"
Sep 17 23:06:32.426019 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.425999    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z84d9"
Sep 17 23:06:32.486513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.486446    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" event={"ID":"e2a8d187de3034f51c9752cc1f41717d","Type":"ContainerStarted","Data":"5d3d185868af357e1910fc5b3cdaa649bff4ce68a6cf24916f2346bbb8efe3a6"}
Sep 17 23:06:32.487625 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.487596    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"eab2e6eb3aed73f0fd06af8490099cf1","Type":"ContainerStarted","Data":"385f4f8b69614d98132521b32ff7d28057630cecba9933a986dda76135ecf28a"}
Sep 17 23:06:32.490399 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.490381    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 23:06:32.500094 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500069    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/814e2509-d1b2-4c9b-81b7-b17e1af94e4a-hosts-file\") pod \"node-resolver-wzlbb\" (UID: \"814e2509-d1b2-4c9b-81b7-b17e1af94e4a\") " pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.500212 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-var-lib-kubelet\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.500212 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500123    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-hostroot\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.500212 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500158    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad763c95-3505-4748-93ff-ab0a41ee8763-cnibin\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.500212 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500190    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bdrs\" (UniqueName: \"kubernetes.io/projected/ad763c95-3505-4748-93ff-ab0a41ee8763-kube-api-access-6bdrs\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.500364 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500229    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-sysconfig\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.500364 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500253    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-run\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.500364 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500279    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-device-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.500364 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500313    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-sys-fs\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.500364 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500345    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-var-lib-openvswitch\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.500364 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500351    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-device-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a69d421-fd13-4891-aca0-89a67b766906-env-overrides\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500392    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/814e2509-d1b2-4c9b-81b7-b17e1af94e4a-tmp-dir\") pod \"node-resolver-wzlbb\" (UID: \"814e2509-d1b2-4c9b-81b7-b17e1af94e4a\") " pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500397    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-var-lib-openvswitch\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500420    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln7wz\" (UniqueName: \"kubernetes.io/projected/b01c722e-6626-4a46-a68d-b516de659640-kube-api-access-ln7wz\") pod \"node-ca-skqrh\" (UID: \"b01c722e-6626-4a46-a68d-b516de659640\") " pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-etc-selinux\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500444    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-sys-fs\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500484    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-modprobe-d\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-sysctl-d\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500549    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c8264cd-918c-4ddd-bd27-dee318c6e3dc-iptables-alerter-script\") pod \"iptables-alerter-mrkhc\" (UID: \"0c8264cd-918c-4ddd-bd27-dee318c6e3dc\") " pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-dbus\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-systemd-units\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-etc-selinux\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.500646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500617    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-slash\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-cni-netd\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500662    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-slash\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500663    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-systemd-units\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-tuned\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500705    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-cni-netd\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-run-ovn\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-var-lib-cni-bin\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500767    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-conf-dir\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-etc-kubernetes\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-run-ovn\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500813    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-registration-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500861    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a69d421-fd13-4891-aca0-89a67b766906-env-overrides\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500863    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6ql\" (UniqueName: \"kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql\") pod \"network-check-target-zsdgk\" (UID: \"d759aa46-0c62-4f7b-90e1-e8ed71a3a079\") " pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:32.501206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500946    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-system-cni-dir\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.500969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-etc-openvswitch\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.501016    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zckn2\" (UniqueName: \"kubernetes.io/projected/8a69d421-fd13-4891-aca0-89a67b766906-kube-api-access-zckn2\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c0da294-f659-4e57-9cb2-268d978041c7-agent-certs\") pod \"konnectivity-agent-qw68s\" (UID: \"5c0da294-f659-4e57-9cb2-268d978041c7\") " pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.501091    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs podName:e32a70e6-4684-4db1-9047-07504bd11322 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:33.001068921 +0000 UTC m=+4.608646573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs") pod "network-metrics-daemon-d8wwk" (UID: "e32a70e6-4684-4db1-9047-07504bd11322") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501114    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-kubelet-config\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-cni-bin\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-cnibin\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501325    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-daemon-config\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501347    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad763c95-3505-4748-93ff-ab0a41ee8763-system-cni-dir\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-var-lib-kubelet\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k872d\" (UniqueName: \"kubernetes.io/projected/0c8264cd-918c-4ddd-bd27-dee318c6e3dc-kube-api-access-k872d\") pod \"iptables-alerter-mrkhc\" (UID: \"0c8264cd-918c-4ddd-bd27-dee318c6e3dc\") " pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-host\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-kubelet\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.501994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501456    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-node-log\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501491    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-var-lib-cni-multus\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad763c95-3505-4748-93ff-ab0a41ee8763-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501541    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-kubelet\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501560    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c8264cd-918c-4ddd-bd27-dee318c6e3dc-host-slash\") pod \"iptables-alerter-mrkhc\" (UID: \"0c8264cd-918c-4ddd-bd27-dee318c6e3dc\") " pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501674    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-run-netns\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501692    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b01c722e-6626-4a46-a68d-b516de659640-serviceca\") pod \"node-ca-skqrh\" (UID: \"b01c722e-6626-4a46-a68d-b516de659640\") " pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501569    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-node-log\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-socket-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501607    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-registration-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501567    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-etc-openvswitch\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-run-openvswitch\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501601    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-cni-bin\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501772    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a69d421-fd13-4891-aca0-89a67b766906-ovnkube-config\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvgk8\" (UniqueName: \"kubernetes.io/projected/e32a70e6-4684-4db1-9047-07504bd11322-kube-api-access-zvgk8\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501822    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-run-multus-certs\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501845    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad763c95-3505-4748-93ff-ab0a41ee8763-cni-binary-copy\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.502650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501869    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-run-netns\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501885    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a48005d-f884-4cdc-94dd-66f406cbc610-socket-dir\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a69d421-fd13-4891-aca0-89a67b766906-ovn-node-metrics-cert\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501917    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a69d421-fd13-4891-aca0-89a67b766906-ovnkube-script-lib\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-cni-dir\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.501962    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c0da294-f659-4e57-9cb2-268d978041c7-konnectivity-ca\") pod \"konnectivity-agent-qw68s\" (UID: \"5c0da294-f659-4e57-9cb2-268d978041c7\") " pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad763c95-3505-4748-93ff-ab0a41ee8763-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502025    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-systemd\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkw9r\" (UniqueName: \"kubernetes.io/projected/0a48005d-f884-4cdc-94dd-66f406cbc610-kube-api-access-xkw9r\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-run-systemd\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-log-socket\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502122    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-socket-dir-parent\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b01c722e-6626-4a46-a68d-b516de659640-host\") pod \"node-ca-skqrh\" (UID: \"b01c722e-6626-4a46-a68d-b516de659640\") " pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502200    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/225dc1ab-4b0f-4e5d-be4c-06637e77be24-cni-binary-copy\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502224    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-run-k8s-cni-cncf-io\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.503254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad763c95-3505-4748-93ff-ab0a41ee8763-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502271    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-kubernetes\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502296    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-sysctl-conf\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-sys\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snrpb\" (UniqueName: \"kubernetes.io/projected/814e2509-d1b2-4c9b-81b7-b17e1af94e4a-kube-api-access-snrpb\") pod \"node-resolver-wzlbb\" (UID: \"814e2509-d1b2-4c9b-81b7-b17e1af94e4a\") " pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx2l2\" (UniqueName: \"kubernetes.io/projected/225dc1ab-4b0f-4e5d-be4c-06637e77be24-kube-api-access-hx2l2\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502406    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-lib-modules\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502428    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b942fac-7a98-49e1-b66a-4743ca664b7b-tmp\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr2v9\" (UniqueName: \"kubernetes.io/projected/8b942fac-7a98-49e1-b66a-4743ca664b7b-kube-api-access-kr2v9\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502544    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a69d421-fd13-4891-aca0-89a67b766906-ovnkube-config\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502578    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-run-netns\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502644    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502921    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-run-systemd\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.502957    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.503161    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-run-openvswitch\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.503867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.503205    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a69d421-fd13-4891-aca0-89a67b766906-log-socket\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.504411 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.503211    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a69d421-fd13-4891-aca0-89a67b766906-ovnkube-script-lib\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.506551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.506532    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a69d421-fd13-4891-aca0-89a67b766906-ovn-node-metrics-cert\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.507129 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.507104    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:32.507129 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.507130    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:32.507277 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.507144    2583 projected.go:196] Error preparing data for projected volume kube-api-access-hs6ql for pod openshift-network-diagnostics/network-check-target-zsdgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:32.507277 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.507220    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql podName:d759aa46-0c62-4f7b-90e1-e8ed71a3a079 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:33.007200374 +0000 UTC m=+4.614778033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hs6ql" (UniqueName: "kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql") pod "network-check-target-zsdgk" (UID: "d759aa46-0c62-4f7b-90e1-e8ed71a3a079") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:32.509999 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.509957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zckn2\" (UniqueName: \"kubernetes.io/projected/8a69d421-fd13-4891-aca0-89a67b766906-kube-api-access-zckn2\") pod \"ovnkube-node-2nzwr\" (UID: \"8a69d421-fd13-4891-aca0-89a67b766906\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.510849 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.510826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkw9r\" (UniqueName: \"kubernetes.io/projected/0a48005d-f884-4cdc-94dd-66f406cbc610-kube-api-access-xkw9r\") pod \"aws-ebs-csi-driver-node-dg9pc\" (UID: \"0a48005d-f884-4cdc-94dd-66f406cbc610\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.514771 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.514736    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvgk8\" (UniqueName: \"kubernetes.io/projected/e32a70e6-4684-4db1-9047-07504bd11322-kube-api-access-zvgk8\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:32.603286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603253    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-var-lib-cni-multus\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.603505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad763c95-3505-4748-93ff-ab0a41ee8763-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.603505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c8264cd-918c-4ddd-bd27-dee318c6e3dc-host-slash\") pod \"iptables-alerter-mrkhc\" (UID: \"0c8264cd-918c-4ddd-bd27-dee318c6e3dc\") " pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.603505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603388    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c8264cd-918c-4ddd-bd27-dee318c6e3dc-host-slash\") pod \"iptables-alerter-mrkhc\" (UID: \"0c8264cd-918c-4ddd-bd27-dee318c6e3dc\") " pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.603505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603384    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-var-lib-cni-multus\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.603505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-run-netns\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.603505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b01c722e-6626-4a46-a68d-b516de659640-serviceca\") pod \"node-ca-skqrh\" (UID: \"b01c722e-6626-4a46-a68d-b516de659640\") " pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603517    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad763c95-3505-4748-93ff-ab0a41ee8763-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-run-multus-certs\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603504    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-run-netns\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603560    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad763c95-3505-4748-93ff-ab0a41ee8763-cni-binary-copy\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-cni-dir\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603607    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-run-multus-certs\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c0da294-f659-4e57-9cb2-268d978041c7-konnectivity-ca\") pod \"konnectivity-agent-qw68s\" (UID: \"5c0da294-f659-4e57-9cb2-268d978041c7\") " pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad763c95-3505-4748-93ff-ab0a41ee8763-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-systemd\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603720    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-socket-dir-parent\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b01c722e-6626-4a46-a68d-b516de659640-host\") pod \"node-ca-skqrh\" (UID: \"b01c722e-6626-4a46-a68d-b516de659640\") " pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603750    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-cni-dir\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.603759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/225dc1ab-4b0f-4e5d-be4c-06637e77be24-cni-binary-copy\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-run-k8s-cni-cncf-io\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad763c95-3505-4748-93ff-ab0a41ee8763-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603844    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-socket-dir-parent\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603882    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-run-k8s-cni-cncf-io\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-kubernetes\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603900    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-kubernetes\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-sysctl-conf\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603938    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-systemd\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b01c722e-6626-4a46-a68d-b516de659640-serviceca\") pod \"node-ca-skqrh\" (UID: \"b01c722e-6626-4a46-a68d-b516de659640\") " pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604095    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-sysctl-conf\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604219    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c0da294-f659-4e57-9cb2-268d978041c7-konnectivity-ca\") pod \"konnectivity-agent-qw68s\" (UID: \"5c0da294-f659-4e57-9cb2-268d978041c7\") " pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604223    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-sys\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.604357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604280    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad763c95-3505-4748-93ff-ab0a41ee8763-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad763c95-3505-4748-93ff-ab0a41ee8763-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.603943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-sys\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snrpb\" (UniqueName: \"kubernetes.io/projected/814e2509-d1b2-4c9b-81b7-b17e1af94e4a-kube-api-access-snrpb\") pod \"node-resolver-wzlbb\" (UID: \"814e2509-d1b2-4c9b-81b7-b17e1af94e4a\") " pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b01c722e-6626-4a46-a68d-b516de659640-host\") pod \"node-ca-skqrh\" (UID: \"b01c722e-6626-4a46-a68d-b516de659640\") " pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604480    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx2l2\" (UniqueName: \"kubernetes.io/projected/225dc1ab-4b0f-4e5d-be4c-06637e77be24-kube-api-access-hx2l2\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604504    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-lib-modules\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b942fac-7a98-49e1-b66a-4743ca664b7b-tmp\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr2v9\" (UniqueName: \"kubernetes.io/projected/8b942fac-7a98-49e1-b66a-4743ca664b7b-kube-api-access-kr2v9\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604603    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/225dc1ab-4b0f-4e5d-be4c-06637e77be24-cni-binary-copy\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/814e2509-d1b2-4c9b-81b7-b17e1af94e4a-hosts-file\") pod \"node-resolver-wzlbb\" (UID: \"814e2509-d1b2-4c9b-81b7-b17e1af94e4a\") " pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604663    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-var-lib-kubelet\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604665    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-lib-modules\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-hostroot\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604707    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/814e2509-d1b2-4c9b-81b7-b17e1af94e4a-hosts-file\") pod \"node-resolver-wzlbb\" (UID: \"814e2509-d1b2-4c9b-81b7-b17e1af94e4a\") " pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad763c95-3505-4748-93ff-ab0a41ee8763-cnibin\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604731    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-var-lib-kubelet\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bdrs\" (UniqueName: \"kubernetes.io/projected/ad763c95-3505-4748-93ff-ab0a41ee8763-kube-api-access-6bdrs\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.605002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604724    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-hostroot\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-sysconfig\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad763c95-3505-4748-93ff-ab0a41ee8763-cnibin\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604764    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad763c95-3505-4748-93ff-ab0a41ee8763-cni-binary-copy\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-run\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-sysconfig\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604849    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/814e2509-d1b2-4c9b-81b7-b17e1af94e4a-tmp-dir\") pod \"node-resolver-wzlbb\" (UID: \"814e2509-d1b2-4c9b-81b7-b17e1af94e4a\") " pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-run\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604944    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln7wz\" (UniqueName: \"kubernetes.io/projected/b01c722e-6626-4a46-a68d-b516de659640-kube-api-access-ln7wz\") pod \"node-ca-skqrh\" (UID: \"b01c722e-6626-4a46-a68d-b516de659640\") " pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604973    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-modprobe-d\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.604989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-sysctl-d\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c8264cd-918c-4ddd-bd27-dee318c6e3dc-iptables-alerter-script\") pod \"iptables-alerter-mrkhc\" (UID: \"0c8264cd-918c-4ddd-bd27-dee318c6e3dc\") " pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-dbus\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-tuned\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-var-lib-cni-bin\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605115    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-conf-dir\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605113    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/814e2509-d1b2-4c9b-81b7-b17e1af94e4a-tmp-dir\") pod \"node-resolver-wzlbb\" (UID: \"814e2509-d1b2-4c9b-81b7-b17e1af94e4a\") " pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-etc-kubernetes\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.605754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605160    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-sysctl-d\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-etc-kubernetes\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605209    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-system-cni-dir\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605210    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-dbus\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605094    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-modprobe-d\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605246    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605268    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-conf-dir\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c0da294-f659-4e57-9cb2-268d978041c7-agent-certs\") pod \"konnectivity-agent-qw68s\" (UID: \"5c0da294-f659-4e57-9cb2-268d978041c7\") " pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-kubelet-config\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-cnibin\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-daemon-config\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad763c95-3505-4748-93ff-ab0a41ee8763-system-cni-dir\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605403    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-var-lib-kubelet\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605426    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k872d\" (UniqueName: \"kubernetes.io/projected/0c8264cd-918c-4ddd-bd27-dee318c6e3dc-kube-api-access-k872d\") pod \"iptables-alerter-mrkhc\" (UID: \"0c8264cd-918c-4ddd-bd27-dee318c6e3dc\") " pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-host\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605489    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-system-cni-dir\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605494    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-kubelet-config\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605538    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c8264cd-918c-4ddd-bd27-dee318c6e3dc-iptables-alerter-script\") pod \"iptables-alerter-mrkhc\" (UID: \"0c8264cd-918c-4ddd-bd27-dee318c6e3dc\") " pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.606604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605556    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad763c95-3505-4748-93ff-ab0a41ee8763-system-cni-dir\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.607486 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.605563    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:32.607486 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605559    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-cnibin\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.607486 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.605588    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/225dc1ab-4b0f-4e5d-be4c-06637e77be24-host-var-lib-cni-bin\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.607927 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:32.607909    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret podName:1fdc998a-15cc-4e00-97ee-00c1b11db4cc nodeName:}" failed. No retries permitted until 2026-09-17 23:06:33.10787949 +0000 UTC m=+4.715457145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret") pod "global-pull-secret-syncer-fvjmj" (UID: "1fdc998a-15cc-4e00-97ee-00c1b11db4cc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:32.608788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.608539    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-host\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.608788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.608719    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b942fac-7a98-49e1-b66a-4743ca664b7b-var-lib-kubelet\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.608788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.608742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b942fac-7a98-49e1-b66a-4743ca664b7b-tmp\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.611393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.608960    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c0da294-f659-4e57-9cb2-268d978041c7-agent-certs\") pod \"konnectivity-agent-qw68s\" (UID: \"5c0da294-f659-4e57-9cb2-268d978041c7\") " pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:32.611393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.609008    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/225dc1ab-4b0f-4e5d-be4c-06637e77be24-multus-daemon-config\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.611743 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.611720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b942fac-7a98-49e1-b66a-4743ca664b7b-etc-tuned\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.619208 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.619183    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snrpb\" (UniqueName: \"kubernetes.io/projected/814e2509-d1b2-4c9b-81b7-b17e1af94e4a-kube-api-access-snrpb\") pod \"node-resolver-wzlbb\" (UID: \"814e2509-d1b2-4c9b-81b7-b17e1af94e4a\") " pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.620218 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.620193    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr2v9\" (UniqueName: \"kubernetes.io/projected/8b942fac-7a98-49e1-b66a-4743ca664b7b-kube-api-access-kr2v9\") pod \"tuned-2mjrz\" (UID: \"8b942fac-7a98-49e1-b66a-4743ca664b7b\") " pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.620357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.620337    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx2l2\" (UniqueName: \"kubernetes.io/projected/225dc1ab-4b0f-4e5d-be4c-06637e77be24-kube-api-access-hx2l2\") pod \"multus-lkdzw\" (UID: \"225dc1ab-4b0f-4e5d-be4c-06637e77be24\") " pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.624437 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.624380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k872d\" (UniqueName: \"kubernetes.io/projected/0c8264cd-918c-4ddd-bd27-dee318c6e3dc-kube-api-access-k872d\") pod \"iptables-alerter-mrkhc\" (UID: \"0c8264cd-918c-4ddd-bd27-dee318c6e3dc\") " pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.624569 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.624552    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln7wz\" (UniqueName: \"kubernetes.io/projected/b01c722e-6626-4a46-a68d-b516de659640-kube-api-access-ln7wz\") pod \"node-ca-skqrh\" (UID: \"b01c722e-6626-4a46-a68d-b516de659640\") " pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.624839 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.624811    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bdrs\" (UniqueName: \"kubernetes.io/projected/ad763c95-3505-4748-93ff-ab0a41ee8763-kube-api-access-6bdrs\") pod \"multus-additional-cni-plugins-h42tf\" (UID: \"ad763c95-3505-4748-93ff-ab0a41ee8763\") " pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.697081 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.697041    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc"
Sep 17 23:06:32.704843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.704811    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:32.716594 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.716569    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mrkhc"
Sep 17 23:06:32.722477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.722439    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wzlbb"
Sep 17 23:06:32.731585 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.731562    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-skqrh"
Sep 17 23:06:32.739230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.739203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lkdzw"
Sep 17 23:06:32.748086 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.748061    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h42tf"
Sep 17 23:06:32.758211 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.758182    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2mjrz"
Sep 17 23:06:32.763202 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.763165    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:32.867388 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:32.867355    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:33.008542 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.008444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:33.008542 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.008507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6ql\" (UniqueName: \"kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql\") pod \"network-check-target-zsdgk\" (UID: \"d759aa46-0c62-4f7b-90e1-e8ed71a3a079\") " pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:33.008742 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:33.008620    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:33.008742 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:33.008633    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:33.008742 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:33.008653    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:33.008742 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:33.008665    2583 projected.go:196] Error preparing data for projected volume kube-api-access-hs6ql for pod openshift-network-diagnostics/network-check-target-zsdgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:33.008742 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:33.008700    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs podName:e32a70e6-4684-4db1-9047-07504bd11322 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:34.008679931 +0000 UTC m=+5.616257581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs") pod "network-metrics-daemon-d8wwk" (UID: "e32a70e6-4684-4db1-9047-07504bd11322") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:33.008742 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:33.008716    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql podName:d759aa46-0c62-4f7b-90e1-e8ed71a3a079 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:34.008709842 +0000 UTC m=+5.616287480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs6ql" (UniqueName: "kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql") pod "network-check-target-zsdgk" (UID: "d759aa46-0c62-4f7b-90e1-e8ed71a3a079") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:33.109274 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.109208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:33.109430 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:33.109358    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:33.109518 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:33.109441    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret podName:1fdc998a-15cc-4e00-97ee-00c1b11db4cc nodeName:}" failed. No retries permitted until 2026-09-17 23:06:34.10942137 +0000 UTC m=+5.716999029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret") pod "global-pull-secret-syncer-fvjmj" (UID: "1fdc998a-15cc-4e00-97ee-00c1b11db4cc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:33.429074 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.429023    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 23:01:32 +0000 UTC" deadline="2028-06-12 22:10:23.127530044 +0000 UTC"
Sep 17 23:06:33.429074 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.429071    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15215h3m49.698462633s"
Sep 17 23:06:33.439186 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:33.439157    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225dc1ab_4b0f_4e5d_be4c_06637e77be24.slice/crio-5d098e10b210077392f016f638c499ce76f495f1ea4a440257f91402b3ce1c8e WatchSource:0}: Error finding container 5d098e10b210077392f016f638c499ce76f495f1ea4a440257f91402b3ce1c8e: Status 404 returned error can't find the container with id 5d098e10b210077392f016f638c499ce76f495f1ea4a440257f91402b3ce1c8e
Sep 17 23:06:33.441983 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:33.441961    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8264cd_918c_4ddd_bd27_dee318c6e3dc.slice/crio-874382ab7200eec877e69bc066633448027609549dea6ca90704bfbda21c8a80 WatchSource:0}: Error finding container 874382ab7200eec877e69bc066633448027609549dea6ca90704bfbda21c8a80: Status 404 returned error can't find the container with id 874382ab7200eec877e69bc066633448027609549dea6ca90704bfbda21c8a80
Sep 17 23:06:33.443187 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:33.443160    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a69d421_fd13_4891_aca0_89a67b766906.slice/crio-e1e7a6b554d8d578dbffa55748c6e4c8310a81d618e997b7c6cb8249a70aa71d WatchSource:0}: Error finding container e1e7a6b554d8d578dbffa55748c6e4c8310a81d618e997b7c6cb8249a70aa71d: Status 404 returned error can't find the container with id e1e7a6b554d8d578dbffa55748c6e4c8310a81d618e997b7c6cb8249a70aa71d
Sep 17 23:06:33.446406 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:33.446386    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814e2509_d1b2_4c9b_81b7_b17e1af94e4a.slice/crio-cdf9606de39f783d25b96fa19f8c4eca69e6eed3dc330151daeddc16b2bd0cae WatchSource:0}: Error finding container cdf9606de39f783d25b96fa19f8c4eca69e6eed3dc330151daeddc16b2bd0cae: Status 404 returned error can't find the container with id cdf9606de39f783d25b96fa19f8c4eca69e6eed3dc330151daeddc16b2bd0cae
Sep 17 23:06:33.447137 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:33.447109    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0da294_f659_4e57_9cb2_268d978041c7.slice/crio-b58b1b561d6d536199136572c02df1a9427e27f5a1571a217297d997f1e6d34e WatchSource:0}: Error finding container b58b1b561d6d536199136572c02df1a9427e27f5a1571a217297d997f1e6d34e: Status 404 returned error can't find the container with id b58b1b561d6d536199136572c02df1a9427e27f5a1571a217297d997f1e6d34e
Sep 17 23:06:33.447912 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:33.447890    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01c722e_6626_4a46_a68d_b516de659640.slice/crio-577b597d4041efbb1adf3b84a918cf18a0851dfb4f590d5e96fc3ae0b23fe240 WatchSource:0}: Error finding container 577b597d4041efbb1adf3b84a918cf18a0851dfb4f590d5e96fc3ae0b23fe240: Status 404 returned error can't find the container with id 577b597d4041efbb1adf3b84a918cf18a0851dfb4f590d5e96fc3ae0b23fe240
Sep 17 23:06:33.449134 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:33.449117    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad763c95_3505_4748_93ff_ab0a41ee8763.slice/crio-7cbbba5803a727a0682a9732bd54ef9763963f9e72ca1a2dccc186dc1c09bf70 WatchSource:0}: Error finding container 7cbbba5803a727a0682a9732bd54ef9763963f9e72ca1a2dccc186dc1c09bf70: Status 404 returned error can't find the container with id 7cbbba5803a727a0682a9732bd54ef9763963f9e72ca1a2dccc186dc1c09bf70
Sep 17 23:06:33.450073 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:33.449997    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a48005d_f884_4cdc_94dd_66f406cbc610.slice/crio-cb9757622bbe3816c39dd2b46e6588fbb0c1f97d52f3a8693d28d2c6667f4bad WatchSource:0}: Error finding container cb9757622bbe3816c39dd2b46e6588fbb0c1f97d52f3a8693d28d2c6667f4bad: Status 404 returned error can't find the container with id cb9757622bbe3816c39dd2b46e6588fbb0c1f97d52f3a8693d28d2c6667f4bad
Sep 17 23:06:33.451689 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:06:33.451310    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b942fac_7a98_49e1_b66a_4743ca664b7b.slice/crio-f477580f17f16717b0b5ce48078579bc36aaad92c33463d3aa43dc0607afbe39 WatchSource:0}: Error finding container f477580f17f16717b0b5ce48078579bc36aaad92c33463d3aa43dc0607afbe39: Status 404 returned error can't find the container with id f477580f17f16717b0b5ce48078579bc36aaad92c33463d3aa43dc0607afbe39
Sep 17 23:06:33.481087 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.481065    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:33.481183 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:33.481158    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:33.497320 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.497287    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2mjrz" event={"ID":"8b942fac-7a98-49e1-b66a-4743ca664b7b","Type":"ContainerStarted","Data":"f477580f17f16717b0b5ce48078579bc36aaad92c33463d3aa43dc0607afbe39"}
Sep 17 23:06:33.499373 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.499341    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h42tf" event={"ID":"ad763c95-3505-4748-93ff-ab0a41ee8763","Type":"ContainerStarted","Data":"7cbbba5803a727a0682a9732bd54ef9763963f9e72ca1a2dccc186dc1c09bf70"}
Sep 17 23:06:33.500986 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.500897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-skqrh" event={"ID":"b01c722e-6626-4a46-a68d-b516de659640","Type":"ContainerStarted","Data":"577b597d4041efbb1adf3b84a918cf18a0851dfb4f590d5e96fc3ae0b23fe240"}
Sep 17 23:06:33.502080 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.502057    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wzlbb" event={"ID":"814e2509-d1b2-4c9b-81b7-b17e1af94e4a","Type":"ContainerStarted","Data":"cdf9606de39f783d25b96fa19f8c4eca69e6eed3dc330151daeddc16b2bd0cae"}
Sep 17 23:06:33.503213 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.503190    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr" event={"ID":"8a69d421-fd13-4891-aca0-89a67b766906","Type":"ContainerStarted","Data":"e1e7a6b554d8d578dbffa55748c6e4c8310a81d618e997b7c6cb8249a70aa71d"}
Sep 17 23:06:33.504407 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.504382    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mrkhc" event={"ID":"0c8264cd-918c-4ddd-bd27-dee318c6e3dc","Type":"ContainerStarted","Data":"874382ab7200eec877e69bc066633448027609549dea6ca90704bfbda21c8a80"}
Sep 17 23:06:33.505583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.505560    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkdzw" event={"ID":"225dc1ab-4b0f-4e5d-be4c-06637e77be24","Type":"ContainerStarted","Data":"5d098e10b210077392f016f638c499ce76f495f1ea4a440257f91402b3ce1c8e"}
Sep 17 23:06:33.506925 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.506650    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc" event={"ID":"0a48005d-f884-4cdc-94dd-66f406cbc610","Type":"ContainerStarted","Data":"cb9757622bbe3816c39dd2b46e6588fbb0c1f97d52f3a8693d28d2c6667f4bad"}
Sep 17 23:06:33.507825 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:33.507801    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qw68s" event={"ID":"5c0da294-f659-4e57-9cb2-268d978041c7","Type":"ContainerStarted","Data":"b58b1b561d6d536199136572c02df1a9427e27f5a1571a217297d997f1e6d34e"}
Sep 17 23:06:34.017201 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.017164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:34.017493 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.017226    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6ql\" (UniqueName: \"kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql\") pod \"network-check-target-zsdgk\" (UID: \"d759aa46-0c62-4f7b-90e1-e8ed71a3a079\") " pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:34.017493 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:34.017411    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:34.017493 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:34.017433    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:34.017493 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:34.017447    2583 projected.go:196] Error preparing data for projected volume kube-api-access-hs6ql for pod openshift-network-diagnostics/network-check-target-zsdgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:34.017786 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:34.017521    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql podName:d759aa46-0c62-4f7b-90e1-e8ed71a3a079 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:36.017502274 +0000 UTC m=+7.625079915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs6ql" (UniqueName: "kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql") pod "network-check-target-zsdgk" (UID: "d759aa46-0c62-4f7b-90e1-e8ed71a3a079") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:34.017941 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:34.017912    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:34.018004 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:34.017970    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs podName:e32a70e6-4684-4db1-9047-07504bd11322 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:36.017954809 +0000 UTC m=+7.625532447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs") pod "network-metrics-daemon-d8wwk" (UID: "e32a70e6-4684-4db1-9047-07504bd11322") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:34.118222 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.118175    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:34.118405 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:34.118373    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:34.118516 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:34.118436    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret podName:1fdc998a-15cc-4e00-97ee-00c1b11db4cc nodeName:}" failed. No retries permitted until 2026-09-17 23:06:36.118418292 +0000 UTC m=+7.725995934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret") pod "global-pull-secret-syncer-fvjmj" (UID: "1fdc998a-15cc-4e00-97ee-00c1b11db4cc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:34.430260 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.429903    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 23:01:32 +0000 UTC" deadline="2028-06-09 20:38:23.831718664 +0000 UTC"
Sep 17 23:06:34.430260 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.430176    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15141h31m49.401550317s"
Sep 17 23:06:34.483138 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.482593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:34.483138 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:34.482760    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:34.483138 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.482599    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:34.483138 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:34.482947    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:34.539148 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.538726    2583 generic.go:356] "Generic (PLEG): container finished" podID="eab2e6eb3aed73f0fd06af8490099cf1" containerID="0681d5eeb3a4eca2be655721474ac644bc357cf85f46fbf0e5e63d8b16c14eb7" exitCode=0
Sep 17 23:06:34.539148 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.539050    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"eab2e6eb3aed73f0fd06af8490099cf1","Type":"ContainerDied","Data":"0681d5eeb3a4eca2be655721474ac644bc357cf85f46fbf0e5e63d8b16c14eb7"}
Sep 17 23:06:34.544117 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.544079    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" event={"ID":"e2a8d187de3034f51c9752cc1f41717d","Type":"ContainerStarted","Data":"62ca9c93ca862cfab37a67a73122989fe5042ee2ff8da0d00a51baff38a81419"}
Sep 17 23:06:34.581374 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:34.581308    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" podStartSLOduration=3.581287518 podStartE2EDuration="3.581287518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:34.580739034 +0000 UTC m=+6.188316714" watchObservedRunningTime="2026-09-17 23:06:34.581287518 +0000 UTC m=+6.188865179"
Sep 17 23:06:35.481076 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:35.481042    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:35.481608 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:35.481175    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:35.573412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:35.573377    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"eab2e6eb3aed73f0fd06af8490099cf1","Type":"ContainerStarted","Data":"f17a9a297e09e753a7c6f69602d844f79d1dce83d3b9489fe30012d564bbf540"}
Sep 17 23:06:35.590293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:35.590229    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" podStartSLOduration=4.590207744 podStartE2EDuration="4.590207744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:35.590085848 +0000 UTC m=+7.197663528" watchObservedRunningTime="2026-09-17 23:06:35.590207744 +0000 UTC m=+7.197785402"
Sep 17 23:06:36.033255 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:36.033209    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:36.033431 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:36.033272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6ql\" (UniqueName: \"kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql\") pod \"network-check-target-zsdgk\" (UID: \"d759aa46-0c62-4f7b-90e1-e8ed71a3a079\") " pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:36.033516 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:36.033478    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:36.033516 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:36.033501    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:36.033516 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:36.033514    2583 projected.go:196] Error preparing data for projected volume kube-api-access-hs6ql for pod openshift-network-diagnostics/network-check-target-zsdgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:36.033738 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:36.033574    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql podName:d759aa46-0c62-4f7b-90e1-e8ed71a3a079 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:40.033556504 +0000 UTC m=+11.641134157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs6ql" (UniqueName: "kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql") pod "network-check-target-zsdgk" (UID: "d759aa46-0c62-4f7b-90e1-e8ed71a3a079") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:36.033988 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:36.033968    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:36.034077 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:36.034066    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs podName:e32a70e6-4684-4db1-9047-07504bd11322 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:40.034051974 +0000 UTC m=+11.641629627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs") pod "network-metrics-daemon-d8wwk" (UID: "e32a70e6-4684-4db1-9047-07504bd11322") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:36.134082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:36.134044    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:36.134308 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:36.134179    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:36.134308 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:36.134239    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret podName:1fdc998a-15cc-4e00-97ee-00c1b11db4cc nodeName:}" failed. No retries permitted until 2026-09-17 23:06:40.134221836 +0000 UTC m=+11.741799477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret") pod "global-pull-secret-syncer-fvjmj" (UID: "1fdc998a-15cc-4e00-97ee-00c1b11db4cc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:36.482661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:36.482579    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:36.483093 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:36.482728    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:36.484407 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:36.484383    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:36.484547 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:36.484515    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:37.481108 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:37.480970    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:37.481108 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:37.481102    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:38.481506 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:38.481456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:38.482084 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:38.481609    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:38.482084 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:38.481993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:38.482211 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:38.482083    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:39.482117 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:39.481588    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:39.482117 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:39.481722    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:40.066146 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:40.066096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:40.066146 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:40.066151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6ql\" (UniqueName: \"kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql\") pod \"network-check-target-zsdgk\" (UID: \"d759aa46-0c62-4f7b-90e1-e8ed71a3a079\") " pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:40.066409 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:40.066312    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:40.066409 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:40.066328    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:40.066409 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:40.066338    2583 projected.go:196] Error preparing data for projected volume kube-api-access-hs6ql for pod openshift-network-diagnostics/network-check-target-zsdgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:40.066409 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:40.066385    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql podName:d759aa46-0c62-4f7b-90e1-e8ed71a3a079 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:48.066370652 +0000 UTC m=+19.673948290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs6ql" (UniqueName: "kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql") pod "network-check-target-zsdgk" (UID: "d759aa46-0c62-4f7b-90e1-e8ed71a3a079") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:40.066841 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:40.066749    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:40.066841 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:40.066819    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs podName:e32a70e6-4684-4db1-9047-07504bd11322 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:48.0668022 +0000 UTC m=+19.674379855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs") pod "network-metrics-daemon-d8wwk" (UID: "e32a70e6-4684-4db1-9047-07504bd11322") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:40.167478 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:40.167423    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:40.167664 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:40.167606    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:40.167729 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:40.167690    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret podName:1fdc998a-15cc-4e00-97ee-00c1b11db4cc nodeName:}" failed. No retries permitted until 2026-09-17 23:06:48.167669408 +0000 UTC m=+19.775247056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret") pod "global-pull-secret-syncer-fvjmj" (UID: "1fdc998a-15cc-4e00-97ee-00c1b11db4cc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:40.481848 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:40.481340    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:40.481848 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:40.481452    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:40.481848 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:40.481634    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:40.481848 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:40.481747    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:41.481708 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:41.480990    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:41.481708 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:41.481143    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:42.481265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:42.481229    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:42.481454 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:42.481376    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:42.481454 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:42.481427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:42.481575 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:42.481558    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:43.481100 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:43.481055    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:43.481526 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:43.481170    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:44.481135 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:44.481095    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:44.481135 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:44.481110    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:44.481686 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:44.481237    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:44.481686 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:44.481373    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:45.481067 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:45.481029    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:45.481241 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:45.481146    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:46.484202 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:46.484170    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:46.484654 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:46.484288    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:46.484654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:46.484347    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:46.484654 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:46.484437    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:47.481803 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:47.481754    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:47.482004 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:47.481869    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:48.129589 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:48.129555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:48.129589 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:48.129594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6ql\" (UniqueName: \"kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql\") pod \"network-check-target-zsdgk\" (UID: \"d759aa46-0c62-4f7b-90e1-e8ed71a3a079\") " pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:48.130024 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:48.129731    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:48.130024 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:48.129780    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:48.130024 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:48.129799    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:48.130024 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:48.129811    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs podName:e32a70e6-4684-4db1-9047-07504bd11322 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:04.129790649 +0000 UTC m=+35.737368296 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs") pod "network-metrics-daemon-d8wwk" (UID: "e32a70e6-4684-4db1-9047-07504bd11322") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:48.130024 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:48.129813    2583 projected.go:196] Error preparing data for projected volume kube-api-access-hs6ql for pod openshift-network-diagnostics/network-check-target-zsdgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:48.130024 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:48.129852    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql podName:d759aa46-0c62-4f7b-90e1-e8ed71a3a079 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:04.129842138 +0000 UTC m=+35.737419776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs6ql" (UniqueName: "kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql") pod "network-check-target-zsdgk" (UID: "d759aa46-0c62-4f7b-90e1-e8ed71a3a079") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:48.230420 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:48.230380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:48.230616 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:48.230530    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:48.230616 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:48.230608    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret podName:1fdc998a-15cc-4e00-97ee-00c1b11db4cc nodeName:}" failed. No retries permitted until 2026-09-17 23:07:04.230588642 +0000 UTC m=+35.838166286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret") pod "global-pull-secret-syncer-fvjmj" (UID: "1fdc998a-15cc-4e00-97ee-00c1b11db4cc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:48.481875 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:48.481781    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:48.482031 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:48.481910    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:48.482031 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:48.481969    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:48.482143 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:48.482110    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:49.481866 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:49.481821    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:49.482351 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:49.481967    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:50.481917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:50.481879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:50.482390 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:50.482014    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:50.482390 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:50.482098    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:50.482390 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:50.482213    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:51.481747 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.481457    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:51.481899 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:51.481873    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:51.610779 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.610745    2583 generic.go:356] "Generic (PLEG): container finished" podID="ad763c95-3505-4748-93ff-ab0a41ee8763" containerID="a173443e9cff506d50026a12e6f6967d631c34f44713ddc2b8a4dbe3b25b79b6" exitCode=0
Sep 17 23:06:51.611734 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.610826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h42tf" event={"ID":"ad763c95-3505-4748-93ff-ab0a41ee8763","Type":"ContainerDied","Data":"a173443e9cff506d50026a12e6f6967d631c34f44713ddc2b8a4dbe3b25b79b6"}
Sep 17 23:06:51.613093 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.613013    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-skqrh" event={"ID":"b01c722e-6626-4a46-a68d-b516de659640","Type":"ContainerStarted","Data":"972503a4e29512293885c77272297d878c01b8faa8e3b81efb8196c3582e90e3"}
Sep 17 23:06:51.614969 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.614937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wzlbb" event={"ID":"814e2509-d1b2-4c9b-81b7-b17e1af94e4a","Type":"ContainerStarted","Data":"96126d77704452b4d8c947d9852b6f373bec1d5b90d7370a41ed93f11ba1b061"}
Sep 17 23:06:51.618525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.618496    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr" event={"ID":"8a69d421-fd13-4891-aca0-89a67b766906","Type":"ContainerStarted","Data":"8ecff48e145a52d44277ac828188f1386bbd496701e30d530336950e50895427"}
Sep 17 23:06:51.618628 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.618581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr" event={"ID":"8a69d421-fd13-4891-aca0-89a67b766906","Type":"ContainerStarted","Data":"3052bc017c4104888e72591b2e1d278ab0967f628bff8863c9aee13edefb9f38"}
Sep 17 23:06:51.618673 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.618632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr" event={"ID":"8a69d421-fd13-4891-aca0-89a67b766906","Type":"ContainerStarted","Data":"64c4023cd12402f42b1c95a75ea77103795436a9c4266ae81a4218ef1ee2460d"}
Sep 17 23:06:51.620214 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.620154    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkdzw" event={"ID":"225dc1ab-4b0f-4e5d-be4c-06637e77be24","Type":"ContainerStarted","Data":"18b7c3553b91ff6d55e224f7c82dec94c59fe3fa707dc2bc59b8f7b2170f9612"}
Sep 17 23:06:51.621960 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.621935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc" event={"ID":"0a48005d-f884-4cdc-94dd-66f406cbc610","Type":"ContainerStarted","Data":"2c2bb8878dc74bd78dd4d54d70e0d74732a1b71c2607d67cbecff01e5a1cec10"}
Sep 17 23:06:51.623529 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.623510    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qw68s" event={"ID":"5c0da294-f659-4e57-9cb2-268d978041c7","Type":"ContainerStarted","Data":"7629287cf438af4ec0ec85555cec8f7ed9edbef7eba5de6bccfcf01323cb77e5"}
Sep 17 23:06:51.625255 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.625233    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2mjrz" event={"ID":"8b942fac-7a98-49e1-b66a-4743ca664b7b","Type":"ContainerStarted","Data":"c2c80e18bcacdd513c9887796c5b43509dae4e433f7c476acfd9ce799858057a"}
Sep 17 23:06:51.656100 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.656057    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2mjrz" podStartSLOduration=3.96801943 podStartE2EDuration="21.656040509s" totalImagesPullingTime="17.688021079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:51.655763858 +0000 UTC m=+23.263341517" watchObservedRunningTime="2026-09-17 23:06:51.656040509 +0000 UTC m=+23.263618169"
Sep 17 23:06:51.674148 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.674090    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qw68s" podStartSLOduration=8.230228707 podStartE2EDuration="21.674069829s" totalImagesPullingTime="13.443841122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:51.673103612 +0000 UTC m=+23.280681272" watchObservedRunningTime="2026-09-17 23:06:51.674069829 +0000 UTC m=+23.281647491"
Sep 17 23:06:51.687096 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.687055    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-skqrh" podStartSLOduration=3.9978265630000003 podStartE2EDuration="21.687039755s" totalImagesPullingTime="17.689213192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:51.686754476 +0000 UTC m=+23.294332136" watchObservedRunningTime="2026-09-17 23:06:51.687039755 +0000 UTC m=+23.294617416"
Sep 17 23:06:51.705893 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.705844    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lkdzw" podStartSLOduration=3.95477515 podStartE2EDuration="21.70582871s" totalImagesPullingTime="17.75105356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:51.705448835 +0000 UTC m=+23.313026513" watchObservedRunningTime="2026-09-17 23:06:51.70582871 +0000 UTC m=+23.313406370"
Sep 17 23:06:51.721375 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:51.721332    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wzlbb" podStartSLOduration=4.078469005 podStartE2EDuration="21.721317029s" totalImagesPullingTime="17.642848024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:51.720631034 +0000 UTC m=+23.328208698" watchObservedRunningTime="2026-09-17 23:06:51.721317029 +0000 UTC m=+23.328894689"
Sep 17 23:06:52.384064 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:52.383900    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 23:06:52.481770 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:52.481739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:52.481930 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:52.481862    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:52.481997 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:52.481923    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:52.482070 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:52.482034    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:52.491780 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:52.491695    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T23:06:52.384059082Z","UUID":"82e04efb-c3eb-4ae7-b372-cba1e8f1e410","Handler":null,"Name":"","Endpoint":""}
Sep 17 23:06:52.493482 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:52.493443    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 23:06:52.493615 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:52.493521    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 23:06:52.630915 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:52.630885    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr" event={"ID":"8a69d421-fd13-4891-aca0-89a67b766906","Type":"ContainerStarted","Data":"d028de58f876e3b3348206ca195833dd208978173220873d5ac9ad599cbcfaa8"}
Sep 17 23:06:52.631341 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:52.630961    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr" event={"ID":"8a69d421-fd13-4891-aca0-89a67b766906","Type":"ContainerStarted","Data":"88cb72d811753ea91b952ee887a47936933952302f0c3235385f92cfedfdfaa5"}
Sep 17 23:06:52.631341 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:52.631004    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr" event={"ID":"8a69d421-fd13-4891-aca0-89a67b766906","Type":"ContainerStarted","Data":"d9a05b3898cdd99879b003ffef9618c36a16b5c926d1775788da1057efbcd959"}
Sep 17 23:06:52.632783 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:52.632757    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc" event={"ID":"0a48005d-f884-4cdc-94dd-66f406cbc610","Type":"ContainerStarted","Data":"4f0e7503a0db48dcdad70b083b70926fe37a43a57d57c9329472a8573df00f61"}
Sep 17 23:06:53.481694 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:53.481660    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:53.481861 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:53.481790    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:53.637399 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:53.637361    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mrkhc" event={"ID":"0c8264cd-918c-4ddd-bd27-dee318c6e3dc","Type":"ContainerStarted","Data":"660e003369bbee65cb92c668b59c6402e069c9c71571adca80b5c7a22c208442"}
Sep 17 23:06:53.639873 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:53.639840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc" event={"ID":"0a48005d-f884-4cdc-94dd-66f406cbc610","Type":"ContainerStarted","Data":"e5d293945511e84bedea1a03df601ffc3c0c384550a3083125457776dc0f29ea"}
Sep 17 23:06:53.658759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:53.658714    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mrkhc" podStartSLOduration=5.96296611 podStartE2EDuration="23.65869607s" totalImagesPullingTime="17.69572996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:53.658025681 +0000 UTC m=+25.265603370" watchObservedRunningTime="2026-09-17 23:06:53.65869607 +0000 UTC m=+25.266273730"
Sep 17 23:06:53.678999 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:53.678948    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc" podStartSLOduration=4.25956088 podStartE2EDuration="23.678934772s" totalImagesPullingTime="19.419373892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:53.67861059 +0000 UTC m=+25.286188257" watchObservedRunningTime="2026-09-17 23:06:53.678934772 +0000 UTC m=+25.286512432"
Sep 17 23:06:54.481159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:54.481123    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:54.481330 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:54.481123    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:54.481330 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:54.481269    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:54.481452 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:54.481350    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:54.646089 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:54.646051    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr" event={"ID":"8a69d421-fd13-4891-aca0-89a67b766906","Type":"ContainerStarted","Data":"49eabd6cd8883df2ed40be89fcdcf72c3b76c6a6b6c3c8689ff6a9396082cc1b"}
Sep 17 23:06:55.481294 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:55.481258    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:55.481489 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:55.481395    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:56.465691 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.465425    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:56.466197 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.465980    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:56.480782 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.480754    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:56.480898 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:56.480854    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:56.480975 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.480937    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:56.481033 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:56.481021    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:56.652935 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.652898    2583 generic.go:356] "Generic (PLEG): container finished" podID="ad763c95-3505-4748-93ff-ab0a41ee8763" containerID="b6b58c5b7e008feca01741f020870230d6a7e7b70de918d41ed7ff9feac28a03" exitCode=0
Sep 17 23:06:56.653074 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.652993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h42tf" event={"ID":"ad763c95-3505-4748-93ff-ab0a41ee8763","Type":"ContainerDied","Data":"b6b58c5b7e008feca01741f020870230d6a7e7b70de918d41ed7ff9feac28a03"}
Sep 17 23:06:56.657180 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.657157    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr" event={"ID":"8a69d421-fd13-4891-aca0-89a67b766906","Type":"ContainerStarted","Data":"0755c87011302aa97d957fc2368e223dad4ec465063c7a25f51ad70fe1deb8f6"}
Sep 17 23:06:56.657280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.657243    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:56.657519 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.657499    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:56.657811 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.657794    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qw68s"
Sep 17 23:06:56.672984 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.672944    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:56.713443 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:56.713381    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr" podStartSLOduration=9.003191333 podStartE2EDuration="26.713364712s" totalImagesPullingTime="17.710173379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:56.712866726 +0000 UTC m=+28.320444401" watchObservedRunningTime="2026-09-17 23:06:56.713364712 +0000 UTC m=+28.320942372"
Sep 17 23:06:57.480826 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:57.480788    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:57.481434 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:57.480915    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:57.659820 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:57.659787    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:57.660145 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:57.660128    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:57.674929 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:57.674898    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:06:58.158137 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:58.157888    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fvjmj"]
Sep 17 23:06:58.158335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:58.158301    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:58.158422 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:58.158402    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:58.160635 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:58.160589    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d8wwk"]
Sep 17 23:06:58.160769 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:58.160726    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:58.160882 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:58.160831    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:06:58.161381 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:58.161358    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zsdgk"]
Sep 17 23:06:58.161491 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:58.161473    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:58.161586 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:58.161563    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:58.664044 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:58.664013    2583 generic.go:356] "Generic (PLEG): container finished" podID="ad763c95-3505-4748-93ff-ab0a41ee8763" containerID="ea607f4a9ec1e25698b83b845d351689d124dc697d6ca57bc39b282b6b1848e5" exitCode=0
Sep 17 23:06:58.664445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:58.664093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h42tf" event={"ID":"ad763c95-3505-4748-93ff-ab0a41ee8763","Type":"ContainerDied","Data":"ea607f4a9ec1e25698b83b845d351689d124dc697d6ca57bc39b282b6b1848e5"}
Sep 17 23:06:59.481624 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:59.481592    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:06:59.481780 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:59.481594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:06:59.481780 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:59.481697    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:06:59.481886 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:59.481777    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:06:59.481886 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:06:59.481594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:06:59.481886 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:06:59.481866    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:00.671903 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:00.671869    2583 generic.go:356] "Generic (PLEG): container finished" podID="ad763c95-3505-4748-93ff-ab0a41ee8763" containerID="0324997822db2dbe762e2e24fd4c695546827665957cb4ab0e05a4794cea51f7" exitCode=0
Sep 17 23:07:00.672284 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:00.671924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h42tf" event={"ID":"ad763c95-3505-4748-93ff-ab0a41ee8763","Type":"ContainerDied","Data":"0324997822db2dbe762e2e24fd4c695546827665957cb4ab0e05a4794cea51f7"}
Sep 17 23:07:00.985975 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:00.985943    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wzlbb_814e2509-d1b2-4c9b-81b7-b17e1af94e4a/dns-node-resolver/0.log"
Sep 17 23:07:01.481561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:01.481522    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:01.481561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:01.481552    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:01.481804 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:01.481658    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:01.481804 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:01.481712    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:01.481804 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:01.481745    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:01.481959 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:01.481818    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:01.952736 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:01.952704    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-skqrh_b01c722e-6626-4a46-a68d-b516de659640/node-ca/0.log"
Sep 17 23:07:03.483583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:03.481937    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:03.483583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:03.481998    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:03.483583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:03.482001    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:03.483583 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:03.482129    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:03.483583 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:03.482719    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:03.483583 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:03.482836    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:04.143759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:04.143728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:04.143759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:04.143766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6ql\" (UniqueName: \"kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql\") pod \"network-check-target-zsdgk\" (UID: \"d759aa46-0c62-4f7b-90e1-e8ed71a3a079\") " pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:04.144003 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:04.143906    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:07:04.144003 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:04.143995    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs podName:e32a70e6-4684-4db1-9047-07504bd11322 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:36.14397284 +0000 UTC m=+67.751550490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs") pod "network-metrics-daemon-d8wwk" (UID: "e32a70e6-4684-4db1-9047-07504bd11322") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:07:04.144088 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:04.143919    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:07:04.144088 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:04.144039    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:07:04.144088 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:04.144052    2583 projected.go:196] Error preparing data for projected volume kube-api-access-hs6ql for pod openshift-network-diagnostics/network-check-target-zsdgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:07:04.144204 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:04.144097    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql podName:d759aa46-0c62-4f7b-90e1-e8ed71a3a079 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:36.144083765 +0000 UTC m=+67.751661407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs6ql" (UniqueName: "kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql") pod "network-check-target-zsdgk" (UID: "d759aa46-0c62-4f7b-90e1-e8ed71a3a079") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:07:04.244691 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:04.244605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:04.244838 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:04.244778    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:07:04.244879 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:04.244857    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret podName:1fdc998a-15cc-4e00-97ee-00c1b11db4cc nodeName:}" failed. No retries permitted until 2026-09-17 23:07:36.244836574 +0000 UTC m=+67.852414225 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret") pod "global-pull-secret-syncer-fvjmj" (UID: "1fdc998a-15cc-4e00-97ee-00c1b11db4cc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:07:05.481872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:05.481617    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:05.482251 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:05.481658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:05.482251 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:05.481897    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:05.482251 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:05.481663    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:05.482251 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:05.481971    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:05.482251 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:05.482058    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:05.688331 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:05.688289    2583 generic.go:356] "Generic (PLEG): container finished" podID="ad763c95-3505-4748-93ff-ab0a41ee8763" containerID="0ab830210b2d80b0841ded6f8e67574b418ddd2cd5df9393c3dfa4bdbf26d85f" exitCode=0
Sep 17 23:07:05.688540 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:05.688348    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h42tf" event={"ID":"ad763c95-3505-4748-93ff-ab0a41ee8763","Type":"ContainerDied","Data":"0ab830210b2d80b0841ded6f8e67574b418ddd2cd5df9393c3dfa4bdbf26d85f"}
Sep 17 23:07:06.693814 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:06.693778    2583 generic.go:356] "Generic (PLEG): container finished" podID="ad763c95-3505-4748-93ff-ab0a41ee8763" containerID="b01afc7092c4e6c9888790592cc843e4f71c0062433cb50bd9a7e0ae12aff5e0" exitCode=0
Sep 17 23:07:06.694166 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:06.693830    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h42tf" event={"ID":"ad763c95-3505-4748-93ff-ab0a41ee8763","Type":"ContainerDied","Data":"b01afc7092c4e6c9888790592cc843e4f71c0062433cb50bd9a7e0ae12aff5e0"}
Sep 17 23:07:07.481393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:07.481356    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:07.481599 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:07.481357    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:07.481599 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:07.481493    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:07.481599 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:07.481572    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:07.481599 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:07.481357    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:07.482042 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:07.481653    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:07.699765 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:07.699736    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h42tf" event={"ID":"ad763c95-3505-4748-93ff-ab0a41ee8763","Type":"ContainerStarted","Data":"b469f9c18a72d9e4093bd90443407c5c94be7970b65e759cf76cdb1d30984a85"}
Sep 17 23:07:07.722126 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:07.722065    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h42tf" podStartSLOduration=9.064062714 podStartE2EDuration="37.722045364s" totalImagesPullingTime="28.65798265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:07.720564367 +0000 UTC m=+39.328142083" watchObservedRunningTime="2026-09-17 23:07:07.722045364 +0000 UTC m=+39.329623026"
Sep 17 23:07:09.481064 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:09.481029    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:09.481064 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:09.481046    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:09.481623 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:09.481031    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:09.481623 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:09.481137    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:09.481623 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:09.481234    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:09.481623 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:09.481299    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:11.480842 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:11.480803    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:11.481319 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:11.480901    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:11.481319 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:11.480907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:11.481319 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:11.481028    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:11.481319 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:11.481118    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:11.481319 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:11.480905    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:13.481175 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:13.481128    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:13.481175 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:13.481163    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:13.481613 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:13.481248    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:13.481613 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:13.481256    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:13.481613 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:13.481323    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:13.481613 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:13.481383    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:15.481340 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:15.481292    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:15.481340 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:15.481343    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:15.481864 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:15.481292    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:15.481864 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:15.481403    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:15.481864 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:15.481519    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:15.481864 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:15.481591    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:17.481226 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:17.481185    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:17.481632 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:17.481185    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:17.481632 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:17.481307    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:17.481632 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:17.481185    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:17.481632 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:17.481381    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:17.481632 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:17.481458    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:19.481106 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:19.481068    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:19.481519 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:19.481171    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:19.481519 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:19.481196    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:19.481519 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:19.481186    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:19.481519 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:19.481269    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:19.481519 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:19.481355    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:21.481744 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:21.481714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:21.482105 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:21.481751    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:21.482105 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:21.481751    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:21.482105 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:21.481837    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvjmj" podUID="1fdc998a-15cc-4e00-97ee-00c1b11db4cc"
Sep 17 23:07:21.482105 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:21.481925    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsdgk" podUID="d759aa46-0c62-4f7b-90e1-e8ed71a3a079"
Sep 17 23:07:21.482105 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:21.482026    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wwk" podUID="e32a70e6-4684-4db1-9047-07504bd11322"
Sep 17 23:07:22.189374 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.189344    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeReady"
Sep 17 23:07:22.189543 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.189477    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 23:07:22.230597 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.230565    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68999896c6-2gpfj"]
Sep 17 23:07:22.253709 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.253679    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68999896c6-2gpfj"]
Sep 17 23:07:22.253869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.253818    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.253869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.253849    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n6wf4"]
Sep 17 23:07:22.256829 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.256808    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cm7l8\""
Sep 17 23:07:22.257024 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.257011    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 23:07:22.257071 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.257039    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 23:07:22.257149 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.257129    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 23:07:22.264977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.264958    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 23:07:22.277779 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.277758    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kc4rm"]
Sep 17 23:07:22.277908 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.277892    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n6wf4"
Sep 17 23:07:22.280962 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.280945    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 23:07:22.281062 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.281020    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 23:07:22.281128 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.281112    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 23:07:22.281346 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.281265    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-672mp\""
Sep 17 23:07:22.295718 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.295699    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n6wf4"]
Sep 17 23:07:22.295807 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.295731    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kc4rm"]
Sep 17 23:07:22.295851 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.295805    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.298240 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.298220    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 23:07:22.298342 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.298325    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vvv69\""
Sep 17 23:07:22.298479 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.298450    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 23:07:22.368371 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.368331    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b85t\" (UniqueName: \"kubernetes.io/projected/3e209bab-865b-4e8b-bc43-c7b459f5c153-kube-api-access-4b85t\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.368371 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.368373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e209bab-865b-4e8b-bc43-c7b459f5c153-image-registry-private-configuration\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.368634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.368402    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e209bab-865b-4e8b-bc43-c7b459f5c153-bound-sa-token\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.368634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.368493    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e209bab-865b-4e8b-bc43-c7b459f5c153-ca-trust-extracted\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.368634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.368525    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b36fa738-3ce2-456b-8438-ec19a3437076-cert\") pod \"ingress-canary-n6wf4\" (UID: \"b36fa738-3ce2-456b-8438-ec19a3437076\") " pod="openshift-ingress-canary/ingress-canary-n6wf4"
Sep 17 23:07:22.368634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.368554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e209bab-865b-4e8b-bc43-c7b459f5c153-registry-tls\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.368634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.368611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcqmx\" (UniqueName: \"kubernetes.io/projected/b36fa738-3ce2-456b-8438-ec19a3437076-kube-api-access-tcqmx\") pod \"ingress-canary-n6wf4\" (UID: \"b36fa738-3ce2-456b-8438-ec19a3437076\") " pod="openshift-ingress-canary/ingress-canary-n6wf4"
Sep 17 23:07:22.368833 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.368642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e209bab-865b-4e8b-bc43-c7b459f5c153-registry-certificates\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.368833 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.368659    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e209bab-865b-4e8b-bc43-c7b459f5c153-trusted-ca\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.368833 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.368676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e209bab-865b-4e8b-bc43-c7b459f5c153-installation-pull-secrets\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.391704 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.391678    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2knf6"]
Sep 17 23:07:22.413772 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.413750    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2knf6"]
Sep 17 23:07:22.413882 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.413861    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.417209 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.417184    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 23:07:22.417523 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.417504    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 23:07:22.418671 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.418653    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 23:07:22.418949 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.418932    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 23:07:22.419042 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.418994    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ktswr\""
Sep 17 23:07:22.470104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470027    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e209bab-865b-4e8b-bc43-c7b459f5c153-ca-trust-extracted\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.470104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470060    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b36fa738-3ce2-456b-8438-ec19a3437076-cert\") pod \"ingress-canary-n6wf4\" (UID: \"b36fa738-3ce2-456b-8438-ec19a3437076\") " pod="openshift-ingress-canary/ingress-canary-n6wf4"
Sep 17 23:07:22.470104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-tmp-dir\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.470104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e209bab-865b-4e8b-bc43-c7b459f5c153-registry-tls\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.470402 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcqmx\" (UniqueName: \"kubernetes.io/projected/b36fa738-3ce2-456b-8438-ec19a3437076-kube-api-access-tcqmx\") pod \"ingress-canary-n6wf4\" (UID: \"b36fa738-3ce2-456b-8438-ec19a3437076\") " pod="openshift-ingress-canary/ingress-canary-n6wf4"
Sep 17 23:07:22.470402 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-metrics-tls\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.470402 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e209bab-865b-4e8b-bc43-c7b459f5c153-registry-certificates\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.470402 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470312    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e209bab-865b-4e8b-bc43-c7b459f5c153-trusted-ca\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.470402 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470334    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e209bab-865b-4e8b-bc43-c7b459f5c153-installation-pull-secrets\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.470629 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b85t\" (UniqueName: \"kubernetes.io/projected/3e209bab-865b-4e8b-bc43-c7b459f5c153-kube-api-access-4b85t\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.470629 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e209bab-865b-4e8b-bc43-c7b459f5c153-image-registry-private-configuration\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.470629 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470543    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nspx\" (UniqueName: \"kubernetes.io/projected/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-kube-api-access-8nspx\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.470629 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-config-volume\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.470629 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.470620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e209bab-865b-4e8b-bc43-c7b459f5c153-bound-sa-token\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.471153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.471110    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e209bab-865b-4e8b-bc43-c7b459f5c153-ca-trust-extracted\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.471254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.471177    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e209bab-865b-4e8b-bc43-c7b459f5c153-registry-certificates\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.471383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.471359    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e209bab-865b-4e8b-bc43-c7b459f5c153-trusted-ca\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.474538 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.474514    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e209bab-865b-4e8b-bc43-c7b459f5c153-installation-pull-secrets\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.474538 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.474536    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e209bab-865b-4e8b-bc43-c7b459f5c153-registry-tls\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.474669 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.474567    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b36fa738-3ce2-456b-8438-ec19a3437076-cert\") pod \"ingress-canary-n6wf4\" (UID: \"b36fa738-3ce2-456b-8438-ec19a3437076\") " pod="openshift-ingress-canary/ingress-canary-n6wf4"
Sep 17 23:07:22.474669 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.474536    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e209bab-865b-4e8b-bc43-c7b459f5c153-image-registry-private-configuration\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.478793 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.478770    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e209bab-865b-4e8b-bc43-c7b459f5c153-bound-sa-token\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.479546 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.479528    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcqmx\" (UniqueName: \"kubernetes.io/projected/b36fa738-3ce2-456b-8438-ec19a3437076-kube-api-access-tcqmx\") pod \"ingress-canary-n6wf4\" (UID: \"b36fa738-3ce2-456b-8438-ec19a3437076\") " pod="openshift-ingress-canary/ingress-canary-n6wf4"
Sep 17 23:07:22.479651 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.479632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b85t\" (UniqueName: \"kubernetes.io/projected/3e209bab-865b-4e8b-bc43-c7b459f5c153-kube-api-access-4b85t\") pod \"image-registry-68999896c6-2gpfj\" (UID: \"3e209bab-865b-4e8b-bc43-c7b459f5c153\") " pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.563421 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.563379    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:22.571638 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.571605    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.571766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.571661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-metrics-tls\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.571766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.571687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.571766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.571761    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-data-volume\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.571915 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.571789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nspx\" (UniqueName: \"kubernetes.io/projected/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-kube-api-access-8nspx\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.571915 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.571816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-config-volume\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.571915 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.571853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-crio-socket\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.572030 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.571937    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtglr\" (UniqueName: \"kubernetes.io/projected/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-kube-api-access-vtglr\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.572030 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.571979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-tmp-dir\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.572334 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.572268    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-tmp-dir\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.572373 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.572344    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-config-volume\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.573886 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.573868    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-metrics-tls\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.582672 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.582652    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nspx\" (UniqueName: \"kubernetes.io/projected/c65c0f93-4f14-4f0b-ae04-1d98e2b19218-kube-api-access-8nspx\") pod \"dns-default-kc4rm\" (UID: \"c65c0f93-4f14-4f0b-ae04-1d98e2b19218\") " pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.586540 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.586524    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n6wf4"
Sep 17 23:07:22.603819 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.603796    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:22.673249 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.673215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtglr\" (UniqueName: \"kubernetes.io/projected/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-kube-api-access-vtglr\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.673427 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.673276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.673427 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.673318    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.673602 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.673553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-data-volume\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.673695 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.673603    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-crio-socket\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.673838 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.673818    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-crio-socket\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.673902 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.673857    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-data-volume\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.673998 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.673979    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.675937 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.675920    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.682449 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.682422    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtglr\" (UniqueName: \"kubernetes.io/projected/9164ecbe-d161-4e2c-b635-3d9e762b9bb3-kube-api-access-vtglr\") pod \"insights-runtime-extractor-2knf6\" (UID: \"9164ecbe-d161-4e2c-b635-3d9e762b9bb3\") " pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.722929 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.722862    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2knf6"
Sep 17 23:07:22.916884 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.916840    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n6wf4"]
Sep 17 23:07:22.921963 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.921927    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68999896c6-2gpfj"]
Sep 17 23:07:22.922267 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:22.922232    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36fa738_3ce2_456b_8438_ec19a3437076.slice/crio-20f5f5a29ab0ca5b2460e54eb698f015c4af79446a9f0c40af09e97d26c969f5 WatchSource:0}: Error finding container 20f5f5a29ab0ca5b2460e54eb698f015c4af79446a9f0c40af09e97d26c969f5: Status 404 returned error can't find the container with id 20f5f5a29ab0ca5b2460e54eb698f015c4af79446a9f0c40af09e97d26c969f5
Sep 17 23:07:22.924239 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:22.924214    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e209bab_865b_4e8b_bc43_c7b459f5c153.slice/crio-7476850fe405fef47a26db3624703590f63b6a86b37a2889d7314ed21c85db6e WatchSource:0}: Error finding container 7476850fe405fef47a26db3624703590f63b6a86b37a2889d7314ed21c85db6e: Status 404 returned error can't find the container with id 7476850fe405fef47a26db3624703590f63b6a86b37a2889d7314ed21c85db6e
Sep 17 23:07:22.945236 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:22.945209    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kc4rm"]
Sep 17 23:07:22.948594 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:22.948572    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65c0f93_4f14_4f0b_ae04_1d98e2b19218.slice/crio-e2992d7ccbae97541193db08b71f9a8658ed64b22cce1e2c518ead99a279b153 WatchSource:0}: Error finding container e2992d7ccbae97541193db08b71f9a8658ed64b22cce1e2c518ead99a279b153: Status 404 returned error can't find the container with id e2992d7ccbae97541193db08b71f9a8658ed64b22cce1e2c518ead99a279b153
Sep 17 23:07:23.026654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.026626    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2knf6"]
Sep 17 23:07:23.029755 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:23.029735    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9164ecbe_d161_4e2c_b635_3d9e762b9bb3.slice/crio-6eb8c87b2accf0c8fcc541ed9b7e159e7a8bb3686624fbc35b4f31284d87b56f WatchSource:0}: Error finding container 6eb8c87b2accf0c8fcc541ed9b7e159e7a8bb3686624fbc35b4f31284d87b56f: Status 404 returned error can't find the container with id 6eb8c87b2accf0c8fcc541ed9b7e159e7a8bb3686624fbc35b4f31284d87b56f
Sep 17 23:07:23.481009 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.480914    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:23.481191 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.481140    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:23.481435 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.481409    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:23.485263 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.485010    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 23:07:23.485263 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.485047    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kxqn4\""
Sep 17 23:07:23.485263 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.485060    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 23:07:23.485263 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.485075    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 23:07:23.485263 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.485105    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t46xp\""
Sep 17 23:07:23.485263 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.485046    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 23:07:23.738572 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.738483    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68999896c6-2gpfj" event={"ID":"3e209bab-865b-4e8b-bc43-c7b459f5c153","Type":"ContainerStarted","Data":"c88897628095d92bf68dd6745dded3f2f3d9213c407a0ee8de3bf61efc87104c"}
Sep 17 23:07:23.738572 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.738545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68999896c6-2gpfj" event={"ID":"3e209bab-865b-4e8b-bc43-c7b459f5c153","Type":"ContainerStarted","Data":"7476850fe405fef47a26db3624703590f63b6a86b37a2889d7314ed21c85db6e"}
Sep 17 23:07:23.739027 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.738930    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:23.741308 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.741273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2knf6" event={"ID":"9164ecbe-d161-4e2c-b635-3d9e762b9bb3","Type":"ContainerStarted","Data":"fc236762637cf979d4c33e45f8f9531ae3f399bb0d91c9b6097e87c58c83ec14"}
Sep 17 23:07:23.741422 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.741329    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2knf6" event={"ID":"9164ecbe-d161-4e2c-b635-3d9e762b9bb3","Type":"ContainerStarted","Data":"6eb8c87b2accf0c8fcc541ed9b7e159e7a8bb3686624fbc35b4f31284d87b56f"}
Sep 17 23:07:23.743104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.743081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n6wf4" event={"ID":"b36fa738-3ce2-456b-8438-ec19a3437076","Type":"ContainerStarted","Data":"20f5f5a29ab0ca5b2460e54eb698f015c4af79446a9f0c40af09e97d26c969f5"}
Sep 17 23:07:23.744590 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.744565    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kc4rm" event={"ID":"c65c0f93-4f14-4f0b-ae04-1d98e2b19218","Type":"ContainerStarted","Data":"e2992d7ccbae97541193db08b71f9a8658ed64b22cce1e2c518ead99a279b153"}
Sep 17 23:07:23.758851 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:23.758812    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68999896c6-2gpfj" podStartSLOduration=2.758797863 podStartE2EDuration="2.758797863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:23.758620594 +0000 UTC m=+55.366198279" watchObservedRunningTime="2026-09-17 23:07:23.758797863 +0000 UTC m=+55.366375527"
Sep 17 23:07:24.710636 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.710604    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-674fc5764c-4ztgh"]
Sep 17 23:07:24.725299 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.725273    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674fc5764c-4ztgh"]
Sep 17 23:07:24.725490 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.725393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.728183 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.728160    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 23:07:24.728382 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.728162    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rftn6\""
Sep 17 23:07:24.728997 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.728957    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 23:07:24.728997 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.728973    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 23:07:24.729171 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.728975    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 23:07:24.729356 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.729341    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 23:07:24.729446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.729429    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 23:07:24.729533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.729344    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 23:07:24.749766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.749726    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2knf6" event={"ID":"9164ecbe-d161-4e2c-b635-3d9e762b9bb3","Type":"ContainerStarted","Data":"10dfe0fd508b51304ac24aeed9bf077993a8f8503de73084b4cec2495a32137f"}
Sep 17 23:07:24.893133 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.893093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-serving-cert\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.893133 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.893140    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-oauth-config\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.893506 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.893290    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-config\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.893506 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.893480    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-service-ca\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.893592 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.893533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-oauth-serving-cert\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.893592 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.893565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2zzp\" (UniqueName: \"kubernetes.io/projected/fccf5e48-c1ab-4422-b934-81d42f5cb602-kube-api-access-b2zzp\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.994510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.994415    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2zzp\" (UniqueName: \"kubernetes.io/projected/fccf5e48-c1ab-4422-b934-81d42f5cb602-kube-api-access-b2zzp\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.994678 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.994523    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-serving-cert\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.994678 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.994559    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-oauth-config\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.994678 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.994617    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-config\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.994678 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.994648    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-service-ca\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.994678 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.994670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-oauth-serving-cert\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.995478 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.995429    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-oauth-serving-cert\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.995478 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.995453    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-config\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.995659 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.995635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-service-ca\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.997341 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.997300    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-oauth-config\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:24.997430 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:24.997403    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-serving-cert\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:25.002872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:25.002848    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2zzp\" (UniqueName: \"kubernetes.io/projected/fccf5e48-c1ab-4422-b934-81d42f5cb602-kube-api-access-b2zzp\") pod \"console-674fc5764c-4ztgh\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") " pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:25.037106 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:25.037070    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:26.344483 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:26.344441    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674fc5764c-4ztgh"]
Sep 17 23:07:26.349275 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:26.349231    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccf5e48_c1ab_4422_b934_81d42f5cb602.slice/crio-04cbd77df0ef773462f2de024f292d25b818268e290eb9f4db569cd23b03571f WatchSource:0}: Error finding container 04cbd77df0ef773462f2de024f292d25b818268e290eb9f4db569cd23b03571f: Status 404 returned error can't find the container with id 04cbd77df0ef773462f2de024f292d25b818268e290eb9f4db569cd23b03571f
Sep 17 23:07:26.759044 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:26.758937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n6wf4" event={"ID":"b36fa738-3ce2-456b-8438-ec19a3437076","Type":"ContainerStarted","Data":"b26ee18c9343e4b535e047d07b8c325f756134994609643dfe1ccc8c42596443"}
Sep 17 23:07:26.760509 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:26.760480    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674fc5764c-4ztgh" event={"ID":"fccf5e48-c1ab-4422-b934-81d42f5cb602","Type":"ContainerStarted","Data":"04cbd77df0ef773462f2de024f292d25b818268e290eb9f4db569cd23b03571f"}
Sep 17 23:07:26.762636 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:26.762600    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kc4rm" event={"ID":"c65c0f93-4f14-4f0b-ae04-1d98e2b19218","Type":"ContainerStarted","Data":"5057d3813c931b5c991ec2c44fba7f62338abba0dfaae38ecb6999431e2d1911"}
Sep 17 23:07:26.762753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:26.762659    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kc4rm" event={"ID":"c65c0f93-4f14-4f0b-ae04-1d98e2b19218","Type":"ContainerStarted","Data":"d37a6e847538ffdc75b9de5ec06d0fff3bcbd8a20cd16b5fdce8c2035f0ba649"}
Sep 17 23:07:26.762753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:26.762699    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:26.776957 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:26.776903    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n6wf4" podStartSLOduration=1.624028092 podStartE2EDuration="4.776885539s" totalImagesPullingTime="3.152857447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:26.776760746 +0000 UTC m=+58.384338427" watchObservedRunningTime="2026-09-17 23:07:26.776885539 +0000 UTC m=+58.384463193"
Sep 17 23:07:26.797976 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:26.797914    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kc4rm" podStartSLOduration=1.677784763 podStartE2EDuration="4.797891023s" totalImagesPullingTime="3.12010626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:26.7965485 +0000 UTC m=+58.404126184" watchObservedRunningTime="2026-09-17 23:07:26.797891023 +0000 UTC m=+58.405468684"
Sep 17 23:07:27.770580 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:27.770488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2knf6" event={"ID":"9164ecbe-d161-4e2c-b635-3d9e762b9bb3","Type":"ContainerStarted","Data":"c766051394846fef5c1bf058c234aca7c2b9d580ad223f5342c6af60d4cfa482"}
Sep 17 23:07:27.792043 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:27.791973    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2knf6" podStartSLOduration=1.796126528 podStartE2EDuration="5.791951435s" totalImagesPullingTime="3.995824907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:07:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:27.790552582 +0000 UTC m=+59.398130267" watchObservedRunningTime="2026-09-17 23:07:27.791951435 +0000 UTC m=+59.399529098"
Sep 17 23:07:29.680406 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:29.680376    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nzwr"
Sep 17 23:07:31.786091 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:31.785992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674fc5764c-4ztgh" event={"ID":"fccf5e48-c1ab-4422-b934-81d42f5cb602","Type":"ContainerStarted","Data":"fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5"}
Sep 17 23:07:31.804959 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:31.804913    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-674fc5764c-4ztgh" podStartSLOduration=2.6287110289999998 podStartE2EDuration="7.804898384s" totalImagesPullingTime="5.176187355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:31.804077245 +0000 UTC m=+63.411654927" watchObservedRunningTime="2026-09-17 23:07:31.804898384 +0000 UTC m=+63.412476044"
Sep 17 23:07:35.038237 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:35.038179    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:35.038237 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:35.038252    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:07:35.039635 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:35.039610    2583 patch_prober.go:28] interesting pod/console-674fc5764c-4ztgh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" start-of-body=
Sep 17 23:07:35.039758 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:35.039655    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-674fc5764c-4ztgh" podUID="fccf5e48-c1ab-4422-b934-81d42f5cb602" containerName="console" probeResult="failure" output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused"
Sep 17 23:07:36.176874 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.176819    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:36.176874 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.176876    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6ql\" (UniqueName: \"kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql\") pod \"network-check-target-zsdgk\" (UID: \"d759aa46-0c62-4f7b-90e1-e8ed71a3a079\") " pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:36.179645 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.179627    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 23:07:36.180648 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.180633    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 23:07:36.189663 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.189636    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 23:07:36.189663 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.189648    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e32a70e6-4684-4db1-9047-07504bd11322-metrics-certs\") pod \"network-metrics-daemon-d8wwk\" (UID: \"e32a70e6-4684-4db1-9047-07504bd11322\") " pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:36.199682 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.199659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs6ql\" (UniqueName: \"kubernetes.io/projected/d759aa46-0c62-4f7b-90e1-e8ed71a3a079-kube-api-access-hs6ql\") pod \"network-check-target-zsdgk\" (UID: \"d759aa46-0c62-4f7b-90e1-e8ed71a3a079\") " pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:36.277856 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.277818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:36.280783 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.280764    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 23:07:36.290857 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.290833    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fdc998a-15cc-4e00-97ee-00c1b11db4cc-original-pull-secret\") pod \"global-pull-secret-syncer-fvjmj\" (UID: \"1fdc998a-15cc-4e00-97ee-00c1b11db4cc\") " pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:36.408037 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.408010    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kxqn4\""
Sep 17 23:07:36.415474 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.415435    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:36.415603 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.415509    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t46xp\""
Sep 17 23:07:36.419367 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.419352    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvjmj"
Sep 17 23:07:36.423073 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.423055    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wwk"
Sep 17 23:07:36.701738 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.701661    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fvjmj"]
Sep 17 23:07:36.704953 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:36.704913    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fdc998a_15cc_4e00_97ee_00c1b11db4cc.slice/crio-48cc6838706b85c04716bfb466a3bdfd72e6a28cc20325a8542a999f0bdda317 WatchSource:0}: Error finding container 48cc6838706b85c04716bfb466a3bdfd72e6a28cc20325a8542a999f0bdda317: Status 404 returned error can't find the container with id 48cc6838706b85c04716bfb466a3bdfd72e6a28cc20325a8542a999f0bdda317
Sep 17 23:07:36.706035 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.706014    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d8wwk"]
Sep 17 23:07:36.707910 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.707889    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zsdgk"]
Sep 17 23:07:36.713804 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:36.713781    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32a70e6_4684_4db1_9047_07504bd11322.slice/crio-b249492dc521322ecb66c708e0c17d54042939ae53571a2bba2cec702cb12f8b WatchSource:0}: Error finding container b249492dc521322ecb66c708e0c17d54042939ae53571a2bba2cec702cb12f8b: Status 404 returned error can't find the container with id b249492dc521322ecb66c708e0c17d54042939ae53571a2bba2cec702cb12f8b
Sep 17 23:07:36.714512 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:36.714491    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd759aa46_0c62_4f7b_90e1_e8ed71a3a079.slice/crio-83cbdad730a505f3684eda2571deb5034ed8ca8a4936a0469b488d77e9aba817 WatchSource:0}: Error finding container 83cbdad730a505f3684eda2571deb5034ed8ca8a4936a0469b488d77e9aba817: Status 404 returned error can't find the container with id 83cbdad730a505f3684eda2571deb5034ed8ca8a4936a0469b488d77e9aba817
Sep 17 23:07:36.772894 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.772865    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kc4rm"
Sep 17 23:07:36.804321 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.804289    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8wwk" event={"ID":"e32a70e6-4684-4db1-9047-07504bd11322","Type":"ContainerStarted","Data":"b249492dc521322ecb66c708e0c17d54042939ae53571a2bba2cec702cb12f8b"}
Sep 17 23:07:36.805780 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.805747    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fvjmj" event={"ID":"1fdc998a-15cc-4e00-97ee-00c1b11db4cc","Type":"ContainerStarted","Data":"48cc6838706b85c04716bfb466a3bdfd72e6a28cc20325a8542a999f0bdda317"}
Sep 17 23:07:36.807233 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:36.807199    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zsdgk" event={"ID":"d759aa46-0c62-4f7b-90e1-e8ed71a3a079","Type":"ContainerStarted","Data":"83cbdad730a505f3684eda2571deb5034ed8ca8a4936a0469b488d77e9aba817"}
Sep 17 23:07:38.819622 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:38.819584    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8wwk" event={"ID":"e32a70e6-4684-4db1-9047-07504bd11322","Type":"ContainerStarted","Data":"9eeac7ca7e36052d316b14b78da465c9ddcd161266236b78e30c2abe7f955fce"}
Sep 17 23:07:38.820094 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:38.819675    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8wwk" event={"ID":"e32a70e6-4684-4db1-9047-07504bd11322","Type":"ContainerStarted","Data":"a01e79db51ece8ca74ecc3dc5f4607a9a59c33a88c0faf70be0666abcff4bfa6"}
Sep 17 23:07:38.837159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:38.837093    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d8wwk" podStartSLOduration=67.777735941 podStartE2EDuration="1m8.837071093s" totalImagesPullingTime="1.059335152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:38.836079291 +0000 UTC m=+70.443656952" watchObservedRunningTime="2026-09-17 23:07:38.837071093 +0000 UTC m=+70.444648756"
Sep 17 23:07:41.398432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:41.398394    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-674fc5764c-4ztgh"]
Sep 17 23:07:41.834185 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:41.834147    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fvjmj" event={"ID":"1fdc998a-15cc-4e00-97ee-00c1b11db4cc","Type":"ContainerStarted","Data":"68ac9e8fcb9baa23319170bf4577eb5cb324f9dd522733926264d6c92b7ab306"}
Sep 17 23:07:41.835555 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:41.835532    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zsdgk" event={"ID":"d759aa46-0c62-4f7b-90e1-e8ed71a3a079","Type":"ContainerStarted","Data":"6e7f010c39182704d5cac74a40f23cbc753727509e3bd8f83d8118acb4c31bb6"}
Sep 17 23:07:41.835668 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:41.835657    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:07:41.850518 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:41.850453    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fvjmj" podStartSLOduration=67.29343281 podStartE2EDuration="1m11.850437169s" totalImagesPullingTime="4.557004359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:41.849690244 +0000 UTC m=+73.457267910" watchObservedRunningTime="2026-09-17 23:07:41.850437169 +0000 UTC m=+73.458014831"
Sep 17 23:07:41.865000 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:41.864942    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zsdgk" podStartSLOduration=67.321300714 podStartE2EDuration="1m11.864926039s" totalImagesPullingTime="4.543625325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:41.864752801 +0000 UTC m=+73.472330475" watchObservedRunningTime="2026-09-17 23:07:41.864926039 +0000 UTC m=+73.472503704"
Sep 17 23:07:44.078644 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.077119    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qrvdw"]
Sep 17 23:07:44.080700 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.080678    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.083219 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.083198    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5h2qn\""
Sep 17 23:07:44.083306 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.083231    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 23:07:44.085203 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.085178    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 23:07:44.085320 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.085213    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 23:07:44.085320 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.085287    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 23:07:44.085320 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.085295    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 23:07:44.085453 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.085320    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 23:07:44.132567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.132527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-textfile\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.132567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.132573    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/540fd8e7-7f54-45ad-9aa3-22086030929c-root\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.132813 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.132595    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jkcs\" (UniqueName: \"kubernetes.io/projected/540fd8e7-7f54-45ad-9aa3-22086030929c-kube-api-access-4jkcs\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.132813 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.132679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/540fd8e7-7f54-45ad-9aa3-22086030929c-sys\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.132813 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.132709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-tls\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.132813 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.132742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-wtmp\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.132813 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.132789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/540fd8e7-7f54-45ad-9aa3-22086030929c-metrics-client-ca\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.133035 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.132879    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.133035 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.132928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.233796 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.233754    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.233989 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.233807    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-textfile\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.233989 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.233834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/540fd8e7-7f54-45ad-9aa3-22086030929c-root\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.233989 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.233860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jkcs\" (UniqueName: \"kubernetes.io/projected/540fd8e7-7f54-45ad-9aa3-22086030929c-kube-api-access-4jkcs\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.233989 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.233888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/540fd8e7-7f54-45ad-9aa3-22086030929c-sys\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.233989 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.233910    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-tls\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.233989 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.233948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-wtmp\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.233989 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.233950    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/540fd8e7-7f54-45ad-9aa3-22086030929c-root\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.233989 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.233964    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/540fd8e7-7f54-45ad-9aa3-22086030929c-sys\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.234432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.233967    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/540fd8e7-7f54-45ad-9aa3-22086030929c-metrics-client-ca\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.234432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.234071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.234432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.234098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-wtmp\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.234432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.234298    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-textfile\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.234670 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.234629    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.234670 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.234652    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/540fd8e7-7f54-45ad-9aa3-22086030929c-metrics-client-ca\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.236138 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.236122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.236246 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.236229    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/540fd8e7-7f54-45ad-9aa3-22086030929c-node-exporter-tls\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.243245 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.243223    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jkcs\" (UniqueName: \"kubernetes.io/projected/540fd8e7-7f54-45ad-9aa3-22086030929c-kube-api-access-4jkcs\") pod \"node-exporter-qrvdw\" (UID: \"540fd8e7-7f54-45ad-9aa3-22086030929c\") " pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.389325 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.389238    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qrvdw"
Sep 17 23:07:44.398263 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:44.398238    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540fd8e7_7f54_45ad_9aa3_22086030929c.slice/crio-2d0bb01908ae8f70856d631c5270786374e35d2d61483516723cf5b97b9d3f68 WatchSource:0}: Error finding container 2d0bb01908ae8f70856d631c5270786374e35d2d61483516723cf5b97b9d3f68: Status 404 returned error can't find the container with id 2d0bb01908ae8f70856d631c5270786374e35d2d61483516723cf5b97b9d3f68
Sep 17 23:07:44.754773 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.754694    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68999896c6-2gpfj"
Sep 17 23:07:44.848150 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:44.848114    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrvdw" event={"ID":"540fd8e7-7f54-45ad-9aa3-22086030929c","Type":"ContainerStarted","Data":"2d0bb01908ae8f70856d631c5270786374e35d2d61483516723cf5b97b9d3f68"}
Sep 17 23:07:45.121803 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.121770    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 23:07:45.124300 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.124274    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.126731 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.126709    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 23:07:45.126838 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.126710    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 23:07:45.126838 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.126797    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 23:07:45.126945 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.126929    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 23:07:45.127187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.127161    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 23:07:45.127313 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.127193    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6mnbh\""
Sep 17 23:07:45.127313 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.127220    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 23:07:45.127313 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.127280    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 23:07:45.127313 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.127222    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 23:07:45.127313 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.127312    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 23:07:45.140753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.140730    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 23:07:45.142661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142640    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.142836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142666    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.142836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142684    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwg95\" (UniqueName: \"kubernetes.io/projected/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-kube-api-access-gwg95\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.142836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-web-config\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.142836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142771    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.142836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142801    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.142836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.143142 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.143142 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-config-out\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.143142 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142911    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.143142 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142941    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.143142 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142961    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.143142 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.142981    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244332 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244405    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-config-out\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244423    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244521    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244917 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:07:45.244572    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-alertmanager-trusted-ca-bundle podName:7d5dd618-059b-48fc-a7eb-1a6a395e6c66 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:45.74454888 +0000 UTC m=+77.352126537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7d5dd618-059b-48fc-a7eb-1a6a395e6c66") : configmap references non-existent config key: ca-bundle.crt
Sep 17 23:07:45.244917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244622    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwg95\" (UniqueName: \"kubernetes.io/projected/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-kube-api-access-gwg95\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-web-config\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.244917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.244726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.245222 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.245064    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.245320 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.245297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.247760 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.247727    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-config-out\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.247961 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.247942    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.248177 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.248117    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.248284 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.248215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.248620 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.248599    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.248871 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.248850    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.249732 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.249710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-web-config\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.249804 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.249770    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.249864 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.249770    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.256372 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.256339    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwg95\" (UniqueName: \"kubernetes.io/projected/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-kube-api-access-gwg95\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.748766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.748664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.749407 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.749386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5dd618-059b-48fc-a7eb-1a6a395e6c66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d5dd618-059b-48fc-a7eb-1a6a395e6c66\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:45.853026 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.852993    2583 generic.go:356] "Generic (PLEG): container finished" podID="540fd8e7-7f54-45ad-9aa3-22086030929c" containerID="05fd6ff0aea7c2fcfc569f27420ff28b801c2b04b550baf934f560ad5fc60450" exitCode=0
Sep 17 23:07:45.853237 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:45.853068    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrvdw" event={"ID":"540fd8e7-7f54-45ad-9aa3-22086030929c","Type":"ContainerDied","Data":"05fd6ff0aea7c2fcfc569f27420ff28b801c2b04b550baf934f560ad5fc60450"}
Sep 17 23:07:46.036030 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:46.035992    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 23:07:46.314514 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:46.314488    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 23:07:46.317055 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:46.317027    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5dd618_059b_48fc_a7eb_1a6a395e6c66.slice/crio-bc7f17b3095e1dd38854bb21eb7d83ab9fc1645d28a37dfa78a3b2a22f6374b4 WatchSource:0}: Error finding container bc7f17b3095e1dd38854bb21eb7d83ab9fc1645d28a37dfa78a3b2a22f6374b4: Status 404 returned error can't find the container with id bc7f17b3095e1dd38854bb21eb7d83ab9fc1645d28a37dfa78a3b2a22f6374b4
Sep 17 23:07:46.858343 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:46.858308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d5dd618-059b-48fc-a7eb-1a6a395e6c66","Type":"ContainerStarted","Data":"bc7f17b3095e1dd38854bb21eb7d83ab9fc1645d28a37dfa78a3b2a22f6374b4"}
Sep 17 23:07:46.860813 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:46.860788    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrvdw" event={"ID":"540fd8e7-7f54-45ad-9aa3-22086030929c","Type":"ContainerStarted","Data":"d251922e9382bacd1eef7ce18fe8d3d4760af98c0a01dc29313a2539ae004fc7"}
Sep 17 23:07:46.860916 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:46.860836    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrvdw" event={"ID":"540fd8e7-7f54-45ad-9aa3-22086030929c","Type":"ContainerStarted","Data":"6506fcb3028ec3a3c64e5d7aa37f00d21babf21bc14254de68ee4610c57349db"}
Sep 17 23:07:46.885107 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:46.885050    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qrvdw" podStartSLOduration=1.94059984 podStartE2EDuration="2.885031697s" totalImagesPullingTime="882.806445ms" totalInitContainerRuntime="61.625412ms" isStatefulPod=true podCreationTimestamp="2026-09-17 23:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:46.883812256 +0000 UTC m=+78.491389946" watchObservedRunningTime="2026-09-17 23:07:46.885031697 +0000 UTC m=+78.492609356"
Sep 17 23:07:47.866774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:47.866737    2583 generic.go:356] "Generic (PLEG): container finished" podID="7d5dd618-059b-48fc-a7eb-1a6a395e6c66" containerID="4f97da063687c8681cdadaf400f96a5ca6e1196065d9a3ac331e5523c9bd7890" exitCode=0
Sep 17 23:07:47.867199 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:47.866818    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d5dd618-059b-48fc-a7eb-1a6a395e6c66","Type":"ContainerDied","Data":"4f97da063687c8681cdadaf400f96a5ca6e1196065d9a3ac331e5523c9bd7890"}
Sep 17 23:07:48.353586 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.353549    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f799df98b-zs8dn"]
Sep 17 23:07:48.355567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.355536    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.357889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.357864    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 17 23:07:48.358082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.358055    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 23:07:48.359300 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.359254    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5nou8mr7qa1k3\""
Sep 17 23:07:48.359486 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.359455    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 17 23:07:48.359563 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.359485    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 17 23:07:48.359563 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.359456    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qq56g\""
Sep 17 23:07:48.366043 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.366017    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f799df98b-zs8dn"]
Sep 17 23:07:48.467117 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.467078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d4ae492-1746-4b88-967a-00a962f8e882-metrics-server-audit-profiles\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.467286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.467238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4ae492-1746-4b88-967a-00a962f8e882-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.467339 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.467315    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d4ae492-1746-4b88-967a-00a962f8e882-audit-log\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.467393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.467356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d4ae492-1746-4b88-967a-00a962f8e882-client-ca-bundle\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.467496 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.467444    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d4ae492-1746-4b88-967a-00a962f8e882-secret-metrics-server-tls\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.467627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.467515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5rfj\" (UniqueName: \"kubernetes.io/projected/0d4ae492-1746-4b88-967a-00a962f8e882-kube-api-access-p5rfj\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.467627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.467547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d4ae492-1746-4b88-967a-00a962f8e882-secret-metrics-server-client-certs\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.568275 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.568237    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d4ae492-1746-4b88-967a-00a962f8e882-audit-log\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.568275 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.568275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d4ae492-1746-4b88-967a-00a962f8e882-client-ca-bundle\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.568595 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.568302    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d4ae492-1746-4b88-967a-00a962f8e882-secret-metrics-server-tls\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.568595 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.568328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5rfj\" (UniqueName: \"kubernetes.io/projected/0d4ae492-1746-4b88-967a-00a962f8e882-kube-api-access-p5rfj\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.568595 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.568352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d4ae492-1746-4b88-967a-00a962f8e882-secret-metrics-server-client-certs\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.568595 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.568392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d4ae492-1746-4b88-967a-00a962f8e882-metrics-server-audit-profiles\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.568595 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.568439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4ae492-1746-4b88-967a-00a962f8e882-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.568848 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.568789    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d4ae492-1746-4b88-967a-00a962f8e882-audit-log\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.569296 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.569267    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4ae492-1746-4b88-967a-00a962f8e882-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.569797 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.569761    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d4ae492-1746-4b88-967a-00a962f8e882-metrics-server-audit-profiles\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.571316 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.571292    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d4ae492-1746-4b88-967a-00a962f8e882-secret-metrics-server-tls\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.571508 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.571485    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d4ae492-1746-4b88-967a-00a962f8e882-client-ca-bundle\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.571690 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.571670    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d4ae492-1746-4b88-967a-00a962f8e882-secret-metrics-server-client-certs\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.576958 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.576931    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5rfj\" (UniqueName: \"kubernetes.io/projected/0d4ae492-1746-4b88-967a-00a962f8e882-kube-api-access-p5rfj\") pod \"metrics-server-5f799df98b-zs8dn\" (UID: \"0d4ae492-1746-4b88-967a-00a962f8e882\") " pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.665596 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.665445    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:07:48.825104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.825074    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"]
Sep 17 23:07:48.827325 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.827307    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"
Sep 17 23:07:48.830147 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.830117    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xdk99\""
Sep 17 23:07:48.830147 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.830133    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 17 23:07:48.843270 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.843239    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"]
Sep 17 23:07:48.871020 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.870987    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3053540d-c330-41b6-b57a-a08764748750-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-trd7x\" (UID: \"3053540d-c330-41b6-b57a-a08764748750\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"
Sep 17 23:07:48.871417 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.871054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzt9t\" (UniqueName: \"kubernetes.io/projected/3053540d-c330-41b6-b57a-a08764748750-kube-api-access-bzt9t\") pod \"monitoring-plugin-5984459ff8-trd7x\" (UID: \"3053540d-c330-41b6-b57a-a08764748750\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"
Sep 17 23:07:48.950539 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.950398    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f799df98b-zs8dn"]
Sep 17 23:07:48.972223 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.972189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3053540d-c330-41b6-b57a-a08764748750-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-trd7x\" (UID: \"3053540d-c330-41b6-b57a-a08764748750\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"
Sep 17 23:07:48.972399 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.972250    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzt9t\" (UniqueName: \"kubernetes.io/projected/3053540d-c330-41b6-b57a-a08764748750-kube-api-access-bzt9t\") pod \"monitoring-plugin-5984459ff8-trd7x\" (UID: \"3053540d-c330-41b6-b57a-a08764748750\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"
Sep 17 23:07:48.974947 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.974918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3053540d-c330-41b6-b57a-a08764748750-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-trd7x\" (UID: \"3053540d-c330-41b6-b57a-a08764748750\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"
Sep 17 23:07:48.980514 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:48.980493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzt9t\" (UniqueName: \"kubernetes.io/projected/3053540d-c330-41b6-b57a-a08764748750-kube-api-access-bzt9t\") pod \"monitoring-plugin-5984459ff8-trd7x\" (UID: \"3053540d-c330-41b6-b57a-a08764748750\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"
Sep 17 23:07:49.061557 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:49.061526    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4ae492_1746_4b88_967a_00a962f8e882.slice/crio-e4b2b06912fb3127cf1b83b7a5c04c2ff41dab437415f9ba8500864d49a2fc92 WatchSource:0}: Error finding container e4b2b06912fb3127cf1b83b7a5c04c2ff41dab437415f9ba8500864d49a2fc92: Status 404 returned error can't find the container with id e4b2b06912fb3127cf1b83b7a5c04c2ff41dab437415f9ba8500864d49a2fc92
Sep 17 23:07:49.137355 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:49.137328    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"
Sep 17 23:07:49.414696 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:49.414665    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"]
Sep 17 23:07:49.417561 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:07:49.417531    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3053540d_c330_41b6_b57a_a08764748750.slice/crio-eaf412f10d49abd05ecceffb092be88a63b71de61a769579d87d88df77de6936 WatchSource:0}: Error finding container eaf412f10d49abd05ecceffb092be88a63b71de61a769579d87d88df77de6936: Status 404 returned error can't find the container with id eaf412f10d49abd05ecceffb092be88a63b71de61a769579d87d88df77de6936
Sep 17 23:07:49.877253 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:49.877177    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x" event={"ID":"3053540d-c330-41b6-b57a-a08764748750","Type":"ContainerStarted","Data":"eaf412f10d49abd05ecceffb092be88a63b71de61a769579d87d88df77de6936"}
Sep 17 23:07:49.882183 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:49.882151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d5dd618-059b-48fc-a7eb-1a6a395e6c66","Type":"ContainerStarted","Data":"86ed575f933defb60d4b0929d5e1727fb7ad7e7737b1b466bdeaea12b7842a72"}
Sep 17 23:07:49.882332 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:49.882229    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d5dd618-059b-48fc-a7eb-1a6a395e6c66","Type":"ContainerStarted","Data":"e025e56d0b7cdfd91d7aab12cc63f361b1c8d706f1078b5857871327921f3910"}
Sep 17 23:07:49.882332 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:49.882274    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d5dd618-059b-48fc-a7eb-1a6a395e6c66","Type":"ContainerStarted","Data":"2e85a09033559d55008b2402ca78ef370a466b31bee34cb3854de561950b0f46"}
Sep 17 23:07:49.882332 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:49.882315    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d5dd618-059b-48fc-a7eb-1a6a395e6c66","Type":"ContainerStarted","Data":"957fdddd8535810cd4120275643872b4910acc1592e3dff56d1e27385b2c70e5"}
Sep 17 23:07:49.882495 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:49.882351    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d5dd618-059b-48fc-a7eb-1a6a395e6c66","Type":"ContainerStarted","Data":"f6758ba8f2d66f036ae3891402e3a37a45619ee864f97e6bbef118c34a92595a"}
Sep 17 23:07:49.884125 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:49.884097    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn" event={"ID":"0d4ae492-1746-4b88-967a-00a962f8e882","Type":"ContainerStarted","Data":"e4b2b06912fb3127cf1b83b7a5c04c2ff41dab437415f9ba8500864d49a2fc92"}
Sep 17 23:07:50.894001 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:50.893962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d5dd618-059b-48fc-a7eb-1a6a395e6c66","Type":"ContainerStarted","Data":"44348a258be945e5ee2c7dd6a814d8f92f448cd80cfafd520f1f3428904c924f"}
Sep 17 23:07:50.896173 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:50.896137    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn" event={"ID":"0d4ae492-1746-4b88-967a-00a962f8e882","Type":"ContainerStarted","Data":"06b1c916194920ebb58ae358216b291ffb8c2baffabbac5d7311e0a4eb49a51a"}
Sep 17 23:07:50.945601 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:50.945548    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.702685004 podStartE2EDuration="5.945532117s" totalImagesPullingTime="3.226071449s" totalInitContainerRuntime="16.775664ms" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:50.94515952 +0000 UTC m=+82.552737201" watchObservedRunningTime="2026-09-17 23:07:50.945532117 +0000 UTC m=+82.553109776"
Sep 17 23:07:50.972106 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:50.972056    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn" podStartSLOduration=1.574459363 podStartE2EDuration="2.972038911s" totalImagesPullingTime="1.397579548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:50.970652964 +0000 UTC m=+82.578230645" watchObservedRunningTime="2026-09-17 23:07:50.972038911 +0000 UTC m=+82.579616571"
Sep 17 23:07:51.901211 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:51.901172    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x" event={"ID":"3053540d-c330-41b6-b57a-a08764748750","Type":"ContainerStarted","Data":"1f5345250a7f0722a50dafc672ab1f6b4574f22584977e12fc687107f79723fd"}
Sep 17 23:07:51.901695 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:51.901678    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"
Sep 17 23:07:51.905872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:51.905850    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x"
Sep 17 23:07:51.919038 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:07:51.918999    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-trd7x" podStartSLOduration=2.356672243 podStartE2EDuration="3.918985629s" totalImagesPullingTime="1.562313386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:51.917435163 +0000 UTC m=+83.525012836" watchObservedRunningTime="2026-09-17 23:07:51.918985629 +0000 UTC m=+83.526563304"
Sep 17 23:08:06.417560 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.417495    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-674fc5764c-4ztgh" podUID="fccf5e48-c1ab-4422-b934-81d42f5cb602" containerName="console" containerID="cri-o://fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5" gracePeriod=15
Sep 17 23:08:06.651949 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.651925    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:08:06.710254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.710167    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-config\") pod \"fccf5e48-c1ab-4422-b934-81d42f5cb602\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") "
Sep 17 23:08:06.710254 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.710234    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-oauth-config\") pod \"fccf5e48-c1ab-4422-b934-81d42f5cb602\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") "
Sep 17 23:08:06.710450 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.710266    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2zzp\" (UniqueName: \"kubernetes.io/projected/fccf5e48-c1ab-4422-b934-81d42f5cb602-kube-api-access-b2zzp\") pod \"fccf5e48-c1ab-4422-b934-81d42f5cb602\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") "
Sep 17 23:08:06.710450 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.710302    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-service-ca\") pod \"fccf5e48-c1ab-4422-b934-81d42f5cb602\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") "
Sep 17 23:08:06.710450 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.710326    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-oauth-serving-cert\") pod \"fccf5e48-c1ab-4422-b934-81d42f5cb602\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") "
Sep 17 23:08:06.710450 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.710389    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-serving-cert\") pod \"fccf5e48-c1ab-4422-b934-81d42f5cb602\" (UID: \"fccf5e48-c1ab-4422-b934-81d42f5cb602\") "
Sep 17 23:08:06.710735 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.710707    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-config" (OuterVolumeSpecName: "console-config") pod "fccf5e48-c1ab-4422-b934-81d42f5cb602" (UID: "fccf5e48-c1ab-4422-b934-81d42f5cb602"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:08:06.710872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.710741    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-service-ca" (OuterVolumeSpecName: "service-ca") pod "fccf5e48-c1ab-4422-b934-81d42f5cb602" (UID: "fccf5e48-c1ab-4422-b934-81d42f5cb602"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:08:06.710872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.710830    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fccf5e48-c1ab-4422-b934-81d42f5cb602" (UID: "fccf5e48-c1ab-4422-b934-81d42f5cb602"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:08:06.712748 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.712722    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fccf5e48-c1ab-4422-b934-81d42f5cb602" (UID: "fccf5e48-c1ab-4422-b934-81d42f5cb602"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:08:06.712846 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.712773    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fccf5e48-c1ab-4422-b934-81d42f5cb602-kube-api-access-b2zzp" (OuterVolumeSpecName: "kube-api-access-b2zzp") pod "fccf5e48-c1ab-4422-b934-81d42f5cb602" (UID: "fccf5e48-c1ab-4422-b934-81d42f5cb602"). InnerVolumeSpecName "kube-api-access-b2zzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:08:06.712846 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.712779    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fccf5e48-c1ab-4422-b934-81d42f5cb602" (UID: "fccf5e48-c1ab-4422-b934-81d42f5cb602"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:08:06.811631 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.811582    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2zzp\" (UniqueName: \"kubernetes.io/projected/fccf5e48-c1ab-4422-b934-81d42f5cb602-kube-api-access-b2zzp\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:08:06.811631 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.811624    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:08:06.811631 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.811636    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-oauth-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:08:06.811879 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.811651    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:08:06.811879 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.811664    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:08:06.811879 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.811674    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fccf5e48-c1ab-4422-b934-81d42f5cb602-console-oauth-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:08:06.955716 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.955682    2583 generic.go:356] "Generic (PLEG): container finished" podID="fccf5e48-c1ab-4422-b934-81d42f5cb602" containerID="fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5" exitCode=0
Sep 17 23:08:06.955903 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.955728    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674fc5764c-4ztgh"
Sep 17 23:08:06.955903 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.955777    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674fc5764c-4ztgh" event={"ID":"fccf5e48-c1ab-4422-b934-81d42f5cb602","Type":"ContainerDied","Data":"fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5"}
Sep 17 23:08:06.955903 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.955827    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674fc5764c-4ztgh" event={"ID":"fccf5e48-c1ab-4422-b934-81d42f5cb602","Type":"ContainerDied","Data":"04cbd77df0ef773462f2de024f292d25b818268e290eb9f4db569cd23b03571f"}
Sep 17 23:08:06.955903 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.955847    2583 scope.go:117] "RemoveContainer" containerID="fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5"
Sep 17 23:08:06.964416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.964400    2583 scope.go:117] "RemoveContainer" containerID="fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5"
Sep 17 23:08:06.964761 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:08:06.964731    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5\": container with ID starting with fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5 not found: ID does not exist" containerID="fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5"
Sep 17 23:08:06.964829 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.964768    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5"} err="failed to get container status \"fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5\": rpc error: code = NotFound desc = could not find container \"fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5\": container with ID starting with fd95ec24bedd1674e8d8ef24a7724d89074481916989499c026b0f8cdbd9b2d5 not found: ID does not exist"
Sep 17 23:08:06.975933 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.975902    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-674fc5764c-4ztgh"]
Sep 17 23:08:06.979441 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:06.979414    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-674fc5764c-4ztgh"]
Sep 17 23:08:08.486374 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:08.486341    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fccf5e48-c1ab-4422-b934-81d42f5cb602" path="/var/lib/kubelet/pods/fccf5e48-c1ab-4422-b934-81d42f5cb602/volumes"
Sep 17 23:08:08.665735 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:08.665703    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:08:08.665853 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:08.665765    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:08:12.842151 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:12.842125    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zsdgk"
Sep 17 23:08:28.671368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:28.671341    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:08:28.675764 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:08:28.675739    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f799df98b-zs8dn"
Sep 17 23:09:08.334780 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.334744    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"]
Sep 17 23:09:08.335187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.334997    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fccf5e48-c1ab-4422-b934-81d42f5cb602" containerName="console"
Sep 17 23:09:08.335187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.335009    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fccf5e48-c1ab-4422-b934-81d42f5cb602" containerName="console"
Sep 17 23:09:08.335187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.335060    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fccf5e48-c1ab-4422-b934-81d42f5cb602" containerName="console"
Sep 17 23:09:08.339117 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.339100    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.341632 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.341606    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 17 23:09:08.341786 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.341656    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 17 23:09:08.341786 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.341672    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wgzsp\""
Sep 17 23:09:08.341786 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.341617    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 17 23:09:08.341786 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.341611    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 17 23:09:08.341786 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.341728    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 17 23:09:08.346847 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.346823    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 17 23:09:08.349711 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.349687    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"]
Sep 17 23:09:08.354798 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.354769    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8304a79-061a-454f-8aa6-f25217cf8ca1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.354928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.354808    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.354928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.354842    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8304a79-061a-454f-8aa6-f25217cf8ca1-metrics-client-ca\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.354928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.354890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjvc2\" (UniqueName: \"kubernetes.io/projected/f8304a79-061a-454f-8aa6-f25217cf8ca1-kube-api-access-jjvc2\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.355047 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.354955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-federate-client-tls\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.355047 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.354974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-telemeter-client-tls\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.355047 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.354998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-secret-telemeter-client\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.355047 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.355021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8304a79-061a-454f-8aa6-f25217cf8ca1-serving-certs-ca-bundle\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.455800 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.455762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-federate-client-tls\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.455800 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.455799    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-telemeter-client-tls\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.456066 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.455828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-secret-telemeter-client\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.456066 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.455945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8304a79-061a-454f-8aa6-f25217cf8ca1-serving-certs-ca-bundle\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.456066 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.455983    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8304a79-061a-454f-8aa6-f25217cf8ca1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.456066 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.456002    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.456267 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.456127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8304a79-061a-454f-8aa6-f25217cf8ca1-metrics-client-ca\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.456267 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.456154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjvc2\" (UniqueName: \"kubernetes.io/projected/f8304a79-061a-454f-8aa6-f25217cf8ca1-kube-api-access-jjvc2\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.456855 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.456825    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8304a79-061a-454f-8aa6-f25217cf8ca1-metrics-client-ca\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.456855 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.456844    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8304a79-061a-454f-8aa6-f25217cf8ca1-serving-certs-ca-bundle\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.457004 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.456929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8304a79-061a-454f-8aa6-f25217cf8ca1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.458575 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.458553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-secret-telemeter-client\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.458682 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.458593    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-telemeter-client-tls\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.458803 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.458787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-federate-client-tls\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.458861 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.458838    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8304a79-061a-454f-8aa6-f25217cf8ca1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.464100 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.464077    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjvc2\" (UniqueName: \"kubernetes.io/projected/f8304a79-061a-454f-8aa6-f25217cf8ca1-kube-api-access-jjvc2\") pod \"telemeter-client-7f785bf9cb-nf4rh\" (UID: \"f8304a79-061a-454f-8aa6-f25217cf8ca1\") " pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.650397 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.650310    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"
Sep 17 23:09:08.927358 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:08.927330    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh"]
Sep 17 23:09:08.928274 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:09:08.928251    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8304a79_061a_454f_8aa6_f25217cf8ca1.slice/crio-3ba5eaa722ff4f556d03142313b3a1221fdddfccbc13eaddec943f85ee03e986 WatchSource:0}: Error finding container 3ba5eaa722ff4f556d03142313b3a1221fdddfccbc13eaddec943f85ee03e986: Status 404 returned error can't find the container with id 3ba5eaa722ff4f556d03142313b3a1221fdddfccbc13eaddec943f85ee03e986
Sep 17 23:09:09.175793 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:09.175686    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh" event={"ID":"f8304a79-061a-454f-8aa6-f25217cf8ca1","Type":"ContainerStarted","Data":"3ba5eaa722ff4f556d03142313b3a1221fdddfccbc13eaddec943f85ee03e986"}
Sep 17 23:09:11.185811 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.185780    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh" event={"ID":"f8304a79-061a-454f-8aa6-f25217cf8ca1","Type":"ContainerStarted","Data":"7f43abfe91141481d2ed9102b5b231104dc86719cf933e0cdf02797fb0811699"}
Sep 17 23:09:11.186212 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.185833    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh" event={"ID":"f8304a79-061a-454f-8aa6-f25217cf8ca1","Type":"ContainerStarted","Data":"8e6437da6158325de2c809deda04edefcf44783cc00d48d9e06a3252989778d7"}
Sep 17 23:09:11.186212 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.185853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh" event={"ID":"f8304a79-061a-454f-8aa6-f25217cf8ca1","Type":"ContainerStarted","Data":"715fd531a1b16d94d22ab1c238684a84430f49cd8a754bdbd390c03577c6054f"}
Sep 17 23:09:11.210518 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.210448    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh" podStartSLOduration=1.51448235 podStartE2EDuration="3.210433491s" totalImagesPullingTime="1.695951141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:09:11.20893064 +0000 UTC m=+162.816508300" watchObservedRunningTime="2026-09-17 23:09:11.210433491 +0000 UTC m=+162.818011150"
Sep 17 23:09:11.293414 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.293379    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6f7b5ddb-jjlhc"]
Sep 17 23:09:11.296265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.296249    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.298886 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.298855    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 23:09:11.299038 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.298941    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 23:09:11.299038 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.299024    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 23:09:11.299147 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.299074    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 23:09:11.299207 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.299184    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 23:09:11.299207 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.299198    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 23:09:11.299403 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.299386    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rftn6\""
Sep 17 23:09:11.299493 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.299482    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 23:09:11.303790 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.303773    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 23:09:11.307208 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.307187    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6f7b5ddb-jjlhc"]
Sep 17 23:09:11.375768 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.375738    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-trusted-ca-bundle\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.375768 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.375772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-oauth-config\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.375768 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.375788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wscfx\" (UniqueName: \"kubernetes.io/projected/2af2cc1f-a8df-4322-9c76-0bc3030f9548-kube-api-access-wscfx\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.376022 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.375807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-config\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.376022 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.375830    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-oauth-serving-cert\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.376022 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.375892    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-service-ca\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.376022 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.375928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-serving-cert\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.476975 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.476890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-service-ca\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.476975 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.476933    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-serving-cert\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.476975 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.476967    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-trusted-ca-bundle\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.477262 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.476984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-oauth-config\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.477262 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.477002    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wscfx\" (UniqueName: \"kubernetes.io/projected/2af2cc1f-a8df-4322-9c76-0bc3030f9548-kube-api-access-wscfx\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.477262 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.477024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-config\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.477262 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.477058    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-oauth-serving-cert\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.477950 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.477790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-service-ca\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.477950 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.477920    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-oauth-serving-cert\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.478084 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.477920    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-config\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.478084 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.478054    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-trusted-ca-bundle\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.479532 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.479513    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-serving-cert\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.479622 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.479545    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-oauth-config\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.484408 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.484386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wscfx\" (UniqueName: \"kubernetes.io/projected/2af2cc1f-a8df-4322-9c76-0bc3030f9548-kube-api-access-wscfx\") pod \"console-7c6f7b5ddb-jjlhc\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") " pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.605576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.605527    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:11.874528 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:11.874493    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6f7b5ddb-jjlhc"]
Sep 17 23:09:11.877280 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:09:11.877243    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af2cc1f_a8df_4322_9c76_0bc3030f9548.slice/crio-97299da2307d97d29d31590bd01ef1f8d2f5046371af3d8727661f20abe4cf68 WatchSource:0}: Error finding container 97299da2307d97d29d31590bd01ef1f8d2f5046371af3d8727661f20abe4cf68: Status 404 returned error can't find the container with id 97299da2307d97d29d31590bd01ef1f8d2f5046371af3d8727661f20abe4cf68
Sep 17 23:09:12.191707 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:12.191607    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6f7b5ddb-jjlhc" event={"ID":"2af2cc1f-a8df-4322-9c76-0bc3030f9548","Type":"ContainerStarted","Data":"d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e"}
Sep 17 23:09:12.191707 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:12.191666    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6f7b5ddb-jjlhc" event={"ID":"2af2cc1f-a8df-4322-9c76-0bc3030f9548","Type":"ContainerStarted","Data":"97299da2307d97d29d31590bd01ef1f8d2f5046371af3d8727661f20abe4cf68"}
Sep 17 23:09:12.210078 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:12.210025    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c6f7b5ddb-jjlhc" podStartSLOduration=1.210006978 podStartE2EDuration="1.210006978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:09:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:09:12.208034945 +0000 UTC m=+163.815612624" watchObservedRunningTime="2026-09-17 23:09:12.210006978 +0000 UTC m=+163.817584708"
Sep 17 23:09:21.606165 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:21.606109    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:21.606733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:21.606290    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:21.611283 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:21.611260    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:22.230256 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.230230    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:22.337752 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.337722    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8649477db9-p4q7n"]
Sep 17 23:09:22.342172 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.342154    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.352600 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.352578    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8649477db9-p4q7n"]
Sep 17 23:09:22.356383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.356360    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-service-ca\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.356512 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.356388    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-oauth-config\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.356512 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.356408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-trusted-ca-bundle\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.356512 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.356423    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-oauth-serving-cert\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.356512 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.356449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlvl7\" (UniqueName: \"kubernetes.io/projected/582fd1c7-9451-43c5-942b-7d4213bd462f-kube-api-access-xlvl7\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.356701 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.356580    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-console-config\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.356701 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.356624    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-serving-cert\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.457788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.457744    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-oauth-config\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.457788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.457787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-trusted-ca-bundle\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.458041 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.457808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-oauth-serving-cert\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.458041 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.457843    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlvl7\" (UniqueName: \"kubernetes.io/projected/582fd1c7-9451-43c5-942b-7d4213bd462f-kube-api-access-xlvl7\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.458041 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.457879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-console-config\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.458041 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.457905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-serving-cert\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.458041 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.457971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-service-ca\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.458707 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.458684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-service-ca\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.458803 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.458709    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-oauth-serving-cert\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.458803 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.458766    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-console-config\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.458875 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.458776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-trusted-ca-bundle\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.460388 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.460365    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-serving-cert\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.460388 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.460384    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-oauth-config\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.466181 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.466153    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlvl7\" (UniqueName: \"kubernetes.io/projected/582fd1c7-9451-43c5-942b-7d4213bd462f-kube-api-access-xlvl7\") pod \"console-8649477db9-p4q7n\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") " pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.650230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.650186    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:22.924338 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:22.924311    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8649477db9-p4q7n"]
Sep 17 23:09:22.926715 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:09:22.926683    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582fd1c7_9451_43c5_942b_7d4213bd462f.slice/crio-d9d0ec3b5485e82566a92d87fe9ef07d8606f1eb59814a82eba21fe62fff0be8 WatchSource:0}: Error finding container d9d0ec3b5485e82566a92d87fe9ef07d8606f1eb59814a82eba21fe62fff0be8: Status 404 returned error can't find the container with id d9d0ec3b5485e82566a92d87fe9ef07d8606f1eb59814a82eba21fe62fff0be8
Sep 17 23:09:23.231015 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:23.230922    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8649477db9-p4q7n" event={"ID":"582fd1c7-9451-43c5-942b-7d4213bd462f","Type":"ContainerStarted","Data":"c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17"}
Sep 17 23:09:23.231015 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:23.230975    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8649477db9-p4q7n" event={"ID":"582fd1c7-9451-43c5-942b-7d4213bd462f","Type":"ContainerStarted","Data":"d9d0ec3b5485e82566a92d87fe9ef07d8606f1eb59814a82eba21fe62fff0be8"}
Sep 17 23:09:23.249733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:23.249676    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8649477db9-p4q7n" podStartSLOduration=1.249657475 podStartE2EDuration="1.249657475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:09:23.248274281 +0000 UTC m=+174.855851942" watchObservedRunningTime="2026-09-17 23:09:23.249657475 +0000 UTC m=+174.857235134"
Sep 17 23:09:32.651078 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:32.651039    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:32.651570 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:32.651101    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:32.655824 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:32.655804    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:33.271044 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:33.271014    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:09:33.317043 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:33.317006    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6f7b5ddb-jjlhc"]
Sep 17 23:09:58.336503 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.336438    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c6f7b5ddb-jjlhc" podUID="2af2cc1f-a8df-4322-9c76-0bc3030f9548" containerName="console" containerID="cri-o://d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e" gracePeriod=15
Sep 17 23:09:58.577780 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.577752    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:58.746593 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.746502    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-serving-cert\") pod \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") "
Sep 17 23:09:58.746593 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.746543    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-oauth-serving-cert\") pod \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") "
Sep 17 23:09:58.746593 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.746585    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-oauth-config\") pod \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") "
Sep 17 23:09:58.746860 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.746624    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-config\") pod \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") "
Sep 17 23:09:58.746860 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.746644    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-service-ca\") pod \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") "
Sep 17 23:09:58.746860 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.746673    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-trusted-ca-bundle\") pod \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") "
Sep 17 23:09:58.746860 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.746700    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wscfx\" (UniqueName: \"kubernetes.io/projected/2af2cc1f-a8df-4322-9c76-0bc3030f9548-kube-api-access-wscfx\") pod \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\" (UID: \"2af2cc1f-a8df-4322-9c76-0bc3030f9548\") "
Sep 17 23:09:58.747058 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.746990    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2af2cc1f-a8df-4322-9c76-0bc3030f9548" (UID: "2af2cc1f-a8df-4322-9c76-0bc3030f9548"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:09:58.747187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.747153    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-config" (OuterVolumeSpecName: "console-config") pod "2af2cc1f-a8df-4322-9c76-0bc3030f9548" (UID: "2af2cc1f-a8df-4322-9c76-0bc3030f9548"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:09:58.747187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.747157    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-service-ca" (OuterVolumeSpecName: "service-ca") pod "2af2cc1f-a8df-4322-9c76-0bc3030f9548" (UID: "2af2cc1f-a8df-4322-9c76-0bc3030f9548"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:09:58.747523 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.747502    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2af2cc1f-a8df-4322-9c76-0bc3030f9548" (UID: "2af2cc1f-a8df-4322-9c76-0bc3030f9548"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:09:58.748724 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.748701    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2af2cc1f-a8df-4322-9c76-0bc3030f9548" (UID: "2af2cc1f-a8df-4322-9c76-0bc3030f9548"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:09:58.748815 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.748762    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2af2cc1f-a8df-4322-9c76-0bc3030f9548" (UID: "2af2cc1f-a8df-4322-9c76-0bc3030f9548"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:09:58.748888 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.748873    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af2cc1f-a8df-4322-9c76-0bc3030f9548-kube-api-access-wscfx" (OuterVolumeSpecName: "kube-api-access-wscfx") pod "2af2cc1f-a8df-4322-9c76-0bc3030f9548" (UID: "2af2cc1f-a8df-4322-9c76-0bc3030f9548"). InnerVolumeSpecName "kube-api-access-wscfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:09:58.847962 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.847932    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-trusted-ca-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:09:58.847962 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.847959    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wscfx\" (UniqueName: \"kubernetes.io/projected/2af2cc1f-a8df-4322-9c76-0bc3030f9548-kube-api-access-wscfx\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:09:58.847962 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.847968    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:09:58.848183 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.847979    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-oauth-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:09:58.848183 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.847987    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-oauth-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:09:58.848183 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.847998    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-console-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:09:58.848183 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:58.848006    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af2cc1f-a8df-4322-9c76-0bc3030f9548-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:09:59.360230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:59.360197    2583 generic.go:356] "Generic (PLEG): container finished" podID="2af2cc1f-a8df-4322-9c76-0bc3030f9548" containerID="d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e" exitCode=0
Sep 17 23:09:59.360731 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:59.360243    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6f7b5ddb-jjlhc"
Sep 17 23:09:59.360731 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:59.360268    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6f7b5ddb-jjlhc" event={"ID":"2af2cc1f-a8df-4322-9c76-0bc3030f9548","Type":"ContainerDied","Data":"d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e"}
Sep 17 23:09:59.360731 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:59.360308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6f7b5ddb-jjlhc" event={"ID":"2af2cc1f-a8df-4322-9c76-0bc3030f9548","Type":"ContainerDied","Data":"97299da2307d97d29d31590bd01ef1f8d2f5046371af3d8727661f20abe4cf68"}
Sep 17 23:09:59.360731 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:59.360328    2583 scope.go:117] "RemoveContainer" containerID="d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e"
Sep 17 23:09:59.368542 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:59.368518    2583 scope.go:117] "RemoveContainer" containerID="d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e"
Sep 17 23:09:59.368825 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:09:59.368807    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e\": container with ID starting with d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e not found: ID does not exist" containerID="d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e"
Sep 17 23:09:59.368875 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:59.368834    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e"} err="failed to get container status \"d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e\": rpc error: code = NotFound desc = could not find container \"d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e\": container with ID starting with d98e626da1e7a921c31e63b7718d73d0da81e80194b19c57b5704d27631f7f1e not found: ID does not exist"
Sep 17 23:09:59.379904 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:59.379878    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6f7b5ddb-jjlhc"]
Sep 17 23:09:59.383686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:09:59.383666    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c6f7b5ddb-jjlhc"]
Sep 17 23:10:00.486099 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:00.486064    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2af2cc1f-a8df-4322-9c76-0bc3030f9548" path="/var/lib/kubelet/pods/2af2cc1f-a8df-4322-9c76-0bc3030f9548/volumes"
Sep 17 23:10:11.137153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.137119    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"]
Sep 17 23:10:11.137604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.137387    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af2cc1f-a8df-4322-9c76-0bc3030f9548" containerName="console"
Sep 17 23:10:11.137604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.137397    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af2cc1f-a8df-4322-9c76-0bc3030f9548" containerName="console"
Sep 17 23:10:11.137604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.137446    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af2cc1f-a8df-4322-9c76-0bc3030f9548" containerName="console"
Sep 17 23:10:11.141850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.141829    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.144573 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.144552    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 23:10:11.145456 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.145439    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hrdr\""
Sep 17 23:10:11.145456 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.145453    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 23:10:11.150106 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.150087    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"]
Sep 17 23:10:11.239562 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.239514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.239562 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.239557    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.239823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.239699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7dvb\" (UniqueName: \"kubernetes.io/projected/897a1a40-a512-45be-9bd2-64664e1cd512-kube-api-access-x7dvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.340747 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.340708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7dvb\" (UniqueName: \"kubernetes.io/projected/897a1a40-a512-45be-9bd2-64664e1cd512-kube-api-access-x7dvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.340919 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.340759    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.340919 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.340781    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.341175 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.341153    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.341251 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.341186    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.359539 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.359509    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7dvb\" (UniqueName: \"kubernetes.io/projected/897a1a40-a512-45be-9bd2-64664e1cd512-kube-api-access-x7dvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.452048 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.451957    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:11.732271 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:11.732161    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"]
Sep 17 23:10:11.734946 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:10:11.734910    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897a1a40_a512_45be_9bd2_64664e1cd512.slice/crio-1bf3b387959bb3a9bcb07edf61f4b2259508cd0b0789384f22821d5cd552d4e3 WatchSource:0}: Error finding container 1bf3b387959bb3a9bcb07edf61f4b2259508cd0b0789384f22821d5cd552d4e3: Status 404 returned error can't find the container with id 1bf3b387959bb3a9bcb07edf61f4b2259508cd0b0789384f22821d5cd552d4e3
Sep 17 23:10:12.411149 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:12.411111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn" event={"ID":"897a1a40-a512-45be-9bd2-64664e1cd512","Type":"ContainerStarted","Data":"1bf3b387959bb3a9bcb07edf61f4b2259508cd0b0789384f22821d5cd552d4e3"}
Sep 17 23:10:18.434659 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:18.434621    2583 generic.go:356] "Generic (PLEG): container finished" podID="897a1a40-a512-45be-9bd2-64664e1cd512" containerID="727c7aa1deaf9b60eb03818692062d7727d532bf875c2e1a55274d934816fa5b" exitCode=0
Sep 17 23:10:18.435127 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:18.434657    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn" event={"ID":"897a1a40-a512-45be-9bd2-64664e1cd512","Type":"ContainerDied","Data":"727c7aa1deaf9b60eb03818692062d7727d532bf875c2e1a55274d934816fa5b"}
Sep 17 23:10:21.448171 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:21.448137    2583 generic.go:356] "Generic (PLEG): container finished" podID="897a1a40-a512-45be-9bd2-64664e1cd512" containerID="5719fcd1a0d4b7571389d14136389e1f4af8ae97927e693ce661a4425e60fc92" exitCode=0
Sep 17 23:10:21.448564 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:21.448176    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn" event={"ID":"897a1a40-a512-45be-9bd2-64664e1cd512","Type":"ContainerDied","Data":"5719fcd1a0d4b7571389d14136389e1f4af8ae97927e693ce661a4425e60fc92"}
Sep 17 23:10:28.479501 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:28.479453    2583 generic.go:356] "Generic (PLEG): container finished" podID="897a1a40-a512-45be-9bd2-64664e1cd512" containerID="52fcb5f697686cb4de8cb1cf237fa43b49fa4b313d1fc3d75ddfb1a5d0edfada" exitCode=0
Sep 17 23:10:28.479928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:28.479541    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn" event={"ID":"897a1a40-a512-45be-9bd2-64664e1cd512","Type":"ContainerDied","Data":"52fcb5f697686cb4de8cb1cf237fa43b49fa4b313d1fc3d75ddfb1a5d0edfada"}
Sep 17 23:10:29.604823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:29.604797    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:29.692165 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:29.692135    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-bundle\") pod \"897a1a40-a512-45be-9bd2-64664e1cd512\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") "
Sep 17 23:10:29.692339 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:29.692191    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7dvb\" (UniqueName: \"kubernetes.io/projected/897a1a40-a512-45be-9bd2-64664e1cd512-kube-api-access-x7dvb\") pod \"897a1a40-a512-45be-9bd2-64664e1cd512\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") "
Sep 17 23:10:29.692339 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:29.692216    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-util\") pod \"897a1a40-a512-45be-9bd2-64664e1cd512\" (UID: \"897a1a40-a512-45be-9bd2-64664e1cd512\") "
Sep 17 23:10:29.692995 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:29.692968    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-bundle" (OuterVolumeSpecName: "bundle") pod "897a1a40-a512-45be-9bd2-64664e1cd512" (UID: "897a1a40-a512-45be-9bd2-64664e1cd512"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:10:29.694324 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:29.694300    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/897a1a40-a512-45be-9bd2-64664e1cd512-kube-api-access-x7dvb" (OuterVolumeSpecName: "kube-api-access-x7dvb") pod "897a1a40-a512-45be-9bd2-64664e1cd512" (UID: "897a1a40-a512-45be-9bd2-64664e1cd512"). InnerVolumeSpecName "kube-api-access-x7dvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:10:29.696845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:29.696822    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-util" (OuterVolumeSpecName: "util") pod "897a1a40-a512-45be-9bd2-64664e1cd512" (UID: "897a1a40-a512-45be-9bd2-64664e1cd512"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:10:29.792909 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:29.792870    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7dvb\" (UniqueName: \"kubernetes.io/projected/897a1a40-a512-45be-9bd2-64664e1cd512-kube-api-access-x7dvb\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:10:29.792909 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:29.792907    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:10:29.793101 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:29.792924    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/897a1a40-a512-45be-9bd2-64664e1cd512-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:10:30.487925 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:30.487900    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn"
Sep 17 23:10:30.487925 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:30.487909    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rsdgn" event={"ID":"897a1a40-a512-45be-9bd2-64664e1cd512","Type":"ContainerDied","Data":"1bf3b387959bb3a9bcb07edf61f4b2259508cd0b0789384f22821d5cd552d4e3"}
Sep 17 23:10:30.488153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:30.487947    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bf3b387959bb3a9bcb07edf61f4b2259508cd0b0789384f22821d5cd552d4e3"
Sep 17 23:10:34.094731 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.094693    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"]
Sep 17 23:10:34.095168 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.094962    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="897a1a40-a512-45be-9bd2-64664e1cd512" containerName="extract"
Sep 17 23:10:34.095168 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.094973    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="897a1a40-a512-45be-9bd2-64664e1cd512" containerName="extract"
Sep 17 23:10:34.095168 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.094991    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="897a1a40-a512-45be-9bd2-64664e1cd512" containerName="util"
Sep 17 23:10:34.095168 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.094996    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="897a1a40-a512-45be-9bd2-64664e1cd512" containerName="util"
Sep 17 23:10:34.095168 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.095002    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="897a1a40-a512-45be-9bd2-64664e1cd512" containerName="pull"
Sep 17 23:10:34.095168 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.095008    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="897a1a40-a512-45be-9bd2-64664e1cd512" containerName="pull"
Sep 17 23:10:34.095168 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.095054    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="897a1a40-a512-45be-9bd2-64664e1cd512" containerName="extract"
Sep 17 23:10:34.098618 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.098602    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"
Sep 17 23:10:34.100996 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.100973    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:10:34.101102 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.101066    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6w88k\""
Sep 17 23:10:34.101164 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.101139    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 17 23:10:34.110837 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.110817    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"]
Sep 17 23:10:34.123801 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.123779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad256be-e8dd-4910-8f44-3998c2379639-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-99586\" (UID: \"cad256be-e8dd-4910-8f44-3998c2379639\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"
Sep 17 23:10:34.123918 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.123827    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjgb2\" (UniqueName: \"kubernetes.io/projected/cad256be-e8dd-4910-8f44-3998c2379639-kube-api-access-jjgb2\") pod \"cert-manager-operator-controller-manager-55c444bf86-99586\" (UID: \"cad256be-e8dd-4910-8f44-3998c2379639\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"
Sep 17 23:10:34.224966 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.224920    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad256be-e8dd-4910-8f44-3998c2379639-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-99586\" (UID: \"cad256be-e8dd-4910-8f44-3998c2379639\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"
Sep 17 23:10:34.225141 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.225005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjgb2\" (UniqueName: \"kubernetes.io/projected/cad256be-e8dd-4910-8f44-3998c2379639-kube-api-access-jjgb2\") pod \"cert-manager-operator-controller-manager-55c444bf86-99586\" (UID: \"cad256be-e8dd-4910-8f44-3998c2379639\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"
Sep 17 23:10:34.225382 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.225361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad256be-e8dd-4910-8f44-3998c2379639-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-99586\" (UID: \"cad256be-e8dd-4910-8f44-3998c2379639\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"
Sep 17 23:10:34.236647 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.236617    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjgb2\" (UniqueName: \"kubernetes.io/projected/cad256be-e8dd-4910-8f44-3998c2379639-kube-api-access-jjgb2\") pod \"cert-manager-operator-controller-manager-55c444bf86-99586\" (UID: \"cad256be-e8dd-4910-8f44-3998c2379639\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"
Sep 17 23:10:34.407892 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.407801    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"
Sep 17 23:10:34.681735 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:34.681711    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586"]
Sep 17 23:10:34.683992 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:10:34.683964    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad256be_e8dd_4910_8f44_3998c2379639.slice/crio-d1d0e67bc17451d1843bba714d573a6d0d32d72747da66414f1c1281cf2eef9e WatchSource:0}: Error finding container d1d0e67bc17451d1843bba714d573a6d0d32d72747da66414f1c1281cf2eef9e: Status 404 returned error can't find the container with id d1d0e67bc17451d1843bba714d573a6d0d32d72747da66414f1c1281cf2eef9e
Sep 17 23:10:35.508282 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:35.508234    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586" event={"ID":"cad256be-e8dd-4910-8f44-3998c2379639","Type":"ContainerStarted","Data":"d1d0e67bc17451d1843bba714d573a6d0d32d72747da66414f1c1281cf2eef9e"}
Sep 17 23:10:36.516784 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:36.516750    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586" event={"ID":"cad256be-e8dd-4910-8f44-3998c2379639","Type":"ContainerStarted","Data":"a9ee0ebbfdb13bbe41210813621e921f81cdbe812ed98b0075227fd8d854f635"}
Sep 17 23:10:36.544674 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:36.544617    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-99586" podStartSLOduration=1.030388527 podStartE2EDuration="2.544599767s" totalImagesPullingTime="1.51421124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:10:36.542643511 +0000 UTC m=+248.150221187" watchObservedRunningTime="2026-09-17 23:10:36.544599767 +0000 UTC m=+248.152177427"
Sep 17 23:10:37.782648 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.782614    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"]
Sep 17 23:10:37.785139 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.785116    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:37.789094 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.789072    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 23:10:37.789337 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.789316    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hrdr\""
Sep 17 23:10:37.789897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.789883    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 23:10:37.806108 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.806073    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"]
Sep 17 23:10:37.855894 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.855862    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qgh5\" (UniqueName: \"kubernetes.io/projected/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-kube-api-access-9qgh5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:37.855894 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.855899    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:37.856107 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.855930    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:37.956576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.956533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qgh5\" (UniqueName: \"kubernetes.io/projected/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-kube-api-access-9qgh5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:37.956776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.956579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:37.956776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.956732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:37.956993 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.956972    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:37.957054 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.957028    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:37.970817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:37.970789    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qgh5\" (UniqueName: \"kubernetes.io/projected/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-kube-api-access-9qgh5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:38.093636 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.093554    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:38.096360 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.096336    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pwpph"]
Sep 17 23:10:38.098265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.098243    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph"
Sep 17 23:10:38.101088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.101066    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 23:10:38.101225 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.101201    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 23:10:38.101320 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.101304    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rxfmh\""
Sep 17 23:10:38.108621 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.108598    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pwpph"]
Sep 17 23:10:38.159182 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.159099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9d53311-6ff6-404e-bba5-b298cb8892ae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pwpph\" (UID: \"a9d53311-6ff6-404e-bba5-b298cb8892ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph"
Sep 17 23:10:38.159312 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.159254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxxk4\" (UniqueName: \"kubernetes.io/projected/a9d53311-6ff6-404e-bba5-b298cb8892ae-kube-api-access-gxxk4\") pod \"cert-manager-webhook-6486ffd997-pwpph\" (UID: \"a9d53311-6ff6-404e-bba5-b298cb8892ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph"
Sep 17 23:10:38.260360 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.260329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxxk4\" (UniqueName: \"kubernetes.io/projected/a9d53311-6ff6-404e-bba5-b298cb8892ae-kube-api-access-gxxk4\") pod \"cert-manager-webhook-6486ffd997-pwpph\" (UID: \"a9d53311-6ff6-404e-bba5-b298cb8892ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph"
Sep 17 23:10:38.260540 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.260377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9d53311-6ff6-404e-bba5-b298cb8892ae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pwpph\" (UID: \"a9d53311-6ff6-404e-bba5-b298cb8892ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph"
Sep 17 23:10:38.272028 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.272004    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9d53311-6ff6-404e-bba5-b298cb8892ae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pwpph\" (UID: \"a9d53311-6ff6-404e-bba5-b298cb8892ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph"
Sep 17 23:10:38.272210 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.272188    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxxk4\" (UniqueName: \"kubernetes.io/projected/a9d53311-6ff6-404e-bba5-b298cb8892ae-kube-api-access-gxxk4\") pod \"cert-manager-webhook-6486ffd997-pwpph\" (UID: \"a9d53311-6ff6-404e-bba5-b298cb8892ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph"
Sep 17 23:10:38.366962 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.366928    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"]
Sep 17 23:10:38.369238 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:10:38.369212    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec7480c_b19a_461e_ad0e_4bfc4370edd1.slice/crio-31cdf7a27fff75e5fa8d7dfbbfcb21e0430f92997d6c5ab00a15f89417289f77 WatchSource:0}: Error finding container 31cdf7a27fff75e5fa8d7dfbbfcb21e0430f92997d6c5ab00a15f89417289f77: Status 404 returned error can't find the container with id 31cdf7a27fff75e5fa8d7dfbbfcb21e0430f92997d6c5ab00a15f89417289f77
Sep 17 23:10:38.428005 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.427984    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph"
Sep 17 23:10:38.529918 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.529885    2583 generic.go:356] "Generic (PLEG): container finished" podID="8ec7480c-b19a-461e-ad0e-4bfc4370edd1" containerID="3722fdddcceb9f2393177292544e8d88f51437ed422b5543585ab9ff61aa6525" exitCode=0
Sep 17 23:10:38.530061 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.529941    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg" event={"ID":"8ec7480c-b19a-461e-ad0e-4bfc4370edd1","Type":"ContainerDied","Data":"3722fdddcceb9f2393177292544e8d88f51437ed422b5543585ab9ff61aa6525"}
Sep 17 23:10:38.530061 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.529992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg" event={"ID":"8ec7480c-b19a-461e-ad0e-4bfc4370edd1","Type":"ContainerStarted","Data":"31cdf7a27fff75e5fa8d7dfbbfcb21e0430f92997d6c5ab00a15f89417289f77"}
Sep 17 23:10:38.703733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:38.703708    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pwpph"]
Sep 17 23:10:38.706224 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:10:38.706201    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9d53311_6ff6_404e_bba5_b298cb8892ae.slice/crio-5523fa7627b272123f5d0a45d5f6273263e8a70d8f93e9e74ba67eed884d92a6 WatchSource:0}: Error finding container 5523fa7627b272123f5d0a45d5f6273263e8a70d8f93e9e74ba67eed884d92a6: Status 404 returned error can't find the container with id 5523fa7627b272123f5d0a45d5f6273263e8a70d8f93e9e74ba67eed884d92a6
Sep 17 23:10:39.536339 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:39.536280    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph" event={"ID":"a9d53311-6ff6-404e-bba5-b298cb8892ae","Type":"ContainerStarted","Data":"5523fa7627b272123f5d0a45d5f6273263e8a70d8f93e9e74ba67eed884d92a6"}
Sep 17 23:10:41.546069 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:41.546036    2583 generic.go:356] "Generic (PLEG): container finished" podID="8ec7480c-b19a-461e-ad0e-4bfc4370edd1" containerID="f69805e39459a67d4c773db62acc845ff709a199a6cf18e3904a9c87f680d135" exitCode=0
Sep 17 23:10:41.546576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:41.546126    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg" event={"ID":"8ec7480c-b19a-461e-ad0e-4bfc4370edd1","Type":"ContainerDied","Data":"f69805e39459a67d4c773db62acc845ff709a199a6cf18e3904a9c87f680d135"}
Sep 17 23:10:41.547743 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:41.547726    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph" event={"ID":"a9d53311-6ff6-404e-bba5-b298cb8892ae","Type":"ContainerStarted","Data":"d4040ccbec6d17df1b308c1100f489cb1b53d7773cbe4e53e22d2bcb963932ed"}
Sep 17 23:10:41.547852 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:41.547836    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph"
Sep 17 23:10:41.588272 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:41.588227    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph" podStartSLOduration=1.040639201 podStartE2EDuration="3.588207884s" totalImagesPullingTime="2.547568683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:10:41.587789501 +0000 UTC m=+253.195367162" watchObservedRunningTime="2026-09-17 23:10:41.588207884 +0000 UTC m=+253.195785544"
Sep 17 23:10:42.553767 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:42.553679    2583 generic.go:356] "Generic (PLEG): container finished" podID="8ec7480c-b19a-461e-ad0e-4bfc4370edd1" containerID="904fef0068cd56050cea1715089f8c455c351ce1e99b74c121176b250bc272a1" exitCode=0
Sep 17 23:10:42.554128 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:42.553762    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg" event={"ID":"8ec7480c-b19a-461e-ad0e-4bfc4370edd1","Type":"ContainerDied","Data":"904fef0068cd56050cea1715089f8c455c351ce1e99b74c121176b250bc272a1"}
Sep 17 23:10:43.687198 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:43.687176    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:43.811662 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:43.811581    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qgh5\" (UniqueName: \"kubernetes.io/projected/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-kube-api-access-9qgh5\") pod \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") "
Sep 17 23:10:43.811662 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:43.811646    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-util\") pod \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") "
Sep 17 23:10:43.811823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:43.811672    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-bundle\") pod \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\" (UID: \"8ec7480c-b19a-461e-ad0e-4bfc4370edd1\") "
Sep 17 23:10:43.812089 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:43.812060    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-bundle" (OuterVolumeSpecName: "bundle") pod "8ec7480c-b19a-461e-ad0e-4bfc4370edd1" (UID: "8ec7480c-b19a-461e-ad0e-4bfc4370edd1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:10:43.813842 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:43.813819    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-kube-api-access-9qgh5" (OuterVolumeSpecName: "kube-api-access-9qgh5") pod "8ec7480c-b19a-461e-ad0e-4bfc4370edd1" (UID: "8ec7480c-b19a-461e-ad0e-4bfc4370edd1"). InnerVolumeSpecName "kube-api-access-9qgh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:10:43.816984 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:43.816963    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-util" (OuterVolumeSpecName: "util") pod "8ec7480c-b19a-461e-ad0e-4bfc4370edd1" (UID: "8ec7480c-b19a-461e-ad0e-4bfc4370edd1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:10:43.912692 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:43.912657    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:10:43.912692 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:43.912685    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qgh5\" (UniqueName: \"kubernetes.io/projected/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-kube-api-access-9qgh5\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:10:43.912692 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:43.912698    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec7480c-b19a-461e-ad0e-4bfc4370edd1-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:10:44.563877 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:44.563840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg" event={"ID":"8ec7480c-b19a-461e-ad0e-4bfc4370edd1","Type":"ContainerDied","Data":"31cdf7a27fff75e5fa8d7dfbbfcb21e0430f92997d6c5ab00a15f89417289f77"}
Sep 17 23:10:44.563877 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:44.563864    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g7jg"
Sep 17 23:10:44.564111 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:44.563891    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31cdf7a27fff75e5fa8d7dfbbfcb21e0430f92997d6c5ab00a15f89417289f77"
Sep 17 23:10:45.064693 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.064657    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"]
Sep 17 23:10:45.065069 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.064918    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec7480c-b19a-461e-ad0e-4bfc4370edd1" containerName="util"
Sep 17 23:10:45.065069 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.064928    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec7480c-b19a-461e-ad0e-4bfc4370edd1" containerName="util"
Sep 17 23:10:45.065069 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.064945    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec7480c-b19a-461e-ad0e-4bfc4370edd1" containerName="extract"
Sep 17 23:10:45.065069 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.064951    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec7480c-b19a-461e-ad0e-4bfc4370edd1" containerName="extract"
Sep 17 23:10:45.065069 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.064960    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec7480c-b19a-461e-ad0e-4bfc4370edd1" containerName="pull"
Sep 17 23:10:45.065069 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.064965    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec7480c-b19a-461e-ad0e-4bfc4370edd1" containerName="pull"
Sep 17 23:10:45.065069 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.065011    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec7480c-b19a-461e-ad0e-4bfc4370edd1" containerName="extract"
Sep 17 23:10:45.067350 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.067332    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"
Sep 17 23:10:45.069732 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.069718    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rcrnt\""
Sep 17 23:10:45.075338 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.075314    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"]
Sep 17 23:10:45.122434 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.122399    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ae629bb-c9a6-4fe0-8482-18b2f042cf7d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-brhr5\" (UID: \"5ae629bb-c9a6-4fe0-8482-18b2f042cf7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"
Sep 17 23:10:45.122434 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.122440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l8sr\" (UniqueName: \"kubernetes.io/projected/5ae629bb-c9a6-4fe0-8482-18b2f042cf7d-kube-api-access-6l8sr\") pod \"cert-manager-cainjector-559cdd8c87-brhr5\" (UID: \"5ae629bb-c9a6-4fe0-8482-18b2f042cf7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"
Sep 17 23:10:45.223758 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.223733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ae629bb-c9a6-4fe0-8482-18b2f042cf7d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-brhr5\" (UID: \"5ae629bb-c9a6-4fe0-8482-18b2f042cf7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"
Sep 17 23:10:45.223900 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.223767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l8sr\" (UniqueName: \"kubernetes.io/projected/5ae629bb-c9a6-4fe0-8482-18b2f042cf7d-kube-api-access-6l8sr\") pod \"cert-manager-cainjector-559cdd8c87-brhr5\" (UID: \"5ae629bb-c9a6-4fe0-8482-18b2f042cf7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"
Sep 17 23:10:45.231792 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.231759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ae629bb-c9a6-4fe0-8482-18b2f042cf7d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-brhr5\" (UID: \"5ae629bb-c9a6-4fe0-8482-18b2f042cf7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"
Sep 17 23:10:45.231792 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.231787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l8sr\" (UniqueName: \"kubernetes.io/projected/5ae629bb-c9a6-4fe0-8482-18b2f042cf7d-kube-api-access-6l8sr\") pod \"cert-manager-cainjector-559cdd8c87-brhr5\" (UID: \"5ae629bb-c9a6-4fe0-8482-18b2f042cf7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"
Sep 17 23:10:45.376544 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.376430    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"
Sep 17 23:10:45.645190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:45.645168    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-brhr5"]
Sep 17 23:10:45.647234 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:10:45.647203    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ae629bb_c9a6_4fe0_8482_18b2f042cf7d.slice/crio-beb5b58c25e17de8d8ec26d6c2a7e3c7b68726e69cddfcfa88be0faa8bac8e8e WatchSource:0}: Error finding container beb5b58c25e17de8d8ec26d6c2a7e3c7b68726e69cddfcfa88be0faa8bac8e8e: Status 404 returned error can't find the container with id beb5b58c25e17de8d8ec26d6c2a7e3c7b68726e69cddfcfa88be0faa8bac8e8e
Sep 17 23:10:46.573388 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:46.573341    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5" event={"ID":"5ae629bb-c9a6-4fe0-8482-18b2f042cf7d","Type":"ContainerStarted","Data":"c7563fbf57006beb866326827f423018af4a971266c565fd825ad3cf5199e92d"}
Sep 17 23:10:46.573388 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:46.573394    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5" event={"ID":"5ae629bb-c9a6-4fe0-8482-18b2f042cf7d","Type":"ContainerStarted","Data":"beb5b58c25e17de8d8ec26d6c2a7e3c7b68726e69cddfcfa88be0faa8bac8e8e"}
Sep 17 23:10:46.590383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:46.590322    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-brhr5" podStartSLOduration=1.5903037740000001 podStartE2EDuration="1.590303774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:10:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:10:46.58999259 +0000 UTC m=+258.197570251" watchObservedRunningTime="2026-09-17 23:10:46.590303774 +0000 UTC m=+258.197881435"
Sep 17 23:10:47.556847 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:47.556815    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pwpph"
Sep 17 23:10:57.771995 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:57.771956    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"]
Sep 17 23:10:57.775308 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:57.775290    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:57.778150 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:57.778124    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 23:10:57.778300 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:57.778181    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 23:10:57.778300 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:57.778278    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hrdr\""
Sep 17 23:10:57.785058 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:57.785030    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"]
Sep 17 23:10:57.936817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:57.936784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfvwz\" (UniqueName: \"kubernetes.io/projected/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-kube-api-access-gfvwz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:57.936817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:57.936833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:57.937033 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:57.936862    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:58.038156 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.038069    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfvwz\" (UniqueName: \"kubernetes.io/projected/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-kube-api-access-gfvwz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:58.038156 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.038114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:58.038156 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.038137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:58.038496 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.038456    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:58.038562 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.038511    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:58.046886 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.046864    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfvwz\" (UniqueName: \"kubernetes.io/projected/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-kube-api-access-gfvwz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:58.085404 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.085372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:10:58.355725 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.355665    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"]
Sep 17 23:10:58.357944 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:10:58.357915    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd843b2b4_3211_4ffb_8ecf_a5c58a7e1002.slice/crio-d6525421cdc8d292ca3e857f4b82e14fc9f4bb0d3ba6b68add6def301f48a2e6 WatchSource:0}: Error finding container d6525421cdc8d292ca3e857f4b82e14fc9f4bb0d3ba6b68add6def301f48a2e6: Status 404 returned error can't find the container with id d6525421cdc8d292ca3e857f4b82e14fc9f4bb0d3ba6b68add6def301f48a2e6
Sep 17 23:10:58.623641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.623553    2583 generic.go:356] "Generic (PLEG): container finished" podID="d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" containerID="b7f33755bb9ee4e96e1442260d29a942ce14368d09927ea437628005e28a9923" exitCode=0
Sep 17 23:10:58.623805 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.623638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54" event={"ID":"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002","Type":"ContainerDied","Data":"b7f33755bb9ee4e96e1442260d29a942ce14368d09927ea437628005e28a9923"}
Sep 17 23:10:58.623805 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:58.623687    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54" event={"ID":"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002","Type":"ContainerStarted","Data":"d6525421cdc8d292ca3e857f4b82e14fc9f4bb0d3ba6b68add6def301f48a2e6"}
Sep 17 23:10:59.629352 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:59.629268    2583 generic.go:356] "Generic (PLEG): container finished" podID="d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" containerID="e03c631366617d3892e075d16174a3f0f265671ba508a386a1f9c2db827f8bf3" exitCode=0
Sep 17 23:10:59.629753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:10:59.629363    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54" event={"ID":"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002","Type":"ContainerDied","Data":"e03c631366617d3892e075d16174a3f0f265671ba508a386a1f9c2db827f8bf3"}
Sep 17 23:11:00.635962 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:00.635926    2583 generic.go:356] "Generic (PLEG): container finished" podID="d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" containerID="bd6e9b02f93087c1f9a9a158a49474bd802f1d3ac2372b26d94d3f66de5d1785" exitCode=0
Sep 17 23:11:00.636396 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:00.635972    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54" event={"ID":"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002","Type":"ContainerDied","Data":"bd6e9b02f93087c1f9a9a158a49474bd802f1d3ac2372b26d94d3f66de5d1785"}
Sep 17 23:11:01.784673 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:01.784639    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:11:01.969418 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:01.969331    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-util\") pod \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") "
Sep 17 23:11:01.969418 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:01.969393    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfvwz\" (UniqueName: \"kubernetes.io/projected/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-kube-api-access-gfvwz\") pod \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") "
Sep 17 23:11:01.969666 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:01.969484    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-bundle\") pod \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\" (UID: \"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002\") "
Sep 17 23:11:01.970209 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:01.970183    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-bundle" (OuterVolumeSpecName: "bundle") pod "d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" (UID: "d843b2b4-3211-4ffb-8ecf-a5c58a7e1002"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:11:01.971553 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:01.971522    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-kube-api-access-gfvwz" (OuterVolumeSpecName: "kube-api-access-gfvwz") pod "d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" (UID: "d843b2b4-3211-4ffb-8ecf-a5c58a7e1002"). InnerVolumeSpecName "kube-api-access-gfvwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:11:01.975195 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:01.975149    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-util" (OuterVolumeSpecName: "util") pod "d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" (UID: "d843b2b4-3211-4ffb-8ecf-a5c58a7e1002"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:11:02.070292 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:02.070257    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:11:02.070292 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:02.070285    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:11:02.070292 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:02.070294    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfvwz\" (UniqueName: \"kubernetes.io/projected/d843b2b4-3211-4ffb-8ecf-a5c58a7e1002-kube-api-access-gfvwz\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:11:02.646124 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:02.646094    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54" event={"ID":"d843b2b4-3211-4ffb-8ecf-a5c58a7e1002","Type":"ContainerDied","Data":"d6525421cdc8d292ca3e857f4b82e14fc9f4bb0d3ba6b68add6def301f48a2e6"}
Sep 17 23:11:02.646124 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:02.646121    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwhd54"
Sep 17 23:11:02.646356 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:02.646136    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6525421cdc8d292ca3e857f4b82e14fc9f4bb0d3ba6b68add6def301f48a2e6"
Sep 17 23:11:05.164011 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.163972    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"]
Sep 17 23:11:05.164382 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.164234    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" containerName="extract"
Sep 17 23:11:05.164382 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.164244    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" containerName="extract"
Sep 17 23:11:05.164382 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.164258    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" containerName="pull"
Sep 17 23:11:05.164382 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.164263    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" containerName="pull"
Sep 17 23:11:05.164382 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.164275    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" containerName="util"
Sep 17 23:11:05.164382 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.164280    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" containerName="util"
Sep 17 23:11:05.164382 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.164327    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d843b2b4-3211-4ffb-8ecf-a5c58a7e1002" containerName="extract"
Sep 17 23:11:05.166153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.166138    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.168821 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.168793    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xfzjq\""
Sep 17 23:11:05.170033 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.170014    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 17 23:11:05.170142 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.170092    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 23:11:05.170204 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.170096    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:11:05.170304 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.170291    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 17 23:11:05.170442 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.170424    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 17 23:11:05.176685 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.176665    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"]
Sep 17 23:11:05.297269 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.297235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-manager-config\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.297269 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.297275    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drnd4\" (UniqueName: \"kubernetes.io/projected/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-kube-api-access-drnd4\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.297488 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.297295    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-metrics-cert\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.297488 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.297355    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-cert\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.398762 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.398711    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-manager-config\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.398959 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.398773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drnd4\" (UniqueName: \"kubernetes.io/projected/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-kube-api-access-drnd4\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.398959 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.398803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-metrics-cert\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.398959 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.398828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-cert\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.399523 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.399503    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-manager-config\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.401377 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.401355    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-cert\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.401451 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.401397    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-metrics-cert\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.421580 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.421515    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drnd4\" (UniqueName: \"kubernetes.io/projected/21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07-kube-api-access-drnd4\") pod \"lws-controller-manager-858688bfcc-fznkh\" (UID: \"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07\") " pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.475399 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.475365    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:05.752404 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:05.752325    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"]
Sep 17 23:11:05.755502 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:11:05.755456    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c8cb0d_e28f_4cc4_9d4c_4b4b66fe9b07.slice/crio-a71f2aafd2fbab72ecbc1f990c66c6a72ca01af7afdad1c0d7d6186a44517aaa WatchSource:0}: Error finding container a71f2aafd2fbab72ecbc1f990c66c6a72ca01af7afdad1c0d7d6186a44517aaa: Status 404 returned error can't find the container with id a71f2aafd2fbab72ecbc1f990c66c6a72ca01af7afdad1c0d7d6186a44517aaa
Sep 17 23:11:06.666535 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:06.666495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh" event={"ID":"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07","Type":"ContainerStarted","Data":"a71f2aafd2fbab72ecbc1f990c66c6a72ca01af7afdad1c0d7d6186a44517aaa"}
Sep 17 23:11:07.647557 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.647453    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"]
Sep 17 23:11:07.651744 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.651725    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:07.654443 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.654422    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 23:11:07.655512 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.655489    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 23:11:07.655618 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.655562    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hrdr\""
Sep 17 23:11:07.661355 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.661330    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"]
Sep 17 23:11:07.674483 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.674437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh" event={"ID":"21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07","Type":"ContainerStarted","Data":"0459cd10c949fe1b0a96e7dc4590364c0451f9cc996327ecdd396b88a3906522"}
Sep 17 23:11:07.674927 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.674517    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:07.701732 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.700605    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh" podStartSLOduration=1.162207303 podStartE2EDuration="2.7005878s" totalImagesPullingTime="1.538380497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:07.699732207 +0000 UTC m=+279.307309884" watchObservedRunningTime="2026-09-17 23:11:07.7005878 +0000 UTC m=+279.308165461"
Sep 17 23:11:07.722811 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.722774    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zl77\" (UniqueName: \"kubernetes.io/projected/8f0a5e21-1563-41de-827c-c16a3444b86c-kube-api-access-4zl77\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:07.722980 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.722825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:07.722980 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.722866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:07.823886 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.823857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zl77\" (UniqueName: \"kubernetes.io/projected/8f0a5e21-1563-41de-827c-c16a3444b86c-kube-api-access-4zl77\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:07.824082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.823893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:07.824082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.823913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:07.824337 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.824312    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:07.824380 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.824325    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:07.832129 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.832098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zl77\" (UniqueName: \"kubernetes.io/projected/8f0a5e21-1563-41de-827c-c16a3444b86c-kube-api-access-4zl77\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:07.961592 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:07.961495    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:08.244498 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:08.244441    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"]
Sep 17 23:11:08.246720 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:11:08.246687    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0a5e21_1563_41de_827c_c16a3444b86c.slice/crio-63db6f61a56cb348b87eb3aa279292712a9f895c2451a25b3787fcaf79cb45dc WatchSource:0}: Error finding container 63db6f61a56cb348b87eb3aa279292712a9f895c2451a25b3787fcaf79cb45dc: Status 404 returned error can't find the container with id 63db6f61a56cb348b87eb3aa279292712a9f895c2451a25b3787fcaf79cb45dc
Sep 17 23:11:08.680402 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:08.680365    2583 generic.go:356] "Generic (PLEG): container finished" podID="8f0a5e21-1563-41de-827c-c16a3444b86c" containerID="8326ba2425e6c8fcde0eef5ac587091ba632e24d64a6e70802b8a87946047dae" exitCode=0
Sep 17 23:11:08.680912 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:08.680454    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4" event={"ID":"8f0a5e21-1563-41de-827c-c16a3444b86c","Type":"ContainerDied","Data":"8326ba2425e6c8fcde0eef5ac587091ba632e24d64a6e70802b8a87946047dae"}
Sep 17 23:11:08.680912 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:08.680538    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4" event={"ID":"8f0a5e21-1563-41de-827c-c16a3444b86c","Type":"ContainerStarted","Data":"63db6f61a56cb348b87eb3aa279292712a9f895c2451a25b3787fcaf79cb45dc"}
Sep 17 23:11:09.296398 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.296366    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"]
Sep 17 23:11:09.299667 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.299650    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.301970 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.301946    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 23:11:09.302068 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.302007    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-czjhc\""
Sep 17 23:11:09.302277 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.302257    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 23:11:09.302362 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.302280    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 23:11:09.302362 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.302307    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 23:11:09.317435 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.317407    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"]
Sep 17 23:11:09.335023 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.334989    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-tmp\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.335023 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.335023    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-manifests\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.335204 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.335046    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m89bb\" (UniqueName: \"kubernetes.io/projected/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-kube-api-access-m89bb\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.335204 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.335093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-apiservice-cert\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.335204 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.335112    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-webhook-cert\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.436266 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.436165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-apiservice-cert\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.436266 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.436217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-webhook-cert\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.436266 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.436275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-tmp\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.436554 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.436296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-manifests\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.436554 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.436316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m89bb\" (UniqueName: \"kubernetes.io/projected/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-kube-api-access-m89bb\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.436801 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.436771    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-manifests\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.438669 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.438651    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-tmp\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.438878 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.438858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-webhook-cert\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.438936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.438858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-apiservice-cert\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.444488 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.444442    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m89bb\" (UniqueName: \"kubernetes.io/projected/4d2a578b-75a8-4d85-9f3d-ab426aa0f042-kube-api-access-m89bb\") pod \"opendatahub-operator-controller-manager-697bb5576d-qg2sc\" (UID: \"4d2a578b-75a8-4d85-9f3d-ab426aa0f042\") " pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.610132 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.610091    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:09.686664 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.686590    2583 generic.go:356] "Generic (PLEG): container finished" podID="8f0a5e21-1563-41de-827c-c16a3444b86c" containerID="f3193937ff81dc09c8bbb1abd4e1f5cccb6ba6c42239c8e24c51d8555d16d5d2" exitCode=0
Sep 17 23:11:09.686664 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.686630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4" event={"ID":"8f0a5e21-1563-41de-827c-c16a3444b86c","Type":"ContainerDied","Data":"f3193937ff81dc09c8bbb1abd4e1f5cccb6ba6c42239c8e24c51d8555d16d5d2"}
Sep 17 23:11:09.887180 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:09.887131    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"]
Sep 17 23:11:09.898259 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:11:09.898225    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2a578b_75a8_4d85_9f3d_ab426aa0f042.slice/crio-cf7a27e8663a5265e55c0e3627d3e2ccac2778e20fac5a0c2423799319a6b255 WatchSource:0}: Error finding container cf7a27e8663a5265e55c0e3627d3e2ccac2778e20fac5a0c2423799319a6b255: Status 404 returned error can't find the container with id cf7a27e8663a5265e55c0e3627d3e2ccac2778e20fac5a0c2423799319a6b255
Sep 17 23:11:10.693711 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:10.693640    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc" event={"ID":"4d2a578b-75a8-4d85-9f3d-ab426aa0f042","Type":"ContainerStarted","Data":"cf7a27e8663a5265e55c0e3627d3e2ccac2778e20fac5a0c2423799319a6b255"}
Sep 17 23:11:10.696406 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:10.696313    2583 generic.go:356] "Generic (PLEG): container finished" podID="8f0a5e21-1563-41de-827c-c16a3444b86c" containerID="b8f4c72aa93a38ab52fb02145579149ee32c3d6dbef1e346ff7c15d5dd8c2ead" exitCode=0
Sep 17 23:11:10.696406 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:10.696367    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4" event={"ID":"8f0a5e21-1563-41de-827c-c16a3444b86c","Type":"ContainerDied","Data":"b8f4c72aa93a38ab52fb02145579149ee32c3d6dbef1e346ff7c15d5dd8c2ead"}
Sep 17 23:11:12.620634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.620607    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:12.658240 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.658221    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zl77\" (UniqueName: \"kubernetes.io/projected/8f0a5e21-1563-41de-827c-c16a3444b86c-kube-api-access-4zl77\") pod \"8f0a5e21-1563-41de-827c-c16a3444b86c\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") "
Sep 17 23:11:12.658340 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.658249    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-bundle\") pod \"8f0a5e21-1563-41de-827c-c16a3444b86c\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") "
Sep 17 23:11:12.658340 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.658296    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-util\") pod \"8f0a5e21-1563-41de-827c-c16a3444b86c\" (UID: \"8f0a5e21-1563-41de-827c-c16a3444b86c\") "
Sep 17 23:11:12.659102 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.659077    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-bundle" (OuterVolumeSpecName: "bundle") pod "8f0a5e21-1563-41de-827c-c16a3444b86c" (UID: "8f0a5e21-1563-41de-827c-c16a3444b86c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:11:12.660532 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.660507    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f0a5e21-1563-41de-827c-c16a3444b86c-kube-api-access-4zl77" (OuterVolumeSpecName: "kube-api-access-4zl77") pod "8f0a5e21-1563-41de-827c-c16a3444b86c" (UID: "8f0a5e21-1563-41de-827c-c16a3444b86c"). InnerVolumeSpecName "kube-api-access-4zl77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:11:12.663402 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.663376    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-util" (OuterVolumeSpecName: "util") pod "8f0a5e21-1563-41de-827c-c16a3444b86c" (UID: "8f0a5e21-1563-41de-827c-c16a3444b86c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:11:12.708059 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.708036    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4"
Sep 17 23:11:12.708059 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.708042    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0h28c4" event={"ID":"8f0a5e21-1563-41de-827c-c16a3444b86c","Type":"ContainerDied","Data":"63db6f61a56cb348b87eb3aa279292712a9f895c2451a25b3787fcaf79cb45dc"}
Sep 17 23:11:12.708201 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.708084    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63db6f61a56cb348b87eb3aa279292712a9f895c2451a25b3787fcaf79cb45dc"
Sep 17 23:11:12.758908 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.758871    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zl77\" (UniqueName: \"kubernetes.io/projected/8f0a5e21-1563-41de-827c-c16a3444b86c-kube-api-access-4zl77\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:11:12.758908 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.758906    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:11:12.758908 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:12.758917    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f0a5e21-1563-41de-827c-c16a3444b86c-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:11:13.717173 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:13.717137    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc" event={"ID":"4d2a578b-75a8-4d85-9f3d-ab426aa0f042","Type":"ContainerStarted","Data":"7721658f8cfefbcdcd92096aef8ae1ab4ec0c77dae472c0a6c6effa9fcc5f2f3"}
Sep 17 23:11:14.724407 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:14.724371    2583 generic.go:356] "Generic (PLEG): container finished" podID="4d2a578b-75a8-4d85-9f3d-ab426aa0f042" containerID="7721658f8cfefbcdcd92096aef8ae1ab4ec0c77dae472c0a6c6effa9fcc5f2f3" exitCode=0
Sep 17 23:11:14.724807 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:14.724425    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc" event={"ID":"4d2a578b-75a8-4d85-9f3d-ab426aa0f042","Type":"ContainerDied","Data":"7721658f8cfefbcdcd92096aef8ae1ab4ec0c77dae472c0a6c6effa9fcc5f2f3"}
Sep 17 23:11:15.731551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:15.731510    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc" event={"ID":"4d2a578b-75a8-4d85-9f3d-ab426aa0f042","Type":"ContainerStarted","Data":"89f00b0731814d01f8dd4f016177441c5c64ab4b982dba5b45c2118c4a82d942"}
Sep 17 23:11:15.732004 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:15.731602    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:15.767317 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:15.767262    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc" podStartSLOduration=2.519453861 podStartE2EDuration="6.767242115s" totalImagesPullingTime="3.114868418s" totalInitContainerRuntime="1.132919836s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:11:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:15.764355483 +0000 UTC m=+287.371933159" watchObservedRunningTime="2026-09-17 23:11:15.767242115 +0000 UTC m=+287.374819775"
Sep 17 23:11:18.683197 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:18.683166    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh"
Sep 17 23:11:26.737776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:26.737741    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc"
Sep 17 23:11:30.424350 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:30.424318    2583 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 23:11:35.490125 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.490096    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"]
Sep 17 23:11:35.492658 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.490521    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0a5e21-1563-41de-827c-c16a3444b86c" containerName="pull"
Sep 17 23:11:35.492658 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.490540    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0a5e21-1563-41de-827c-c16a3444b86c" containerName="pull"
Sep 17 23:11:35.492658 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.490566    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0a5e21-1563-41de-827c-c16a3444b86c" containerName="extract"
Sep 17 23:11:35.492658 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.490574    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0a5e21-1563-41de-827c-c16a3444b86c" containerName="extract"
Sep 17 23:11:35.492658 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.490593    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0a5e21-1563-41de-827c-c16a3444b86c" containerName="util"
Sep 17 23:11:35.492658 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.490603    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0a5e21-1563-41de-827c-c16a3444b86c" containerName="util"
Sep 17 23:11:35.492658 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.490677    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f0a5e21-1563-41de-827c-c16a3444b86c" containerName="extract"
Sep 17 23:11:35.493573 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.493559    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.496590 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:11:35.496544    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 17 23:11:35.496707 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:11:35.496654    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="16f1c993-a5a4-47d3-9a7c-565cf167728b" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.497187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.497168    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 23:11:35.497300 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.497250    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mgq9d\""
Sep 17 23:11:35.497574 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.497559    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 23:11:35.526679 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.526643    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"]
Sep 17 23:11:35.541051 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.541019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.541051 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.541050    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.541341 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.541074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.541341 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.541089    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.541341 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.541111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16f1c993-a5a4-47d3-9a7c-565cf167728b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.541341 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.541152    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmcch\" (UniqueName: \"kubernetes.io/projected/16f1c993-a5a4-47d3-9a7c-565cf167728b-kube-api-access-qmcch\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.541341 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.541231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.541341 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.541268    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.541341 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.541322    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642152    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642706 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642423    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16f1c993-a5a4-47d3-9a7c-565cf167728b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642706 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmcch\" (UniqueName: \"kubernetes.io/projected/16f1c993-a5a4-47d3-9a7c-565cf167728b-kube-api-access-qmcch\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642706 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642855 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642855 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642774    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.642964 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.642891    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.643275 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.643252    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16f1c993-a5a4-47d3-9a7c-565cf167728b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.644481 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.644448    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.644764 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.644744    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:35.653082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:35.653063    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16f1c993-a5a4-47d3-9a7c-565cf167728b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:36.656550 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:11:36.656496    2583 projected.go:291] Couldn't get configMap openshift-ingress/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 17 23:11:36.656550 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:11:36.656556    2583 projected.go:196] Error preparing data for projected volume kube-api-access-qmcch for pod openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k: failed to sync configmap cache: timed out waiting for the condition
Sep 17 23:11:36.656978 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:11:36.656616    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16f1c993-a5a4-47d3-9a7c-565cf167728b-kube-api-access-qmcch podName:16f1c993-a5a4-47d3-9a7c-565cf167728b nodeName:}" failed. No retries permitted until 2026-09-17 23:11:37.156598327 +0000 UTC m=+308.764175972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qmcch" (UniqueName: "kubernetes.io/projected/16f1c993-a5a4-47d3-9a7c-565cf167728b-kube-api-access-qmcch") pod "data-science-gateway-data-science-gateway-class-68cf4d799cfh66k" (UID: "16f1c993-a5a4-47d3-9a7c-565cf167728b") : failed to sync configmap cache: timed out waiting for the condition
Sep 17 23:11:37.091651 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:37.091624    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 23:11:37.255689 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:37.255652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmcch\" (UniqueName: \"kubernetes.io/projected/16f1c993-a5a4-47d3-9a7c-565cf167728b-kube-api-access-qmcch\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:37.258163 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:37.258134    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmcch\" (UniqueName: \"kubernetes.io/projected/16f1c993-a5a4-47d3-9a7c-565cf167728b-kube-api-access-qmcch\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cfh66k\" (UID: \"16f1c993-a5a4-47d3-9a7c-565cf167728b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:37.303050 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:37.303015    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:37.577273 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:37.577246    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"]
Sep 17 23:11:37.579104 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:11:37.579075    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f1c993_a5a4_47d3_9a7c_565cf167728b.slice/crio-b45e5f25c928a503c19e05f8422d26879809d3754e3416c8a508e46b787268be WatchSource:0}: Error finding container b45e5f25c928a503c19e05f8422d26879809d3754e3416c8a508e46b787268be: Status 404 returned error can't find the container with id b45e5f25c928a503c19e05f8422d26879809d3754e3416c8a508e46b787268be
Sep 17 23:11:37.581297 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:37.581281    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:11:37.834181 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:37.834147    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k" event={"ID":"16f1c993-a5a4-47d3-9a7c-565cf167728b","Type":"ContainerStarted","Data":"b45e5f25c928a503c19e05f8422d26879809d3754e3416c8a508e46b787268be"}
Sep 17 23:11:39.100991 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.100959    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ck4x6"]
Sep 17 23:11:39.103949 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.103933    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:39.107240 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.107170    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 17 23:11:39.107817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.107796    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mvd79\""
Sep 17 23:11:39.116503 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.116452    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ck4x6"]
Sep 17 23:11:39.174748 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.174709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwlnw\" (UniqueName: \"kubernetes.io/projected/7373726b-f018-450f-a0b7-71872699add1-kube-api-access-lwlnw\") pod \"odh-model-controller-7998c67dc4-ck4x6\" (UID: \"7373726b-f018-450f-a0b7-71872699add1\") " pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:39.174928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.174764    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7373726b-f018-450f-a0b7-71872699add1-cert\") pod \"odh-model-controller-7998c67dc4-ck4x6\" (UID: \"7373726b-f018-450f-a0b7-71872699add1\") " pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:39.275800 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.275758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwlnw\" (UniqueName: \"kubernetes.io/projected/7373726b-f018-450f-a0b7-71872699add1-kube-api-access-lwlnw\") pod \"odh-model-controller-7998c67dc4-ck4x6\" (UID: \"7373726b-f018-450f-a0b7-71872699add1\") " pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:39.276002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.275813    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7373726b-f018-450f-a0b7-71872699add1-cert\") pod \"odh-model-controller-7998c67dc4-ck4x6\" (UID: \"7373726b-f018-450f-a0b7-71872699add1\") " pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:39.276002 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:11:39.275932    2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 17 23:11:39.276002 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:11:39.275995    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7373726b-f018-450f-a0b7-71872699add1-cert podName:7373726b-f018-450f-a0b7-71872699add1 nodeName:}" failed. No retries permitted until 2026-09-17 23:11:39.775979652 +0000 UTC m=+311.383557292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7373726b-f018-450f-a0b7-71872699add1-cert") pod "odh-model-controller-7998c67dc4-ck4x6" (UID: "7373726b-f018-450f-a0b7-71872699add1") : secret "odh-model-controller-webhook-cert" not found
Sep 17 23:11:39.299576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.299547    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwlnw\" (UniqueName: \"kubernetes.io/projected/7373726b-f018-450f-a0b7-71872699add1-kube-api-access-lwlnw\") pod \"odh-model-controller-7998c67dc4-ck4x6\" (UID: \"7373726b-f018-450f-a0b7-71872699add1\") " pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:39.720869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.720836    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-b8k4c"]
Sep 17 23:11:39.727510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.727483    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:11:39.730970 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.730945    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 17 23:11:39.741049 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.741016    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-b8k4c"]
Sep 17 23:11:39.782422 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.782386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f521c7c-052d-4fcc-9c4f-1df22dec4c1f-tls-certs\") pod \"model-serving-api-54d89bd5fc-b8k4c\" (UID: \"0f521c7c-052d-4fcc-9c4f-1df22dec4c1f\") " pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:11:39.782605 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.782440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjlkf\" (UniqueName: \"kubernetes.io/projected/0f521c7c-052d-4fcc-9c4f-1df22dec4c1f-kube-api-access-mjlkf\") pod \"model-serving-api-54d89bd5fc-b8k4c\" (UID: \"0f521c7c-052d-4fcc-9c4f-1df22dec4c1f\") " pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:11:39.782605 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.782515    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7373726b-f018-450f-a0b7-71872699add1-cert\") pod \"odh-model-controller-7998c67dc4-ck4x6\" (UID: \"7373726b-f018-450f-a0b7-71872699add1\") " pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:39.785251 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.785228    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7373726b-f018-450f-a0b7-71872699add1-cert\") pod \"odh-model-controller-7998c67dc4-ck4x6\" (UID: \"7373726b-f018-450f-a0b7-71872699add1\") " pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:39.883986 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.883936    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f521c7c-052d-4fcc-9c4f-1df22dec4c1f-tls-certs\") pod \"model-serving-api-54d89bd5fc-b8k4c\" (UID: \"0f521c7c-052d-4fcc-9c4f-1df22dec4c1f\") " pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:11:39.884167 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.884003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjlkf\" (UniqueName: \"kubernetes.io/projected/0f521c7c-052d-4fcc-9c4f-1df22dec4c1f-kube-api-access-mjlkf\") pod \"model-serving-api-54d89bd5fc-b8k4c\" (UID: \"0f521c7c-052d-4fcc-9c4f-1df22dec4c1f\") " pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:11:39.884167 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:11:39.884116    2583 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 17 23:11:39.884279 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:11:39.884194    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f521c7c-052d-4fcc-9c4f-1df22dec4c1f-tls-certs podName:0f521c7c-052d-4fcc-9c4f-1df22dec4c1f nodeName:}" failed. No retries permitted until 2026-09-17 23:11:40.384173548 +0000 UTC m=+311.991751200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0f521c7c-052d-4fcc-9c4f-1df22dec4c1f-tls-certs") pod "model-serving-api-54d89bd5fc-b8k4c" (UID: "0f521c7c-052d-4fcc-9c4f-1df22dec4c1f") : secret "model-serving-api-tls" not found
Sep 17 23:11:39.895391 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:39.895357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjlkf\" (UniqueName: \"kubernetes.io/projected/0f521c7c-052d-4fcc-9c4f-1df22dec4c1f-kube-api-access-mjlkf\") pod \"model-serving-api-54d89bd5fc-b8k4c\" (UID: \"0f521c7c-052d-4fcc-9c4f-1df22dec4c1f\") " pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:11:40.016068 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.016038    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:40.161810 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.161775    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:11:40.162090 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.161859    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:11:40.162090 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.161890    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:11:40.365860 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.365820    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ck4x6"]
Sep 17 23:11:40.367305 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:11:40.367273    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7373726b_f018_450f_a0b7_71872699add1.slice/crio-efa21652320777d13d3bd5004822c5d7671f9ab3d49661c996e8b180e7211471 WatchSource:0}: Error finding container efa21652320777d13d3bd5004822c5d7671f9ab3d49661c996e8b180e7211471: Status 404 returned error can't find the container with id efa21652320777d13d3bd5004822c5d7671f9ab3d49661c996e8b180e7211471
Sep 17 23:11:40.388638 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.388612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f521c7c-052d-4fcc-9c4f-1df22dec4c1f-tls-certs\") pod \"model-serving-api-54d89bd5fc-b8k4c\" (UID: \"0f521c7c-052d-4fcc-9c4f-1df22dec4c1f\") " pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:11:40.390896 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.390876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f521c7c-052d-4fcc-9c4f-1df22dec4c1f-tls-certs\") pod \"model-serving-api-54d89bd5fc-b8k4c\" (UID: \"0f521c7c-052d-4fcc-9c4f-1df22dec4c1f\") " pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:11:40.639722 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.639633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:11:40.852230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.852138    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6" event={"ID":"7373726b-f018-450f-a0b7-71872699add1","Type":"ContainerStarted","Data":"efa21652320777d13d3bd5004822c5d7671f9ab3d49661c996e8b180e7211471"}
Sep 17 23:11:40.854345 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.854313    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k" event={"ID":"16f1c993-a5a4-47d3-9a7c-565cf167728b","Type":"ContainerStarted","Data":"f88843eadd905f8e48bcff00bf6714b461374c1d55752ff0d0ba955da0cbc5b4"}
Sep 17 23:11:40.876378 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.875881    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k" podStartSLOduration=3.295825214 podStartE2EDuration="5.875863974s" totalImagesPullingTime="2.58003876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:40.875703246 +0000 UTC m=+312.483280923" watchObservedRunningTime="2026-09-17 23:11:40.875863974 +0000 UTC m=+312.483441636"
Sep 17 23:11:40.916082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:40.915552    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-b8k4c"]
Sep 17 23:11:40.918368 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:11:40.918335    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f521c7c_052d_4fcc_9c4f_1df22dec4c1f.slice/crio-86d239cebc36e9e7776a6ce3c52d44f3261ae4de67183954f040c0dfeedbb42a WatchSource:0}: Error finding container 86d239cebc36e9e7776a6ce3c52d44f3261ae4de67183954f040c0dfeedbb42a: Status 404 returned error can't find the container with id 86d239cebc36e9e7776a6ce3c52d44f3261ae4de67183954f040c0dfeedbb42a
Sep 17 23:11:41.303415 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:41.303373    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:41.310070 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:41.310014    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:41.864745 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:41.864664    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c" event={"ID":"0f521c7c-052d-4fcc-9c4f-1df22dec4c1f","Type":"ContainerStarted","Data":"86d239cebc36e9e7776a6ce3c52d44f3261ae4de67183954f040c0dfeedbb42a"}
Sep 17 23:11:41.864942 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:41.864912    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:41.866365 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:41.866342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k"
Sep 17 23:11:44.887039 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:44.886991    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c" event={"ID":"0f521c7c-052d-4fcc-9c4f-1df22dec4c1f","Type":"ContainerStarted","Data":"9d0cc67ba3053c51a265e174f372161a344b638f8276bc66390debae930c2461"}
Sep 17 23:11:44.887531 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:44.887065    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:11:44.888571 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:44.888548    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6" event={"ID":"7373726b-f018-450f-a0b7-71872699add1","Type":"ContainerStarted","Data":"a2d4b798c1f6bc8302a2db6b7510e8e82090a5711216f59e5fda4a014bf70359"}
Sep 17 23:11:44.888667 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:44.888598    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:44.916195 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:44.916140    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c" podStartSLOduration=2.745632002 podStartE2EDuration="5.916124504s" totalImagesPullingTime="3.170492502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:44.915585165 +0000 UTC m=+316.523162831" watchObservedRunningTime="2026-09-17 23:11:44.916124504 +0000 UTC m=+316.523702164"
Sep 17 23:11:44.944325 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:44.944259    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6" podStartSLOduration=2.260996819 podStartE2EDuration="5.944236183s" totalImagesPullingTime="3.683239364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:44.942932504 +0000 UTC m=+316.550510175" watchObservedRunningTime="2026-09-17 23:11:44.944236183 +0000 UTC m=+316.551813848"
Sep 17 23:11:46.079154 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.079123    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"]
Sep 17 23:11:46.087193 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.087171    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.097970 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.097946    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 23:11:46.098248 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.098232    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 23:11:46.098359 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.098294    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 23:11:46.098524 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.098506    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xfhng\""
Sep 17 23:11:46.126313 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.126282    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"]
Sep 17 23:11:46.242223 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.242178    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r52xx\" (UniqueName: \"kubernetes.io/projected/911ce07f-395f-477b-ac20-7f2f4bd9071d-kube-api-access-r52xx\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.242410 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.242231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.242410 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.242257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.242410 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.242307    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.242410 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.242356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.242410 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.242383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/911ce07f-395f-477b-ac20-7f2f4bd9071d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.242636 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.242523    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/911ce07f-395f-477b-ac20-7f2f4bd9071d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.343624 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.343550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/911ce07f-395f-477b-ac20-7f2f4bd9071d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.343624 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.343590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r52xx\" (UniqueName: \"kubernetes.io/projected/911ce07f-395f-477b-ac20-7f2f4bd9071d-kube-api-access-r52xx\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.343624 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.343612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.343964 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.343741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.343964 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.343786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.343964 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.343824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.343964 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.343844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/911ce07f-395f-477b-ac20-7f2f4bd9071d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.344647 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.344618    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.346218 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.346181    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/911ce07f-395f-477b-ac20-7f2f4bd9071d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.346331 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.346222    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.346331 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.346312    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.346509 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.346491    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/911ce07f-395f-477b-ac20-7f2f4bd9071d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.352698 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.352677    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/911ce07f-395f-477b-ac20-7f2f4bd9071d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.352843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.352826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r52xx\" (UniqueName: \"kubernetes.io/projected/911ce07f-395f-477b-ac20-7f2f4bd9071d-kube-api-access-r52xx\") pod \"istiod-openshift-gateway-5677ccb49b-lvldr\" (UID: \"911ce07f-395f-477b-ac20-7f2f4bd9071d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.396970 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.396938    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:46.717443 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.717245    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"]
Sep 17 23:11:46.720063 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:11:46.720029    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911ce07f_395f_477b_ac20_7f2f4bd9071d.slice/crio-aca23c3a5333ada857c1f55ea656bed70b5da9901c1c591883915f2a9bd09825 WatchSource:0}: Error finding container aca23c3a5333ada857c1f55ea656bed70b5da9901c1c591883915f2a9bd09825: Status 404 returned error can't find the container with id aca23c3a5333ada857c1f55ea656bed70b5da9901c1c591883915f2a9bd09825
Sep 17 23:11:46.898849 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:46.898814    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr" event={"ID":"911ce07f-395f-477b-ac20-7f2f4bd9071d","Type":"ContainerStarted","Data":"aca23c3a5333ada857c1f55ea656bed70b5da9901c1c591883915f2a9bd09825"}
Sep 17 23:11:49.031032 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:49.030999    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:11:49.031315 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:49.031067    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:11:49.916251 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:49.916218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr" event={"ID":"911ce07f-395f-477b-ac20-7f2f4bd9071d","Type":"ContainerStarted","Data":"8497d388125b41932c11b3289eaceb13e2eaf5a549dec2336c4ba6df6dbbc691"}
Sep 17 23:11:49.916428 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:49.916309    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:49.950035 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:49.949983    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr" podStartSLOduration=1.641281839 podStartE2EDuration="3.949967539s" totalImagesPullingTime="2.3086857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:49.945683698 +0000 UTC m=+321.553261377" watchObservedRunningTime="2026-09-17 23:11:49.949967539 +0000 UTC m=+321.557545198"
Sep 17 23:11:50.922806 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:50.922776    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr"
Sep 17 23:11:55.896124 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:55.896091    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ck4x6"
Sep 17 23:11:55.898009 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:11:55.897984    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-b8k4c"
Sep 17 23:12:39.653437 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:39.653398    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8649477db9-p4q7n"]
Sep 17 23:12:44.749346 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.749313    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"]
Sep 17 23:12:44.751765 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.751746    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:44.754603 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.754579    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 23:12:44.755142 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.755129    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5hrdr\""
Sep 17 23:12:44.755957 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.755936    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 23:12:44.764882 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.764859    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"]
Sep 17 23:12:44.845396 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.845358    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"]
Sep 17 23:12:44.847714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.847698    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:44.850049 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.850029    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:44.850101 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.850061    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:44.850137 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.850095    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66g6r\" (UniqueName: \"kubernetes.io/projected/7d9bce47-63a2-401f-9106-00c91f549077-kube-api-access-66g6r\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:44.859958 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.859935    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"]
Sep 17 23:12:44.947915 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.947876    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"]
Sep 17 23:12:44.950337 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.950319    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:44.950637 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.950614    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:44.950721 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.950692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:44.950782 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.950719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:44.950782 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.950750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66g6r\" (UniqueName: \"kubernetes.io/projected/7d9bce47-63a2-401f-9106-00c91f549077-kube-api-access-66g6r\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:44.950782 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.950768    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:44.950943 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.950805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdjbc\" (UniqueName: \"kubernetes.io/projected/7897ac9d-1903-4cec-8c35-a270179aebdd-kube-api-access-rdjbc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:44.951065 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.951045    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:44.951120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.951086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:44.962823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.962794    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66g6r\" (UniqueName: \"kubernetes.io/projected/7d9bce47-63a2-401f-9106-00c91f549077-kube-api-access-66g6r\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:44.971689 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:44.971653    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"]
Sep 17 23:12:45.051531 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.051501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:45.051750 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.051547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:45.051750 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.051569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqh8m\" (UniqueName: \"kubernetes.io/projected/32904e6d-7851-4fc4-b05e-6825da62229b-kube-api-access-rqh8m\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:45.051750 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.051674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:45.051917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.051778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:45.051917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.051823    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdjbc\" (UniqueName: \"kubernetes.io/projected/7897ac9d-1903-4cec-8c35-a270179aebdd-kube-api-access-rdjbc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:45.052037 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.052017    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:45.052090 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.052068    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:45.061395 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.061367    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:45.066080 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.066054    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdjbc\" (UniqueName: \"kubernetes.io/projected/7897ac9d-1903-4cec-8c35-a270179aebdd-kube-api-access-rdjbc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:45.152891 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.152859    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"]
Sep 17 23:12:45.153223 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.153201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:45.153275 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.153257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:45.153320 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.153281    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqh8m\" (UniqueName: \"kubernetes.io/projected/32904e6d-7851-4fc4-b05e-6825da62229b-kube-api-access-rqh8m\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:45.153544 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.153527    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:45.153637 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.153618    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:45.155832 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.155818    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.156061 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.156044    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:45.163880 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.163863    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqh8m\" (UniqueName: \"kubernetes.io/projected/32904e6d-7851-4fc4-b05e-6825da62229b-kube-api-access-rqh8m\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:45.167770 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.167749    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"]
Sep 17 23:12:45.254093 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.254052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.254093 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.254098    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnvdh\" (UniqueName: \"kubernetes.io/projected/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-kube-api-access-tnvdh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.254311 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.254170    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.259935 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.259910    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:45.336355 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.336325    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"]
Sep 17 23:12:45.337821 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:12:45.337795    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9bce47_63a2_401f_9106_00c91f549077.slice/crio-b06d2ccacc66b50bb9ae5b0090dd58f75957ee34223abe8a5cdc22bc28ce5e54 WatchSource:0}: Error finding container b06d2ccacc66b50bb9ae5b0090dd58f75957ee34223abe8a5cdc22bc28ce5e54: Status 404 returned error can't find the container with id b06d2ccacc66b50bb9ae5b0090dd58f75957ee34223abe8a5cdc22bc28ce5e54
Sep 17 23:12:45.355090 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.355064    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.355224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.355111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnvdh\" (UniqueName: \"kubernetes.io/projected/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-kube-api-access-tnvdh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.355224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.355164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.355522 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.355493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.355596 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.355579    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.364153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.364132    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnvdh\" (UniqueName: \"kubernetes.io/projected/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-kube-api-access-tnvdh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.431397 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.431361    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"]
Sep 17 23:12:45.432340 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:12:45.432306    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7897ac9d_1903_4cec_8c35_a270179aebdd.slice/crio-59d35db3fd370565e7051014ccb5e026915fc9e8381821e9446c430e29ded824 WatchSource:0}: Error finding container 59d35db3fd370565e7051014ccb5e026915fc9e8381821e9446c430e29ded824: Status 404 returned error can't find the container with id 59d35db3fd370565e7051014ccb5e026915fc9e8381821e9446c430e29ded824
Sep 17 23:12:45.482226 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.482203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:45.536586 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.536512    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"]
Sep 17 23:12:45.539604 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:12:45.539436    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32904e6d_7851_4fc4_b05e_6825da62229b.slice/crio-2ed570a16ca28c344758a689d55d4a8e35b307603aa5f70386422495b8f616e5 WatchSource:0}: Error finding container 2ed570a16ca28c344758a689d55d4a8e35b307603aa5f70386422495b8f616e5: Status 404 returned error can't find the container with id 2ed570a16ca28c344758a689d55d4a8e35b307603aa5f70386422495b8f616e5
Sep 17 23:12:45.759827 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:45.759797    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"]
Sep 17 23:12:45.761386 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:12:45.761356    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba82a6bf_e2d3_4242_9fdb_597f1c54b248.slice/crio-709f4ff906e02b1ed285b0e2f4dbd3fcda1c0132991777de4a510057c1b94968 WatchSource:0}: Error finding container 709f4ff906e02b1ed285b0e2f4dbd3fcda1c0132991777de4a510057c1b94968: Status 404 returned error can't find the container with id 709f4ff906e02b1ed285b0e2f4dbd3fcda1c0132991777de4a510057c1b94968
Sep 17 23:12:46.186532 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.186436    2583 generic.go:356] "Generic (PLEG): container finished" podID="7d9bce47-63a2-401f-9106-00c91f549077" containerID="08e7dfa56c61d9aa3d370429cc638efde2ddef9b032a85fef0c10a3c9ab67078" exitCode=0
Sep 17 23:12:46.186532 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.186494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9" event={"ID":"7d9bce47-63a2-401f-9106-00c91f549077","Type":"ContainerDied","Data":"08e7dfa56c61d9aa3d370429cc638efde2ddef9b032a85fef0c10a3c9ab67078"}
Sep 17 23:12:46.186717 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.186545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9" event={"ID":"7d9bce47-63a2-401f-9106-00c91f549077","Type":"ContainerStarted","Data":"b06d2ccacc66b50bb9ae5b0090dd58f75957ee34223abe8a5cdc22bc28ce5e54"}
Sep 17 23:12:46.188111 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.188082    2583 generic.go:356] "Generic (PLEG): container finished" podID="7897ac9d-1903-4cec-8c35-a270179aebdd" containerID="675bc0210f1c729ebcc6f8d77e3a77b81be85eada823a652452536afff65cea0" exitCode=0
Sep 17 23:12:46.188226 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.188172    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9" event={"ID":"7897ac9d-1903-4cec-8c35-a270179aebdd","Type":"ContainerDied","Data":"675bc0210f1c729ebcc6f8d77e3a77b81be85eada823a652452536afff65cea0"}
Sep 17 23:12:46.188226 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.188213    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9" event={"ID":"7897ac9d-1903-4cec-8c35-a270179aebdd","Type":"ContainerStarted","Data":"59d35db3fd370565e7051014ccb5e026915fc9e8381821e9446c430e29ded824"}
Sep 17 23:12:46.189948 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.189924    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba82a6bf-e2d3-4242-9fdb-597f1c54b248" containerID="753223ee5764295ef011ee4953730e24d31836d20dab13bb2b41578a2ac8030f" exitCode=0
Sep 17 23:12:46.190031 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.189994    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9" event={"ID":"ba82a6bf-e2d3-4242-9fdb-597f1c54b248","Type":"ContainerDied","Data":"753223ee5764295ef011ee4953730e24d31836d20dab13bb2b41578a2ac8030f"}
Sep 17 23:12:46.190081 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.190037    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9" event={"ID":"ba82a6bf-e2d3-4242-9fdb-597f1c54b248","Type":"ContainerStarted","Data":"709f4ff906e02b1ed285b0e2f4dbd3fcda1c0132991777de4a510057c1b94968"}
Sep 17 23:12:46.191773 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.191751    2583 generic.go:356] "Generic (PLEG): container finished" podID="32904e6d-7851-4fc4-b05e-6825da62229b" containerID="85eb3f5ec71d66db65051ba91ec7ce8c7875275ad4edc058c99276bb0589c334" exitCode=0
Sep 17 23:12:46.191856 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.191777    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n" event={"ID":"32904e6d-7851-4fc4-b05e-6825da62229b","Type":"ContainerDied","Data":"85eb3f5ec71d66db65051ba91ec7ce8c7875275ad4edc058c99276bb0589c334"}
Sep 17 23:12:46.191856 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:46.191817    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n" event={"ID":"32904e6d-7851-4fc4-b05e-6825da62229b","Type":"ContainerStarted","Data":"2ed570a16ca28c344758a689d55d4a8e35b307603aa5f70386422495b8f616e5"}
Sep 17 23:12:47.198439 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:47.198355    2583 generic.go:356] "Generic (PLEG): container finished" podID="7d9bce47-63a2-401f-9106-00c91f549077" containerID="32edd6642026c4c32e41d1e4ae98481896dca1f02fea904ca205050d6c0c8f27" exitCode=0
Sep 17 23:12:47.198850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:47.198439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9" event={"ID":"7d9bce47-63a2-401f-9106-00c91f549077","Type":"ContainerDied","Data":"32edd6642026c4c32e41d1e4ae98481896dca1f02fea904ca205050d6c0c8f27"}
Sep 17 23:12:47.205951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:47.205926    2583 generic.go:356] "Generic (PLEG): container finished" podID="7897ac9d-1903-4cec-8c35-a270179aebdd" containerID="9cfa3696051d0d40989dd53c2654ebcc7ed56d596de9183173849d12adc9cc51" exitCode=0
Sep 17 23:12:47.206046 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:47.206010    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9" event={"ID":"7897ac9d-1903-4cec-8c35-a270179aebdd","Type":"ContainerDied","Data":"9cfa3696051d0d40989dd53c2654ebcc7ed56d596de9183173849d12adc9cc51"}
Sep 17 23:12:47.208023 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:47.208003    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba82a6bf-e2d3-4242-9fdb-597f1c54b248" containerID="864f5a257429d37b092c2e8311025dff2509819b25cffb6c2454423ae8332ec4" exitCode=0
Sep 17 23:12:47.208098 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:47.208065    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9" event={"ID":"ba82a6bf-e2d3-4242-9fdb-597f1c54b248","Type":"ContainerDied","Data":"864f5a257429d37b092c2e8311025dff2509819b25cffb6c2454423ae8332ec4"}
Sep 17 23:12:47.209997 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:47.209974    2583 generic.go:356] "Generic (PLEG): container finished" podID="32904e6d-7851-4fc4-b05e-6825da62229b" containerID="84c1560e7734ae864138c950f0393230d520926a61246d680b8d5710f79b4941" exitCode=0
Sep 17 23:12:47.210077 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:47.210026    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n" event={"ID":"32904e6d-7851-4fc4-b05e-6825da62229b","Type":"ContainerDied","Data":"84c1560e7734ae864138c950f0393230d520926a61246d680b8d5710f79b4941"}
Sep 17 23:12:48.217399 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:48.217367    2583 generic.go:356] "Generic (PLEG): container finished" podID="7897ac9d-1903-4cec-8c35-a270179aebdd" containerID="87a75c685a19ce2c2e14347f1fb7e4574d37c646a5cbad8753e1b4c6d8a4c72e" exitCode=0
Sep 17 23:12:48.217791 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:48.217458    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9" event={"ID":"7897ac9d-1903-4cec-8c35-a270179aebdd","Type":"ContainerDied","Data":"87a75c685a19ce2c2e14347f1fb7e4574d37c646a5cbad8753e1b4c6d8a4c72e"}
Sep 17 23:12:48.219395 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:48.219373    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba82a6bf-e2d3-4242-9fdb-597f1c54b248" containerID="d306e16247cd0566f4abaaeedc8705a169ca80616366d9750a1510c6224dee6b" exitCode=0
Sep 17 23:12:48.219533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:48.219437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9" event={"ID":"ba82a6bf-e2d3-4242-9fdb-597f1c54b248","Type":"ContainerDied","Data":"d306e16247cd0566f4abaaeedc8705a169ca80616366d9750a1510c6224dee6b"}
Sep 17 23:12:48.221521 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:48.221500    2583 generic.go:356] "Generic (PLEG): container finished" podID="32904e6d-7851-4fc4-b05e-6825da62229b" containerID="ca85a8e1e0c8ada30a6cd0f23e923cef4774f3af64d714eac3ae580c5af4e589" exitCode=0
Sep 17 23:12:48.221616 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:48.221581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n" event={"ID":"32904e6d-7851-4fc4-b05e-6825da62229b","Type":"ContainerDied","Data":"ca85a8e1e0c8ada30a6cd0f23e923cef4774f3af64d714eac3ae580c5af4e589"}
Sep 17 23:12:48.223581 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:48.223563    2583 generic.go:356] "Generic (PLEG): container finished" podID="7d9bce47-63a2-401f-9106-00c91f549077" containerID="698ca72f87dfabdb692fac80c4402f27124618784538cbe131cc4d5509a7e26c" exitCode=0
Sep 17 23:12:48.223656 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:48.223604    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9" event={"ID":"7d9bce47-63a2-401f-9106-00c91f549077","Type":"ContainerDied","Data":"698ca72f87dfabdb692fac80c4402f27124618784538cbe131cc4d5509a7e26c"}
Sep 17 23:12:49.369906 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.369884    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:49.413301 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.413273    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:49.445620 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.445601    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:49.448849 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.448822    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:49.494459 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.494387    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdjbc\" (UniqueName: \"kubernetes.io/projected/7897ac9d-1903-4cec-8c35-a270179aebdd-kube-api-access-rdjbc\") pod \"7897ac9d-1903-4cec-8c35-a270179aebdd\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") "
Sep 17 23:12:49.494459 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.494441    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-util\") pod \"7897ac9d-1903-4cec-8c35-a270179aebdd\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") "
Sep 17 23:12:49.494642 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.494613    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-bundle\") pod \"7897ac9d-1903-4cec-8c35-a270179aebdd\" (UID: \"7897ac9d-1903-4cec-8c35-a270179aebdd\") "
Sep 17 23:12:49.495312 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.495283    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-bundle" (OuterVolumeSpecName: "bundle") pod "7897ac9d-1903-4cec-8c35-a270179aebdd" (UID: "7897ac9d-1903-4cec-8c35-a270179aebdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:12:49.496525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.496500    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7897ac9d-1903-4cec-8c35-a270179aebdd-kube-api-access-rdjbc" (OuterVolumeSpecName: "kube-api-access-rdjbc") pod "7897ac9d-1903-4cec-8c35-a270179aebdd" (UID: "7897ac9d-1903-4cec-8c35-a270179aebdd"). InnerVolumeSpecName "kube-api-access-rdjbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:12:49.499915 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.499893    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-util" (OuterVolumeSpecName: "util") pod "7897ac9d-1903-4cec-8c35-a270179aebdd" (UID: "7897ac9d-1903-4cec-8c35-a270179aebdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:12:49.595899 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.595862    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-bundle\") pod \"32904e6d-7851-4fc4-b05e-6825da62229b\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") "
Sep 17 23:12:49.595899 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.595901    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-bundle\") pod \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") "
Sep 17 23:12:49.596088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.595925    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-util\") pod \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") "
Sep 17 23:12:49.596088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596024    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnvdh\" (UniqueName: \"kubernetes.io/projected/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-kube-api-access-tnvdh\") pod \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\" (UID: \"ba82a6bf-e2d3-4242-9fdb-597f1c54b248\") "
Sep 17 23:12:49.596088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596050    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-bundle\") pod \"7d9bce47-63a2-401f-9106-00c91f549077\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") "
Sep 17 23:12:49.596088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596077    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-util\") pod \"32904e6d-7851-4fc4-b05e-6825da62229b\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") "
Sep 17 23:12:49.596282 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596103    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-util\") pod \"7d9bce47-63a2-401f-9106-00c91f549077\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") "
Sep 17 23:12:49.596889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596447    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqh8m\" (UniqueName: \"kubernetes.io/projected/32904e6d-7851-4fc4-b05e-6825da62229b-kube-api-access-rqh8m\") pod \"32904e6d-7851-4fc4-b05e-6825da62229b\" (UID: \"32904e6d-7851-4fc4-b05e-6825da62229b\") "
Sep 17 23:12:49.596889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596530    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66g6r\" (UniqueName: \"kubernetes.io/projected/7d9bce47-63a2-401f-9106-00c91f549077-kube-api-access-66g6r\") pod \"7d9bce47-63a2-401f-9106-00c91f549077\" (UID: \"7d9bce47-63a2-401f-9106-00c91f549077\") "
Sep 17 23:12:49.596889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596608    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-bundle" (OuterVolumeSpecName: "bundle") pod "7d9bce47-63a2-401f-9106-00c91f549077" (UID: "7d9bce47-63a2-401f-9106-00c91f549077"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:12:49.596889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596621    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-bundle" (OuterVolumeSpecName: "bundle") pod "32904e6d-7851-4fc4-b05e-6825da62229b" (UID: "32904e6d-7851-4fc4-b05e-6825da62229b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:12:49.596889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596763    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-bundle" (OuterVolumeSpecName: "bundle") pod "ba82a6bf-e2d3-4242-9fdb-597f1c54b248" (UID: "ba82a6bf-e2d3-4242-9fdb-597f1c54b248"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:12:49.597224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596899    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.597224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596915    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.597224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596929    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.597224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596940    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.597224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596952    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdjbc\" (UniqueName: \"kubernetes.io/projected/7897ac9d-1903-4cec-8c35-a270179aebdd-kube-api-access-rdjbc\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.597224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.596965    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7897ac9d-1903-4cec-8c35-a270179aebdd-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.598701 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.598670    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32904e6d-7851-4fc4-b05e-6825da62229b-kube-api-access-rqh8m" (OuterVolumeSpecName: "kube-api-access-rqh8m") pod "32904e6d-7851-4fc4-b05e-6825da62229b" (UID: "32904e6d-7851-4fc4-b05e-6825da62229b"). InnerVolumeSpecName "kube-api-access-rqh8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:12:49.598701 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.598683    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-kube-api-access-tnvdh" (OuterVolumeSpecName: "kube-api-access-tnvdh") pod "ba82a6bf-e2d3-4242-9fdb-597f1c54b248" (UID: "ba82a6bf-e2d3-4242-9fdb-597f1c54b248"). InnerVolumeSpecName "kube-api-access-tnvdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:12:49.599061 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.599042    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d9bce47-63a2-401f-9106-00c91f549077-kube-api-access-66g6r" (OuterVolumeSpecName: "kube-api-access-66g6r") pod "7d9bce47-63a2-401f-9106-00c91f549077" (UID: "7d9bce47-63a2-401f-9106-00c91f549077"). InnerVolumeSpecName "kube-api-access-66g6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:12:49.602889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.602864    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-util" (OuterVolumeSpecName: "util") pod "ba82a6bf-e2d3-4242-9fdb-597f1c54b248" (UID: "ba82a6bf-e2d3-4242-9fdb-597f1c54b248"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:12:49.602889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.602874    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-util" (OuterVolumeSpecName: "util") pod "7d9bce47-63a2-401f-9106-00c91f549077" (UID: "7d9bce47-63a2-401f-9106-00c91f549077"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:12:49.602889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.602878    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-util" (OuterVolumeSpecName: "util") pod "32904e6d-7851-4fc4-b05e-6825da62229b" (UID: "32904e6d-7851-4fc4-b05e-6825da62229b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:12:49.697534 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.697496    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnvdh\" (UniqueName: \"kubernetes.io/projected/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-kube-api-access-tnvdh\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.697534 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.697525    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32904e6d-7851-4fc4-b05e-6825da62229b-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.697534 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.697534    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d9bce47-63a2-401f-9106-00c91f549077-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.697534 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.697542    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqh8m\" (UniqueName: \"kubernetes.io/projected/32904e6d-7851-4fc4-b05e-6825da62229b-kube-api-access-rqh8m\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.697790 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.697551    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66g6r\" (UniqueName: \"kubernetes.io/projected/7d9bce47-63a2-401f-9106-00c91f549077-kube-api-access-66g6r\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:49.697790 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:49.697560    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba82a6bf-e2d3-4242-9fdb-597f1c54b248-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:12:50.235344 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.235319    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9"
Sep 17 23:12:50.235541 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.235314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cvqv9" event={"ID":"7d9bce47-63a2-401f-9106-00c91f549077","Type":"ContainerDied","Data":"b06d2ccacc66b50bb9ae5b0090dd58f75957ee34223abe8a5cdc22bc28ce5e54"}
Sep 17 23:12:50.235541 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.235431    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b06d2ccacc66b50bb9ae5b0090dd58f75957ee34223abe8a5cdc22bc28ce5e54"
Sep 17 23:12:50.237308 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.237289    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9"
Sep 17 23:12:50.237432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.237326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abwqp9" event={"ID":"7897ac9d-1903-4cec-8c35-a270179aebdd","Type":"ContainerDied","Data":"59d35db3fd370565e7051014ccb5e026915fc9e8381821e9446c430e29ded824"}
Sep 17 23:12:50.237432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.237355    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59d35db3fd370565e7051014ccb5e026915fc9e8381821e9446c430e29ded824"
Sep 17 23:12:50.239378 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.239360    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9" event={"ID":"ba82a6bf-e2d3-4242-9fdb-597f1c54b248","Type":"ContainerDied","Data":"709f4ff906e02b1ed285b0e2f4dbd3fcda1c0132991777de4a510057c1b94968"}
Sep 17 23:12:50.239487 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.239394    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="709f4ff906e02b1ed285b0e2f4dbd3fcda1c0132991777de4a510057c1b94968"
Sep 17 23:12:50.239487 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.239363    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7g45v9"
Sep 17 23:12:50.241511 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.241488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n" event={"ID":"32904e6d-7851-4fc4-b05e-6825da62229b","Type":"ContainerDied","Data":"2ed570a16ca28c344758a689d55d4a8e35b307603aa5f70386422495b8f616e5"}
Sep 17 23:12:50.241511 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.241510    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cghf7n"
Sep 17 23:12:50.241664 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:12:50.241525    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ed570a16ca28c344758a689d55d4a8e35b307603aa5f70386422495b8f616e5"
Sep 17 23:13:04.672645 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:04.672606    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8649477db9-p4q7n" podUID="582fd1c7-9451-43c5-942b-7d4213bd462f" containerName="console" containerID="cri-o://c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17" gracePeriod=15
Sep 17 23:13:04.916171 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:04.916141    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:13:05.033699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.033665    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlvl7\" (UniqueName: \"kubernetes.io/projected/582fd1c7-9451-43c5-942b-7d4213bd462f-kube-api-access-xlvl7\") pod \"582fd1c7-9451-43c5-942b-7d4213bd462f\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") "
Sep 17 23:13:05.033876 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.033710    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-serving-cert\") pod \"582fd1c7-9451-43c5-942b-7d4213bd462f\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") "
Sep 17 23:13:05.033876 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.033729    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-service-ca\") pod \"582fd1c7-9451-43c5-942b-7d4213bd462f\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") "
Sep 17 23:13:05.033876 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.033775    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-oauth-serving-cert\") pod \"582fd1c7-9451-43c5-942b-7d4213bd462f\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") "
Sep 17 23:13:05.033876 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.033800    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-console-config\") pod \"582fd1c7-9451-43c5-942b-7d4213bd462f\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") "
Sep 17 23:13:05.033876 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.033820    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-oauth-config\") pod \"582fd1c7-9451-43c5-942b-7d4213bd462f\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") "
Sep 17 23:13:05.033876 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.033844    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-trusted-ca-bundle\") pod \"582fd1c7-9451-43c5-942b-7d4213bd462f\" (UID: \"582fd1c7-9451-43c5-942b-7d4213bd462f\") "
Sep 17 23:13:05.034222 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.034194    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "582fd1c7-9451-43c5-942b-7d4213bd462f" (UID: "582fd1c7-9451-43c5-942b-7d4213bd462f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:13:05.034281 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.034230    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-service-ca" (OuterVolumeSpecName: "service-ca") pod "582fd1c7-9451-43c5-942b-7d4213bd462f" (UID: "582fd1c7-9451-43c5-942b-7d4213bd462f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:13:05.034281 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.034239    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-console-config" (OuterVolumeSpecName: "console-config") pod "582fd1c7-9451-43c5-942b-7d4213bd462f" (UID: "582fd1c7-9451-43c5-942b-7d4213bd462f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:13:05.034344 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.034295    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "582fd1c7-9451-43c5-942b-7d4213bd462f" (UID: "582fd1c7-9451-43c5-942b-7d4213bd462f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:13:05.035953 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.035927    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "582fd1c7-9451-43c5-942b-7d4213bd462f" (UID: "582fd1c7-9451-43c5-942b-7d4213bd462f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:13:05.036061 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.035955    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "582fd1c7-9451-43c5-942b-7d4213bd462f" (UID: "582fd1c7-9451-43c5-942b-7d4213bd462f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:13:05.036109 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.036079    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/582fd1c7-9451-43c5-942b-7d4213bd462f-kube-api-access-xlvl7" (OuterVolumeSpecName: "kube-api-access-xlvl7") pod "582fd1c7-9451-43c5-942b-7d4213bd462f" (UID: "582fd1c7-9451-43c5-942b-7d4213bd462f"). InnerVolumeSpecName "kube-api-access-xlvl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:13:05.135342 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.135312    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:13:05.135342 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.135338    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:13:05.135342 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.135348    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-oauth-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:13:05.135589 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.135357    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-console-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:13:05.135589 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.135365    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/582fd1c7-9451-43c5-942b-7d4213bd462f-console-oauth-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:13:05.135589 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.135373    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582fd1c7-9451-43c5-942b-7d4213bd462f-trusted-ca-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:13:05.135589 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.135381    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlvl7\" (UniqueName: \"kubernetes.io/projected/582fd1c7-9451-43c5-942b-7d4213bd462f-kube-api-access-xlvl7\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:13:05.320645 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.320562    2583 generic.go:356] "Generic (PLEG): container finished" podID="582fd1c7-9451-43c5-942b-7d4213bd462f" containerID="c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17" exitCode=0
Sep 17 23:13:05.320645 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.320603    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8649477db9-p4q7n"
Sep 17 23:13:05.320816 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.320645    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8649477db9-p4q7n" event={"ID":"582fd1c7-9451-43c5-942b-7d4213bd462f","Type":"ContainerDied","Data":"c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17"}
Sep 17 23:13:05.320816 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.320697    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8649477db9-p4q7n" event={"ID":"582fd1c7-9451-43c5-942b-7d4213bd462f","Type":"ContainerDied","Data":"d9d0ec3b5485e82566a92d87fe9ef07d8606f1eb59814a82eba21fe62fff0be8"}
Sep 17 23:13:05.320816 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.320717    2583 scope.go:117] "RemoveContainer" containerID="c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17"
Sep 17 23:13:05.329658 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.329641    2583 scope.go:117] "RemoveContainer" containerID="c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17"
Sep 17 23:13:05.329922 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:13:05.329903    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17\": container with ID starting with c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17 not found: ID does not exist" containerID="c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17"
Sep 17 23:13:05.329961 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.329931    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17"} err="failed to get container status \"c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17\": rpc error: code = NotFound desc = could not find container \"c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17\": container with ID starting with c2b66224ff030d8230eda3b0943c360c37666157caf0e70e9b6f4f88f0cecc17 not found: ID does not exist"
Sep 17 23:13:05.367428 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.367396    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8649477db9-p4q7n"]
Sep 17 23:13:05.375295 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:05.375269    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8649477db9-p4q7n"]
Sep 17 23:13:06.487389 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:06.487352    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="582fd1c7-9451-43c5-942b-7d4213bd462f" path="/var/lib/kubelet/pods/582fd1c7-9451-43c5-942b-7d4213bd462f/volumes"
Sep 17 23:13:52.813162 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813061    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"]
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813405    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7897ac9d-1903-4cec-8c35-a270179aebdd" containerName="pull"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813417    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7897ac9d-1903-4cec-8c35-a270179aebdd" containerName="pull"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813431    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7897ac9d-1903-4cec-8c35-a270179aebdd" containerName="util"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813437    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7897ac9d-1903-4cec-8c35-a270179aebdd" containerName="util"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813443    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d9bce47-63a2-401f-9106-00c91f549077" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813448    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d9bce47-63a2-401f-9106-00c91f549077" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813456    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba82a6bf-e2d3-4242-9fdb-597f1c54b248" containerName="util"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813475    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba82a6bf-e2d3-4242-9fdb-597f1c54b248" containerName="util"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813488    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d9bce47-63a2-401f-9106-00c91f549077" containerName="pull"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813497    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d9bce47-63a2-401f-9106-00c91f549077" containerName="pull"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813503    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba82a6bf-e2d3-4242-9fdb-597f1c54b248" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813508    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba82a6bf-e2d3-4242-9fdb-597f1c54b248" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813516    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba82a6bf-e2d3-4242-9fdb-597f1c54b248" containerName="pull"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813521    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba82a6bf-e2d3-4242-9fdb-597f1c54b248" containerName="pull"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813528    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d9bce47-63a2-401f-9106-00c91f549077" containerName="util"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813533    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d9bce47-63a2-401f-9106-00c91f549077" containerName="util"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813539    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7897ac9d-1903-4cec-8c35-a270179aebdd" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813543    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7897ac9d-1903-4cec-8c35-a270179aebdd" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813549    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32904e6d-7851-4fc4-b05e-6825da62229b" containerName="pull"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813555    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="32904e6d-7851-4fc4-b05e-6825da62229b" containerName="pull"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813563    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32904e6d-7851-4fc4-b05e-6825da62229b" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813570    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="32904e6d-7851-4fc4-b05e-6825da62229b" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813578    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582fd1c7-9451-43c5-942b-7d4213bd462f" containerName="console"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813582    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="582fd1c7-9451-43c5-942b-7d4213bd462f" containerName="console"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813597    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32904e6d-7851-4fc4-b05e-6825da62229b" containerName="util"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813605    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="32904e6d-7851-4fc4-b05e-6825da62229b" containerName="util"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813688    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="582fd1c7-9451-43c5-942b-7d4213bd462f" containerName="console"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813702    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba82a6bf-e2d3-4242-9fdb-597f1c54b248" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813713    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="32904e6d-7851-4fc4-b05e-6825da62229b" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813722    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d9bce47-63a2-401f-9106-00c91f549077" containerName="extract"
Sep 17 23:13:52.813720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.813731    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7897ac9d-1903-4cec-8c35-a270179aebdd" containerName="extract"
Sep 17 23:13:52.816886 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.816860    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.819203 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.819182    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gqqpx\""
Sep 17 23:13:52.827314 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.827290    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"]
Sep 17 23:13:52.851239 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.851206    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.851239 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.851242    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9xn5\" (UniqueName: \"kubernetes.io/projected/fba4e5c7-faa0-488c-9a1f-b5389723627f-kube-api-access-x9xn5\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.851518 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.851264    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.851518 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.851373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.851518 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.851423    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba4e5c7-faa0-488c-9a1f-b5389723627f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.851518 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.851478    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.851678 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.851522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.851678 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.851545    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.851678 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.851566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952105 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952105 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba4e5c7-faa0-488c-9a1f-b5389723627f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952319 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952319 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952319 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952319 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952267    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952559 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952559 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xn5\" (UniqueName: \"kubernetes.io/projected/fba4e5c7-faa0-488c-9a1f-b5389723627f-kube-api-access-x9xn5\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952559 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952755 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952734    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.952950 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.952922    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.953247 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.953215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba4e5c7-faa0-488c-9a1f-b5389723627f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.954843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.954822    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.955007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.954991    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.959681 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.959659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba4e5c7-faa0-488c-9a1f-b5389723627f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:52.959769 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:52.959705    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9xn5\" (UniqueName: \"kubernetes.io/projected/fba4e5c7-faa0-488c-9a1f-b5389723627f-kube-api-access-x9xn5\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dxbq6\" (UID: \"fba4e5c7-faa0-488c-9a1f-b5389723627f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:53.127725 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:53.127635    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:53.403198 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:53.403171    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"]
Sep 17 23:13:53.404492 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:13:53.404446    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba4e5c7_faa0_488c_9a1f_b5389723627f.slice/crio-7a1e1300bc4267463f68406524689923e9166c17c8893aee96aebd1c64dc2e1d WatchSource:0}: Error finding container 7a1e1300bc4267463f68406524689923e9166c17c8893aee96aebd1c64dc2e1d: Status 404 returned error can't find the container with id 7a1e1300bc4267463f68406524689923e9166c17c8893aee96aebd1c64dc2e1d
Sep 17 23:13:53.406591 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:53.406560    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:13:53.406662 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:53.406622    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:13:53.406662 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:53.406649    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:13:53.568798 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:53.568763    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" event={"ID":"fba4e5c7-faa0-488c-9a1f-b5389723627f","Type":"ContainerStarted","Data":"d5e8c082728ad55e6a7d6fb990eabf0c05c8040624b20fa61a052f58d37d3fbf"}
Sep 17 23:13:53.568982 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:53.568818    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" event={"ID":"fba4e5c7-faa0-488c-9a1f-b5389723627f","Type":"ContainerStarted","Data":"7a1e1300bc4267463f68406524689923e9166c17c8893aee96aebd1c64dc2e1d"}
Sep 17 23:13:53.592939 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:53.592878    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" podStartSLOduration=1.592855793 podStartE2EDuration="1.592855793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:13:53.590593757 +0000 UTC m=+445.198171444" watchObservedRunningTime="2026-09-17 23:13:53.592855793 +0000 UTC m=+445.200433454"
Sep 17 23:13:54.128165 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:54.128126    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:54.133014 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:54.132990    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:54.577761 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:54.577729    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:13:54.578830 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:13:54.578808    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:14:08.561116 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:08.561080    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-2mr8d"]
Sep 17 23:14:08.564477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:08.564447    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-2mr8d"
Sep 17 23:14:08.566885 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:08.566861    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 23:14:08.567010 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:08.566890    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vbwcr\""
Sep 17 23:14:08.567909 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:08.567892    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 23:14:08.570642 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:08.570618    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-2mr8d"]
Sep 17 23:14:08.685448 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:08.685413    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqwvf\" (UniqueName: \"kubernetes.io/projected/573c83b3-1c1d-4c51-8066-060938413cfd-kube-api-access-vqwvf\") pod \"authorino-59c974bd48-2mr8d\" (UID: \"573c83b3-1c1d-4c51-8066-060938413cfd\") " pod="kuadrant-system/authorino-59c974bd48-2mr8d"
Sep 17 23:14:08.786200 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:08.786163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqwvf\" (UniqueName: \"kubernetes.io/projected/573c83b3-1c1d-4c51-8066-060938413cfd-kube-api-access-vqwvf\") pod \"authorino-59c974bd48-2mr8d\" (UID: \"573c83b3-1c1d-4c51-8066-060938413cfd\") " pod="kuadrant-system/authorino-59c974bd48-2mr8d"
Sep 17 23:14:08.794803 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:08.794773    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqwvf\" (UniqueName: \"kubernetes.io/projected/573c83b3-1c1d-4c51-8066-060938413cfd-kube-api-access-vqwvf\") pod \"authorino-59c974bd48-2mr8d\" (UID: \"573c83b3-1c1d-4c51-8066-060938413cfd\") " pod="kuadrant-system/authorino-59c974bd48-2mr8d"
Sep 17 23:14:08.875388 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:08.875312    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-2mr8d"
Sep 17 23:14:09.143327 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:09.143306    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-2mr8d"]
Sep 17 23:14:09.145363 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:14:09.145337    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod573c83b3_1c1d_4c51_8066_060938413cfd.slice/crio-0d8f62c266b599ba33e99a6cbfbec7df3942cd2c0b52cdd20d156e3373d75ddf WatchSource:0}: Error finding container 0d8f62c266b599ba33e99a6cbfbec7df3942cd2c0b52cdd20d156e3373d75ddf: Status 404 returned error can't find the container with id 0d8f62c266b599ba33e99a6cbfbec7df3942cd2c0b52cdd20d156e3373d75ddf
Sep 17 23:14:09.653163 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:09.653123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-2mr8d" event={"ID":"573c83b3-1c1d-4c51-8066-060938413cfd","Type":"ContainerStarted","Data":"0d8f62c266b599ba33e99a6cbfbec7df3942cd2c0b52cdd20d156e3373d75ddf"}
Sep 17 23:14:11.666293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:11.666207    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-2mr8d" event={"ID":"573c83b3-1c1d-4c51-8066-060938413cfd","Type":"ContainerStarted","Data":"5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419"}
Sep 17 23:14:11.682654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:11.682599    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-2mr8d" podStartSLOduration=1.431546077 podStartE2EDuration="3.68258372s" totalImagesPullingTime="2.251037643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:14:11.680653798 +0000 UTC m=+463.288231459" watchObservedRunningTime="2026-09-17 23:14:11.68258372 +0000 UTC m=+463.290161380"
Sep 17 23:14:40.215447 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.215402    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-2mr8d"]
Sep 17 23:14:40.216031 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.215662    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-2mr8d" podUID="573c83b3-1c1d-4c51-8066-060938413cfd" containerName="authorino" containerID="cri-o://5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419" gracePeriod=30
Sep 17 23:14:40.458641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.458617    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-2mr8d"
Sep 17 23:14:40.553554 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.553527    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqwvf\" (UniqueName: \"kubernetes.io/projected/573c83b3-1c1d-4c51-8066-060938413cfd-kube-api-access-vqwvf\") pod \"573c83b3-1c1d-4c51-8066-060938413cfd\" (UID: \"573c83b3-1c1d-4c51-8066-060938413cfd\") "
Sep 17 23:14:40.555762 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.555729    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/573c83b3-1c1d-4c51-8066-060938413cfd-kube-api-access-vqwvf" (OuterVolumeSpecName: "kube-api-access-vqwvf") pod "573c83b3-1c1d-4c51-8066-060938413cfd" (UID: "573c83b3-1c1d-4c51-8066-060938413cfd"). InnerVolumeSpecName "kube-api-access-vqwvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:14:40.654149 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.654118    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqwvf\" (UniqueName: \"kubernetes.io/projected/573c83b3-1c1d-4c51-8066-060938413cfd-kube-api-access-vqwvf\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:14:40.814527 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.814426    2583 generic.go:356] "Generic (PLEG): container finished" podID="573c83b3-1c1d-4c51-8066-060938413cfd" containerID="5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419" exitCode=0
Sep 17 23:14:40.814527 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.814485    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-2mr8d"
Sep 17 23:14:40.814527 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.814498    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-2mr8d" event={"ID":"573c83b3-1c1d-4c51-8066-060938413cfd","Type":"ContainerDied","Data":"5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419"}
Sep 17 23:14:40.814745 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.814542    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-2mr8d" event={"ID":"573c83b3-1c1d-4c51-8066-060938413cfd","Type":"ContainerDied","Data":"0d8f62c266b599ba33e99a6cbfbec7df3942cd2c0b52cdd20d156e3373d75ddf"}
Sep 17 23:14:40.814745 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.814558    2583 scope.go:117] "RemoveContainer" containerID="5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419"
Sep 17 23:14:40.823370 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.823353    2583 scope.go:117] "RemoveContainer" containerID="5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419"
Sep 17 23:14:40.823669 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:14:40.823651    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419\": container with ID starting with 5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419 not found: ID does not exist" containerID="5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419"
Sep 17 23:14:40.823728 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.823678    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419"} err="failed to get container status \"5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419\": rpc error: code = NotFound desc = could not find container \"5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419\": container with ID starting with 5c47f103d0c79f736635581f40cf4106e793f3d19e01ce1e8a8041727dfbe419 not found: ID does not exist"
Sep 17 23:14:40.835038 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.835009    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-2mr8d"]
Sep 17 23:14:40.838055 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:40.838035    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-2mr8d"]
Sep 17 23:14:42.485971 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:42.485941    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="573c83b3-1c1d-4c51-8066-060938413cfd" path="/var/lib/kubelet/pods/573c83b3-1c1d-4c51-8066-060938413cfd/volumes"
Sep 17 23:14:44.891090 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.891055    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-654fc8f547-p7t67"]
Sep 17 23:14:44.891489 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.891454    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="573c83b3-1c1d-4c51-8066-060938413cfd" containerName="authorino"
Sep 17 23:14:44.891549 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.891491    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="573c83b3-1c1d-4c51-8066-060938413cfd" containerName="authorino"
Sep 17 23:14:44.891596 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.891586    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="573c83b3-1c1d-4c51-8066-060938413cfd" containerName="authorino"
Sep 17 23:14:44.893420 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.893405    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:44.895884 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.895849    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 23:14:44.895884 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.895873    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 23:14:44.896061 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.895849    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 23:14:44.896061 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.895977    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xv8zb\""
Sep 17 23:14:44.908303 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.908276    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-654fc8f547-p7t67"]
Sep 17 23:14:44.985833 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.985799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-metrics-certs\") pod \"maas-controller-654fc8f547-p7t67\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") " pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:44.985979 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.985840    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsf6v\" (UniqueName: \"kubernetes.io/projected/23d2304c-8942-4c6c-8787-b8d5f06aa96c-kube-api-access-bsf6v\") pod \"maas-controller-654fc8f547-p7t67\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") " pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:44.985979 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:44.985883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-webhook-cert\") pod \"maas-controller-654fc8f547-p7t67\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") " pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:45.074122 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.074091    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-947db468d-2qdk6"]
Sep 17 23:14:45.076430 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.076411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.086378 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.086352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-metrics-certs\") pod \"maas-controller-654fc8f547-p7t67\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") " pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:45.086547 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.086388    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-metrics-certs\") pod \"maas-controller-947db468d-2qdk6\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") " pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.086547 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.086408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7srwg\" (UniqueName: \"kubernetes.io/projected/5636cfaf-f7c1-42f1-a56e-730cefa419e7-kube-api-access-7srwg\") pod \"maas-controller-947db468d-2qdk6\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") " pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.086547 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.086439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsf6v\" (UniqueName: \"kubernetes.io/projected/23d2304c-8942-4c6c-8787-b8d5f06aa96c-kube-api-access-bsf6v\") pod \"maas-controller-654fc8f547-p7t67\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") " pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:45.086547 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:14:45.086521    2583 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 17 23:14:45.086765 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.086561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-webhook-cert\") pod \"maas-controller-654fc8f547-p7t67\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") " pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:45.086765 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:14:45.086581    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-metrics-certs podName:23d2304c-8942-4c6c-8787-b8d5f06aa96c nodeName:}" failed. No retries permitted until 2026-09-17 23:14:45.586567545 +0000 UTC m=+497.194145189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-metrics-certs") pod "maas-controller-654fc8f547-p7t67" (UID: "23d2304c-8942-4c6c-8787-b8d5f06aa96c") : secret "maas-controller-metrics-tls" not found
Sep 17 23:14:45.086765 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.086621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-webhook-cert\") pod \"maas-controller-947db468d-2qdk6\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") " pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.087021 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.087001    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-947db468d-2qdk6"]
Sep 17 23:14:45.089184 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.089154    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-webhook-cert\") pod \"maas-controller-654fc8f547-p7t67\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") " pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:45.099308 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.099283    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsf6v\" (UniqueName: \"kubernetes.io/projected/23d2304c-8942-4c6c-8787-b8d5f06aa96c-kube-api-access-bsf6v\") pod \"maas-controller-654fc8f547-p7t67\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") " pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:45.187645 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.187547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-metrics-certs\") pod \"maas-controller-947db468d-2qdk6\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") " pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.187645 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.187591    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7srwg\" (UniqueName: \"kubernetes.io/projected/5636cfaf-f7c1-42f1-a56e-730cefa419e7-kube-api-access-7srwg\") pod \"maas-controller-947db468d-2qdk6\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") " pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.187872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.187675    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-webhook-cert\") pod \"maas-controller-947db468d-2qdk6\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") " pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.187872 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:14:45.187694    2583 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 17 23:14:45.187872 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:14:45.187780    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-metrics-certs podName:5636cfaf-f7c1-42f1-a56e-730cefa419e7 nodeName:}" failed. No retries permitted until 2026-09-17 23:14:45.687759235 +0000 UTC m=+497.295336874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-metrics-certs") pod "maas-controller-947db468d-2qdk6" (UID: "5636cfaf-f7c1-42f1-a56e-730cefa419e7") : secret "maas-controller-metrics-tls" not found
Sep 17 23:14:45.190122 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.190101    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-webhook-cert\") pod \"maas-controller-947db468d-2qdk6\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") " pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.195987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.195962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7srwg\" (UniqueName: \"kubernetes.io/projected/5636cfaf-f7c1-42f1-a56e-730cefa419e7-kube-api-access-7srwg\") pod \"maas-controller-947db468d-2qdk6\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") " pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.590544 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.590511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-metrics-certs\") pod \"maas-controller-654fc8f547-p7t67\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") " pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:45.592939 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.592915    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-metrics-certs\") pod \"maas-controller-654fc8f547-p7t67\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") " pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:45.691507 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.691458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-metrics-certs\") pod \"maas-controller-947db468d-2qdk6\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") " pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.693782 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.693751    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-metrics-certs\") pod \"maas-controller-947db468d-2qdk6\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") " pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:45.804103 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.804071    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:45.986647 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:45.986613    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:46.073987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:46.073964    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-654fc8f547-p7t67"]
Sep 17 23:14:46.075728 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:14:46.075707    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d2304c_8942_4c6c_8787_b8d5f06aa96c.slice/crio-240738db2aae3b50e3cdb3a64402cd0ab702fde40b4e726cbeef8aa50cfbffc5 WatchSource:0}: Error finding container 240738db2aae3b50e3cdb3a64402cd0ab702fde40b4e726cbeef8aa50cfbffc5: Status 404 returned error can't find the container with id 240738db2aae3b50e3cdb3a64402cd0ab702fde40b4e726cbeef8aa50cfbffc5
Sep 17 23:14:46.256184 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:46.256157    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-947db468d-2qdk6"]
Sep 17 23:14:46.257846 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:14:46.257816    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5636cfaf_f7c1_42f1_a56e_730cefa419e7.slice/crio-484b36a8f6995fa79dea951622669a95febeb37429b55727e0c25f931c62a516 WatchSource:0}: Error finding container 484b36a8f6995fa79dea951622669a95febeb37429b55727e0c25f931c62a516: Status 404 returned error can't find the container with id 484b36a8f6995fa79dea951622669a95febeb37429b55727e0c25f931c62a516
Sep 17 23:14:46.851543 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:46.851502    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654fc8f547-p7t67" event={"ID":"23d2304c-8942-4c6c-8787-b8d5f06aa96c","Type":"ContainerStarted","Data":"240738db2aae3b50e3cdb3a64402cd0ab702fde40b4e726cbeef8aa50cfbffc5"}
Sep 17 23:14:46.853665 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:46.853586    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-947db468d-2qdk6" event={"ID":"5636cfaf-f7c1-42f1-a56e-730cefa419e7","Type":"ContainerStarted","Data":"484b36a8f6995fa79dea951622669a95febeb37429b55727e0c25f931c62a516"}
Sep 17 23:14:48.866618 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:48.866580    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654fc8f547-p7t67" event={"ID":"23d2304c-8942-4c6c-8787-b8d5f06aa96c","Type":"ContainerStarted","Data":"b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237"}
Sep 17 23:14:48.867055 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:48.866737    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:48.868218 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:48.868196    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-947db468d-2qdk6" event={"ID":"5636cfaf-f7c1-42f1-a56e-730cefa419e7","Type":"ContainerStarted","Data":"70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc"}
Sep 17 23:14:48.868329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:48.868238    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:48.890592 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:48.890543    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-654fc8f547-p7t67" podStartSLOduration=2.254598299 podStartE2EDuration="4.890527585s" totalImagesPullingTime="2.635929286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:14:48.88971744 +0000 UTC m=+500.497295120" watchObservedRunningTime="2026-09-17 23:14:48.890527585 +0000 UTC m=+500.498105241"
Sep 17 23:14:48.909485 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:48.909423    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-947db468d-2qdk6" podStartSLOduration=1.451501102 podStartE2EDuration="3.909407378s" totalImagesPullingTime="2.457906276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:14:48.908177443 +0000 UTC m=+500.515755106" watchObservedRunningTime="2026-09-17 23:14:48.909407378 +0000 UTC m=+500.516985037"
Sep 17 23:14:59.876087 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:59.876056    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:14:59.876551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:59.876126    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:14:59.923563 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:59.923529    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-654fc8f547-p7t67"]
Sep 17 23:14:59.926235 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:14:59.926181    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-654fc8f547-p7t67" podUID="23d2304c-8942-4c6c-8787-b8d5f06aa96c" containerName="manager" containerID="cri-o://b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237" gracePeriod=30
Sep 17 23:15:00.171366 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.171344    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:15:00.220408 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.220381    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsf6v\" (UniqueName: \"kubernetes.io/projected/23d2304c-8942-4c6c-8787-b8d5f06aa96c-kube-api-access-bsf6v\") pod \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") "
Sep 17 23:15:00.220602 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.220427    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-metrics-certs\") pod \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") "
Sep 17 23:15:00.220602 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.220508    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-webhook-cert\") pod \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\" (UID: \"23d2304c-8942-4c6c-8787-b8d5f06aa96c\") "
Sep 17 23:15:00.222802 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.222766    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d2304c-8942-4c6c-8787-b8d5f06aa96c-kube-api-access-bsf6v" (OuterVolumeSpecName: "kube-api-access-bsf6v") pod "23d2304c-8942-4c6c-8787-b8d5f06aa96c" (UID: "23d2304c-8942-4c6c-8787-b8d5f06aa96c"). InnerVolumeSpecName "kube-api-access-bsf6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:15:00.222924 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.222798    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "23d2304c-8942-4c6c-8787-b8d5f06aa96c" (UID: "23d2304c-8942-4c6c-8787-b8d5f06aa96c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:15:00.222924 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.222813    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "23d2304c-8942-4c6c-8787-b8d5f06aa96c" (UID: "23d2304c-8942-4c6c-8787-b8d5f06aa96c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:15:00.321723 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.321679    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-webhook-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:15:00.321723 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.321718    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsf6v\" (UniqueName: \"kubernetes.io/projected/23d2304c-8942-4c6c-8787-b8d5f06aa96c-kube-api-access-bsf6v\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:15:00.321723 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.321727    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d2304c-8942-4c6c-8787-b8d5f06aa96c-metrics-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:15:00.932481 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.932427    2583 generic.go:356] "Generic (PLEG): container finished" podID="23d2304c-8942-4c6c-8787-b8d5f06aa96c" containerID="b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237" exitCode=0
Sep 17 23:15:00.932481 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.932483    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654fc8f547-p7t67"
Sep 17 23:15:00.932914 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.932513    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654fc8f547-p7t67" event={"ID":"23d2304c-8942-4c6c-8787-b8d5f06aa96c","Type":"ContainerDied","Data":"b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237"}
Sep 17 23:15:00.932914 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.932570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654fc8f547-p7t67" event={"ID":"23d2304c-8942-4c6c-8787-b8d5f06aa96c","Type":"ContainerDied","Data":"240738db2aae3b50e3cdb3a64402cd0ab702fde40b4e726cbeef8aa50cfbffc5"}
Sep 17 23:15:00.932914 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.932592    2583 scope.go:117] "RemoveContainer" containerID="b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237"
Sep 17 23:15:00.940984 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.940967    2583 scope.go:117] "RemoveContainer" containerID="b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237"
Sep 17 23:15:00.941276 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:15:00.941261    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237\": container with ID starting with b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237 not found: ID does not exist" containerID="b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237"
Sep 17 23:15:00.941335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.941287    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237"} err="failed to get container status \"b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237\": rpc error: code = NotFound desc = could not find container \"b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237\": container with ID starting with b837155b4be73749d1efffca7792cba186245efe328ca787a63836534f242237 not found: ID does not exist"
Sep 17 23:15:00.948274 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.948252    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-654fc8f547-p7t67"]
Sep 17 23:15:00.959157 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:00.955140    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-654fc8f547-p7t67"]
Sep 17 23:15:02.486839 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:02.486796    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23d2304c-8942-4c6c-8787-b8d5f06aa96c" path="/var/lib/kubelet/pods/23d2304c-8942-4c6c-8787-b8d5f06aa96c/volumes"
Sep 17 23:15:21.381055 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.380973    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"]
Sep 17 23:15:21.381521 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.381357    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23d2304c-8942-4c6c-8787-b8d5f06aa96c" containerName="manager"
Sep 17 23:15:21.381521 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.381370    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="23d2304c-8942-4c6c-8787-b8d5f06aa96c" containerName="manager"
Sep 17 23:15:21.381521 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.381438    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="23d2304c-8942-4c6c-8787-b8d5f06aa96c" containerName="manager"
Sep 17 23:15:21.386676 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.386660    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"
Sep 17 23:15:21.389518 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.389494    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 17 23:15:21.389518 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.389510    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xbsm5\""
Sep 17 23:15:21.396457 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.396433    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"]
Sep 17 23:15:21.509501 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.509443    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-4gbbx\" (UID: \"2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"
Sep 17 23:15:21.509660 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.509565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br5jl\" (UniqueName: \"kubernetes.io/projected/2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9-kube-api-access-br5jl\") pod \"payload-pre-processing-59fbc47bf8-4gbbx\" (UID: \"2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"
Sep 17 23:15:21.610855 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.610812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-4gbbx\" (UID: \"2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"
Sep 17 23:15:21.611034 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.610886    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br5jl\" (UniqueName: \"kubernetes.io/projected/2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9-kube-api-access-br5jl\") pod \"payload-pre-processing-59fbc47bf8-4gbbx\" (UID: \"2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"
Sep 17 23:15:21.611598 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.611572    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-4gbbx\" (UID: \"2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"
Sep 17 23:15:21.622685 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.622657    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br5jl\" (UniqueName: \"kubernetes.io/projected/2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9-kube-api-access-br5jl\") pod \"payload-pre-processing-59fbc47bf8-4gbbx\" (UID: \"2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"
Sep 17 23:15:21.698406 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.698317    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"
Sep 17 23:15:21.972632 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:21.972589    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"]
Sep 17 23:15:21.973805 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:15:21.973782    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a90f0ba_f4e4_4e3e_85ab_526ce3daa4e9.slice/crio-cc85c5eb068e446f443a936fb54f5c3c5aeed64d9545f56c63f94d1e48f44892 WatchSource:0}: Error finding container cc85c5eb068e446f443a936fb54f5c3c5aeed64d9545f56c63f94d1e48f44892: Status 404 returned error can't find the container with id cc85c5eb068e446f443a936fb54f5c3c5aeed64d9545f56c63f94d1e48f44892
Sep 17 23:15:22.037536 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:22.037500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx" event={"ID":"2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9","Type":"ContainerStarted","Data":"cc85c5eb068e446f443a936fb54f5c3c5aeed64d9545f56c63f94d1e48f44892"}
Sep 17 23:15:24.053902 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:24.053859    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx" event={"ID":"2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9","Type":"ContainerStarted","Data":"0c6c5f37e900cfc6585bf4c644e300b0e1a017799e877bceba97266093ea3df2"}
Sep 17 23:15:24.054722 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:24.054697    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"
Sep 17 23:15:24.072014 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:24.071941    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx" podStartSLOduration=1.8077943159999998 podStartE2EDuration="3.07192517s" totalImagesPullingTime="1.264130854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:15:24.070284716 +0000 UTC m=+535.677862415" watchObservedRunningTime="2026-09-17 23:15:24.07192517 +0000 UTC m=+535.679502831"
Sep 17 23:15:31.099806 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:31.099772    2583 generic.go:356] "Generic (PLEG): container finished" podID="fba4e5c7-faa0-488c-9a1f-b5389723627f" containerID="d5e8c082728ad55e6a7d6fb990eabf0c05c8040624b20fa61a052f58d37d3fbf" exitCode=0
Sep 17 23:15:31.100243 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:31.099845    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" event={"ID":"fba4e5c7-faa0-488c-9a1f-b5389723627f","Type":"ContainerDied","Data":"d5e8c082728ad55e6a7d6fb990eabf0c05c8040624b20fa61a052f58d37d3fbf"}
Sep 17 23:15:31.100286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:31.100267    2583 scope.go:117] "RemoveContainer" containerID="d5e8c082728ad55e6a7d6fb990eabf0c05c8040624b20fa61a052f58d37d3fbf"
Sep 17 23:15:31.101363 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:31.101335    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:15:31.101494 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:31.101416    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:15:31.101569 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:31.101511    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:15:32.107368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:32.107332    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" event={"ID":"fba4e5c7-faa0-488c-9a1f-b5389723627f","Type":"ContainerStarted","Data":"23761ce3d96cb6d449002e5cf338b7a20449e46522a40894343a8eb2f9fcfd3d"}
Sep 17 23:15:32.127841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:32.127806    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:15:32.128117 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:32.128079    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dxbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 17 23:15:32.128235 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:32.128158    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" podUID="fba4e5c7-faa0-488c-9a1f-b5389723627f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 17 23:15:33.128336 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:33.128297    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dxbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 17 23:15:33.128756 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:33.128351    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" podUID="fba4e5c7-faa0-488c-9a1f-b5389723627f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 17 23:15:34.128810 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:34.128776    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dxbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 17 23:15:34.129223 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:34.128833    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" podUID="fba4e5c7-faa0-488c-9a1f-b5389723627f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 17 23:15:35.128528 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:35.128498    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dxbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 17 23:15:35.128722 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:35.128547    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" podUID="fba4e5c7-faa0-488c-9a1f-b5389723627f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 17 23:15:36.072697 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:36.072664    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx"
Sep 17 23:15:36.127980 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:36.127941    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dxbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 17 23:15:36.128214 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:36.128189    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" podUID="fba4e5c7-faa0-488c-9a1f-b5389723627f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 17 23:15:37.128545 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:37.128506    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dxbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 17 23:15:37.129012 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:37.128975    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6" podUID="fba4e5c7-faa0-488c-9a1f-b5389723627f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 17 23:15:38.131917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:38.131887    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:15:38.132300 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:38.132266    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:15:38.133013 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:38.132992    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6"
Sep 17 23:15:52.598265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.598228    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"]
Sep 17 23:15:52.601784 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.601760    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.605409 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.605382    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 23:15:52.605409 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.605397    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 17 23:15:52.605650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.605416    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 23:15:52.605650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.605448    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wkppn\""
Sep 17 23:15:52.612505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.612484    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"]
Sep 17 23:15:52.690204 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.690169    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.690366 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.690223    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.690366 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.690280    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnmfx\" (UniqueName: \"kubernetes.io/projected/620ac619-b4d7-4804-8c59-941e27bb7c42-kube-api-access-wnmfx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.690443 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.690378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/620ac619-b4d7-4804-8c59-941e27bb7c42-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.690443 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.690406    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.690443 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.690432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.791342 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.791307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.791545 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.791352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.791545 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.791385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.791545 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.791405    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnmfx\" (UniqueName: \"kubernetes.io/projected/620ac619-b4d7-4804-8c59-941e27bb7c42-kube-api-access-wnmfx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.791545 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.791457    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/620ac619-b4d7-4804-8c59-941e27bb7c42-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.791545 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.791534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.791800 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.791778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.791868 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.791850    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.791906 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.791871    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.793794 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.793769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/620ac619-b4d7-4804-8c59-941e27bb7c42-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.794036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.794021    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/620ac619-b4d7-4804-8c59-941e27bb7c42-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.798795 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.798773    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnmfx\" (UniqueName: \"kubernetes.io/projected/620ac619-b4d7-4804-8c59-941e27bb7c42-kube-api-access-wnmfx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4\" (UID: \"620ac619-b4d7-4804-8c59-941e27bb7c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:52.913651 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:52.913562    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:15:53.199668 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:53.199644    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"]
Sep 17 23:15:53.201058 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:15:53.201021    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620ac619_b4d7_4804_8c59_941e27bb7c42.slice/crio-ed695b5754a0673419ad9fa82b0fa8085acd38079bd4dc7d5cf1267ac1733a5e WatchSource:0}: Error finding container ed695b5754a0673419ad9fa82b0fa8085acd38079bd4dc7d5cf1267ac1733a5e: Status 404 returned error can't find the container with id ed695b5754a0673419ad9fa82b0fa8085acd38079bd4dc7d5cf1267ac1733a5e
Sep 17 23:15:53.221206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:53.221176    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4" event={"ID":"620ac619-b4d7-4804-8c59-941e27bb7c42","Type":"ContainerStarted","Data":"ed695b5754a0673419ad9fa82b0fa8085acd38079bd4dc7d5cf1267ac1733a5e"}
Sep 17 23:15:55.233830 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:55.233790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4" event={"ID":"620ac619-b4d7-4804-8c59-941e27bb7c42","Type":"ContainerStarted","Data":"1604d4d14f1a8715b8ef1698cabfeabfd867ffa4c4fe09be7143dc13f12881b7"}
Sep 17 23:15:55.251911 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:15:55.251857    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4" podStartSLOduration=2.247112653 podStartE2EDuration="3.251841792s" totalImagesPullingTime="1.004729139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:15:55.249794798 +0000 UTC m=+566.857372457" watchObservedRunningTime="2026-09-17 23:15:55.251841792 +0000 UTC m=+566.859419452"
Sep 17 23:16:02.914363 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:16:02.914321    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:16:02.914749 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:16:02.914400    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:16:02.926880 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:16:02.926852    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:16:03.284255 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:16:03.284232    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4"
Sep 17 23:18:15.756950 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.756865    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69c94896d7-d4tm6"]
Sep 17 23:18:15.760183 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.760163    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c94896d7-d4tm6"
Sep 17 23:18:15.762642 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.762616    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 23:18:15.763605 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.763585    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 17 23:18:15.763668 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.763610    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vbwcr\""
Sep 17 23:18:15.763668 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.763640    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 23:18:15.770742 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.770717    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69c94896d7-d4tm6"]
Sep 17 23:18:15.849142 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.849109    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/284cf396-1b72-42c5-bef1-464759f6c03e-tls-cert\") pod \"authorino-69c94896d7-d4tm6\" (UID: \"284cf396-1b72-42c5-bef1-464759f6c03e\") " pod="kuadrant-system/authorino-69c94896d7-d4tm6"
Sep 17 23:18:15.849346 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.849153    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc4tl\" (UniqueName: \"kubernetes.io/projected/284cf396-1b72-42c5-bef1-464759f6c03e-kube-api-access-kc4tl\") pod \"authorino-69c94896d7-d4tm6\" (UID: \"284cf396-1b72-42c5-bef1-464759f6c03e\") " pod="kuadrant-system/authorino-69c94896d7-d4tm6"
Sep 17 23:18:15.950408 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.950378    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/284cf396-1b72-42c5-bef1-464759f6c03e-tls-cert\") pod \"authorino-69c94896d7-d4tm6\" (UID: \"284cf396-1b72-42c5-bef1-464759f6c03e\") " pod="kuadrant-system/authorino-69c94896d7-d4tm6"
Sep 17 23:18:15.950611 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.950426    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc4tl\" (UniqueName: \"kubernetes.io/projected/284cf396-1b72-42c5-bef1-464759f6c03e-kube-api-access-kc4tl\") pod \"authorino-69c94896d7-d4tm6\" (UID: \"284cf396-1b72-42c5-bef1-464759f6c03e\") " pod="kuadrant-system/authorino-69c94896d7-d4tm6"
Sep 17 23:18:15.952932 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.952907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/284cf396-1b72-42c5-bef1-464759f6c03e-tls-cert\") pod \"authorino-69c94896d7-d4tm6\" (UID: \"284cf396-1b72-42c5-bef1-464759f6c03e\") " pod="kuadrant-system/authorino-69c94896d7-d4tm6"
Sep 17 23:18:15.958545 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:15.958522    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc4tl\" (UniqueName: \"kubernetes.io/projected/284cf396-1b72-42c5-bef1-464759f6c03e-kube-api-access-kc4tl\") pod \"authorino-69c94896d7-d4tm6\" (UID: \"284cf396-1b72-42c5-bef1-464759f6c03e\") " pod="kuadrant-system/authorino-69c94896d7-d4tm6"
Sep 17 23:18:16.069933 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:16.069902    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c94896d7-d4tm6"
Sep 17 23:18:16.342981 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:16.342887    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69c94896d7-d4tm6"]
Sep 17 23:18:16.345692 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:18:16.345662    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod284cf396_1b72_42c5_bef1_464759f6c03e.slice/crio-5b296406f052df399ec527fcf3ae2ca3e6d8973ccfa4e77d201ee24df539b75a WatchSource:0}: Error finding container 5b296406f052df399ec527fcf3ae2ca3e6d8973ccfa4e77d201ee24df539b75a: Status 404 returned error can't find the container with id 5b296406f052df399ec527fcf3ae2ca3e6d8973ccfa4e77d201ee24df539b75a
Sep 17 23:18:16.347013 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:16.346996    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:18:16.944607 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:16.944569    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c94896d7-d4tm6" event={"ID":"284cf396-1b72-42c5-bef1-464759f6c03e","Type":"ContainerStarted","Data":"6a8879874c59d5259515d71f47c7b3e54673e3df479bdb0c2a009e0495708e37"}
Sep 17 23:18:16.945002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:16.944616    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c94896d7-d4tm6" event={"ID":"284cf396-1b72-42c5-bef1-464759f6c03e","Type":"ContainerStarted","Data":"5b296406f052df399ec527fcf3ae2ca3e6d8973ccfa4e77d201ee24df539b75a"}
Sep 17 23:18:16.963265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:16.963213    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69c94896d7-d4tm6" podStartSLOduration=1.554065953 podStartE2EDuration="1.963199583s" totalImagesPullingTime="409.13363ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:16.960489121 +0000 UTC m=+708.568066782" watchObservedRunningTime="2026-09-17 23:18:16.963199583 +0000 UTC m=+708.570777242"
Sep 17 23:18:34.282117 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.282053    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"]
Sep 17 23:18:34.286623 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.286600    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.289163 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.289146    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-48d98f-openshift-default-dockercfg-dgzgz\""
Sep 17 23:18:34.298147 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.298123    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"]
Sep 17 23:18:34.346286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.346257    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"]
Sep 17 23:18:34.349800 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.349780    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.352334 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.352313    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-825f30-openshift-default-dockercfg-jxxdf\""
Sep 17 23:18:34.363412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.363386    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"]
Sep 17 23:18:34.421840 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.421810    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-credential-socket\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.421840 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.421843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-credential-socket\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.422083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.421872    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9xkh\" (UniqueName: \"kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-kube-api-access-h9xkh\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.422083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.421990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istiod-ca-cert\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.422083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-socket\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.422083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-envoy\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.422083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-istio-token\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.422338 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-data\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.422338 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7knm\" (UniqueName: \"kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-kube-api-access-b7knm\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.422338 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422253    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-socket\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.422338 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422307    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-token\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.422338 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-certs\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.422654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-data\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.422654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b646954-840c-4deb-b022-7c8040605f08-istiod-ca-cert\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.422654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-envoy\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.422654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-certs\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.422654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422476    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b646954-840c-4deb-b022-7c8040605f08-istio-podinfo\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.422654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.422532    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-podinfo\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.431527 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.431499    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"]
Sep 17 23:18:34.437202 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.437183    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.439684 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.439663    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-736809-openshift-default-dockercfg-v9j7h\""
Sep 17 23:18:34.445221 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.445160    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"]
Sep 17 23:18:34.523189 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523157    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-podinfo\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.523377 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523202    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b646954-840c-4deb-b022-7c8040605f08-istio-podinfo\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.523377 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-socket\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.523377 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523249    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istiod-ca-cert\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.523377 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-token\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.523377 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523298    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b646954-840c-4deb-b022-7c8040605f08-istiod-ca-cert\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.523377 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523323    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-credential-socket\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.523377 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523357    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-credential-socket\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xkh\" (UniqueName: \"kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-kube-api-access-h9xkh\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523414    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-socket\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-envoy\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523457    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-istio-token\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-token\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-envoy\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-data\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-certs\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523620    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-socket\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-socket\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-data\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-envoy\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.523841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523752    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-credential-socket\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.523975    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-data\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524005    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-socket\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524042    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-certs\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524054    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-certs\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-podinfo\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524142    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-certs\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-credential-socket\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istiod-ca-cert\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524246    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn7n4\" (UniqueName: \"kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-kube-api-access-dn7n4\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-data\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7knm\" (UniqueName: \"kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-kube-api-access-b7knm\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.524513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524398    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-credential-socket\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.525132 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524551    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-certs\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.525132 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.524816    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-data\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.525132 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.525052    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istiod-ca-cert\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.525376 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.525354    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b646954-840c-4deb-b022-7c8040605f08-istiod-ca-cert\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.526264 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.526240    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-envoy\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.526641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.526617    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-envoy\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.526759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.526642    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b646954-840c-4deb-b022-7c8040605f08-istio-podinfo\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.526834 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.526781    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-podinfo\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.532590 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.532534    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-token\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.532948 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.532929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-istio-token\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.533570 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.533533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9xkh\" (UniqueName: \"kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-kube-api-access-h9xkh\") pod \"e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") " pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.533932 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.533905    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7knm\" (UniqueName: \"kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-kube-api-access-b7knm\") pod \"e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") " pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.598800 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.598764    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:34.625537 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.625501    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-token\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.625686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.625553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-envoy\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.625686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.625584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-data\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.625686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.625619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-socket\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.625843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.625684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-certs\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.625843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.625734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7n4\" (UniqueName: \"kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-kube-api-access-dn7n4\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.625843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.625766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-podinfo\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.625843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.625821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istiod-ca-cert\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.626046 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.625876    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-credential-socket\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.626046 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.626009    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-data\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.626156 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.626065    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-certs\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.626286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.626234    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-credential-socket\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.626414 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.626347    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-socket\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.626752 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.626724    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istiod-ca-cert\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.628027 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.628008    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-envoy\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.628939 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.628915    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-podinfo\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.634071 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.634047    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-token\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.634071 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.634064    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7n4\" (UniqueName: \"kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-kube-api-access-dn7n4\") pod \"e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") " pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.663186 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.663092    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:34.750423 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.750393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:34.880936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.880895    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"]
Sep 17 23:18:34.882044 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:18:34.882018    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b646954_840c_4deb_b022_7c8040605f08.slice/crio-ab0ec7c43ab8007813697ef8b975058ca41a1c0d76a9a274fd247e525f1043fc WatchSource:0}: Error finding container ab0ec7c43ab8007813697ef8b975058ca41a1c0d76a9a274fd247e525f1043fc: Status 404 returned error can't find the container with id ab0ec7c43ab8007813697ef8b975058ca41a1c0d76a9a274fd247e525f1043fc
Sep 17 23:18:34.884262 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.884232    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:34.884326 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.884299    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:34.884370 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.884328    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:34.944641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.944615    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"]
Sep 17 23:18:34.946356 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:18:34.946331    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ef50e2_fc3f_4bd9_829b_e16db354ffb6.slice/crio-e236f74093f8944f5b90a5d3fdd7e6af600d5ebaa4b7b8600cf3a27c5b4772f2 WatchSource:0}: Error finding container e236f74093f8944f5b90a5d3fdd7e6af600d5ebaa4b7b8600cf3a27c5b4772f2: Status 404 returned error can't find the container with id e236f74093f8944f5b90a5d3fdd7e6af600d5ebaa4b7b8600cf3a27c5b4772f2
Sep 17 23:18:34.948748 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.948717    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:34.948825 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.948807    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:34.948880 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:34.948835    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:35.029927 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.029867    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"]
Sep 17 23:18:35.031977 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:18:35.031933    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf975f9c_c0af_4750_aba8_dc2d5bb2da66.slice/crio-535180ae3e484f0cbe3a6450d4ee0d911654d39565fed02d08de1fe2e32bb75a WatchSource:0}: Error finding container 535180ae3e484f0cbe3a6450d4ee0d911654d39565fed02d08de1fe2e32bb75a: Status 404 returned error can't find the container with id 535180ae3e484f0cbe3a6450d4ee0d911654d39565fed02d08de1fe2e32bb75a
Sep 17 23:18:35.034768 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.034602    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:35.034768 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.034690    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:35.034768 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.034736    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:35.054638 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.054551    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" event={"ID":"df975f9c-c0af-4750-aba8-dc2d5bb2da66","Type":"ContainerStarted","Data":"535180ae3e484f0cbe3a6450d4ee0d911654d39565fed02d08de1fe2e32bb75a"}
Sep 17 23:18:35.056560 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.056488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" event={"ID":"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6","Type":"ContainerStarted","Data":"550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26"}
Sep 17 23:18:35.056785 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.056740    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" event={"ID":"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6","Type":"ContainerStarted","Data":"e236f74093f8944f5b90a5d3fdd7e6af600d5ebaa4b7b8600cf3a27c5b4772f2"}
Sep 17 23:18:35.059279 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.059250    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" event={"ID":"6b646954-840c-4deb-b022-7c8040605f08","Type":"ContainerStarted","Data":"ccd05e09360649165ed79e87e2691fc0339e9864e3946f0728ec22d964a38df8"}
Sep 17 23:18:35.059383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.059303    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" event={"ID":"6b646954-840c-4deb-b022-7c8040605f08","Type":"ContainerStarted","Data":"ab0ec7c43ab8007813697ef8b975058ca41a1c0d76a9a274fd247e525f1043fc"}
Sep 17 23:18:35.083150 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.080396    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" podStartSLOduration=1.08037045 podStartE2EDuration="1.08037045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:35.078582057 +0000 UTC m=+726.686159742" watchObservedRunningTime="2026-09-17 23:18:35.08037045 +0000 UTC m=+726.687948111"
Sep 17 23:18:35.106846 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.106794    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" podStartSLOduration=1.106763033 podStartE2EDuration="1.106763033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:35.10617922 +0000 UTC m=+726.713756897" watchObservedRunningTime="2026-09-17 23:18:35.106763033 +0000 UTC m=+726.714340693"
Sep 17 23:18:35.599444 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.599396    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:35.605022 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.604994    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:35.663974 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:35.663942    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:36.068119 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:36.068078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" event={"ID":"df975f9c-c0af-4750-aba8-dc2d5bb2da66","Type":"ContainerStarted","Data":"064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435"}
Sep 17 23:18:36.068560 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:36.068537    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:36.069437 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:36.069415    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:18:36.109756 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:36.109710    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" podStartSLOduration=2.109697084 podStartE2EDuration="2.109697084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:36.08791114 +0000 UTC m=+727.695488835" watchObservedRunningTime="2026-09-17 23:18:36.109697084 +0000 UTC m=+727.717274744"
Sep 17 23:18:36.669549 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:36.669517    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:36.750687 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:36.750657    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:36.755695 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:36.755670    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:37.075010 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:37.074949    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:37.075010 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:37.075004    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:37.075621 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:37.075598    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:18:37.075732 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:37.075721    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:18:42.300285 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.300250    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"]
Sep 17 23:18:42.303886 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.303870    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:18:42.306113 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.306095    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-736809\""
Sep 17 23:18:42.315009 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.314987    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"]
Sep 17 23:18:42.331035 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.331008    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"]
Sep 17 23:18:42.334552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.334535    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:18:42.338272 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.338255    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-736809-dockercfg-r4hn2\""
Sep 17 23:18:42.347006 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.346983    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"]
Sep 17 23:18:42.406823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.406787    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c320de76-ed56-46a6-9e8c-42b145544a2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc\" (UID: \"c320de76-ed56-46a6-9e8c-42b145544a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:18:42.406823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.406825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mp4s\" (UniqueName: \"kubernetes.io/projected/c320de76-ed56-46a6-9e8c-42b145544a2b-kube-api-access-4mp4s\") pod \"payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc\" (UID: \"c320de76-ed56-46a6-9e8c-42b145544a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:18:42.507738 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.507700    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c320de76-ed56-46a6-9e8c-42b145544a2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc\" (UID: \"c320de76-ed56-46a6-9e8c-42b145544a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:18:42.507738 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.507741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mp4s\" (UniqueName: \"kubernetes.io/projected/c320de76-ed56-46a6-9e8c-42b145544a2b-kube-api-access-4mp4s\") pod \"payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc\" (UID: \"c320de76-ed56-46a6-9e8c-42b145544a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:18:42.507952 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.507897    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvrfc\" (UniqueName: \"kubernetes.io/projected/26220153-8a17-4578-9455-186d3653b6d6-kube-api-access-lvrfc\") pod \"payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs\" (UID: \"26220153-8a17-4578-9455-186d3653b6d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:18:42.507952 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.507932    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26220153-8a17-4578-9455-186d3653b6d6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs\" (UID: \"26220153-8a17-4578-9455-186d3653b6d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:18:42.508448 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.508429    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c320de76-ed56-46a6-9e8c-42b145544a2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc\" (UID: \"c320de76-ed56-46a6-9e8c-42b145544a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:18:42.516085 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.516056    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mp4s\" (UniqueName: \"kubernetes.io/projected/c320de76-ed56-46a6-9e8c-42b145544a2b-kube-api-access-4mp4s\") pod \"payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc\" (UID: \"c320de76-ed56-46a6-9e8c-42b145544a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:18:42.609046 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.608947    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvrfc\" (UniqueName: \"kubernetes.io/projected/26220153-8a17-4578-9455-186d3653b6d6-kube-api-access-lvrfc\") pod \"payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs\" (UID: \"26220153-8a17-4578-9455-186d3653b6d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:18:42.609046 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.608986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26220153-8a17-4578-9455-186d3653b6d6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs\" (UID: \"26220153-8a17-4578-9455-186d3653b6d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:18:42.609747 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.609726    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26220153-8a17-4578-9455-186d3653b6d6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs\" (UID: \"26220153-8a17-4578-9455-186d3653b6d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:18:42.615744 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.615722    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:18:42.616727 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.616706    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvrfc\" (UniqueName: \"kubernetes.io/projected/26220153-8a17-4578-9455-186d3653b6d6-kube-api-access-lvrfc\") pod \"payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs\" (UID: \"26220153-8a17-4578-9455-186d3653b6d6\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:18:42.645145 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.645118    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:18:42.895214 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.895182    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"]
Sep 17 23:18:42.895924 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:18:42.895898    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc320de76_ed56_46a6_9e8c_42b145544a2b.slice/crio-420e66ff2042a759399a2dab1e8f2aeefa2e3856b2d0a15757b269df9c98a66f WatchSource:0}: Error finding container 420e66ff2042a759399a2dab1e8f2aeefa2e3856b2d0a15757b269df9c98a66f: Status 404 returned error can't find the container with id 420e66ff2042a759399a2dab1e8f2aeefa2e3856b2d0a15757b269df9c98a66f
Sep 17 23:18:42.934188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:42.934162    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"]
Sep 17 23:18:42.938589 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:18:42.938561    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26220153_8a17_4578_9455_186d3653b6d6.slice/crio-8e9d7436ec896a1277970360f68b7b23d32243c5a5e0a49457c2eaf4cc3a0a1b WatchSource:0}: Error finding container 8e9d7436ec896a1277970360f68b7b23d32243c5a5e0a49457c2eaf4cc3a0a1b: Status 404 returned error can't find the container with id 8e9d7436ec896a1277970360f68b7b23d32243c5a5e0a49457c2eaf4cc3a0a1b
Sep 17 23:18:43.111785 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.111741    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs" event={"ID":"26220153-8a17-4578-9455-186d3653b6d6","Type":"ContainerStarted","Data":"62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b"}
Sep 17 23:18:43.111980 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.111807    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs" event={"ID":"26220153-8a17-4578-9455-186d3653b6d6","Type":"ContainerStarted","Data":"8e9d7436ec896a1277970360f68b7b23d32243c5a5e0a49457c2eaf4cc3a0a1b"}
Sep 17 23:18:43.111980 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.111837    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:18:43.113520 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.113495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc" event={"ID":"c320de76-ed56-46a6-9e8c-42b145544a2b","Type":"ContainerStarted","Data":"949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864"}
Sep 17 23:18:43.113654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.113536    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc" event={"ID":"c320de76-ed56-46a6-9e8c-42b145544a2b","Type":"ContainerStarted","Data":"420e66ff2042a759399a2dab1e8f2aeefa2e3856b2d0a15757b269df9c98a66f"}
Sep 17 23:18:43.113654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.113559    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:18:43.131406 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.131345    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs" podStartSLOduration=1.131325678 podStartE2EDuration="1.131325678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:43.128415365 +0000 UTC m=+734.735993050" watchObservedRunningTime="2026-09-17 23:18:43.131325678 +0000 UTC m=+734.738903340"
Sep 17 23:18:43.146676 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.146580    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc" podStartSLOduration=1.146560415 podStartE2EDuration="1.146560415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:43.144994166 +0000 UTC m=+734.752571851" watchObservedRunningTime="2026-09-17 23:18:43.146560415 +0000 UTC m=+734.754138079"
Sep 17 23:18:43.384970 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.384934    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"]
Sep 17 23:18:43.389183 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.389153    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.391878 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.391852    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-61e623-openshift-default-dockercfg-np9kf\""
Sep 17 23:18:43.403489 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.403438    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"]
Sep 17 23:18:43.517332 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.517268    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-socket\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.517540 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.517357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-podinfo\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.517540 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.517500    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf74m\" (UniqueName: \"kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-kube-api-access-vf74m\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.517540 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.517538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-certs\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.517776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.517572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-envoy\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.517776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.517609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bcb1827-6071-4063-8635-23c24a7e4f26-istiod-ca-cert\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.517776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.517710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-data\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.517776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.517749    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-credential-socket\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.517987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.517785    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-token\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.618985 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.618952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-certs\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.618985 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.618991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-envoy\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619022    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bcb1827-6071-4063-8635-23c24a7e4f26-istiod-ca-cert\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-data\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-credential-socket\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-token\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-socket\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-podinfo\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619544 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf74m\" (UniqueName: \"kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-kube-api-access-vf74m\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619544 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619392    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-certs\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619697 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619673    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-socket\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619708    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-credential-socket\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619804 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bcb1827-6071-4063-8635-23c24a7e4f26-istiod-ca-cert\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.619842 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.619801    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-data\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.621608 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.621555    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-envoy\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.621816 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.621792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-podinfo\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.632790 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.632759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-token\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.633352 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.633331    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf74m\" (UniqueName: \"kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-kube-api-access-vf74m\") pod \"e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") " pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:43.704594 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:43.704208    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:44.003543 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:44.003513    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"]
Sep 17 23:18:44.004491 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:18:44.004453    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcb1827_6071_4063_8635_23c24a7e4f26.slice/crio-65bcac03d161570c2fc43b0f381a5bd76fc818e2e05d991ccdab886d48d19ad5 WatchSource:0}: Error finding container 65bcac03d161570c2fc43b0f381a5bd76fc818e2e05d991ccdab886d48d19ad5: Status 404 returned error can't find the container with id 65bcac03d161570c2fc43b0f381a5bd76fc818e2e05d991ccdab886d48d19ad5
Sep 17 23:18:44.006756 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:44.006717    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:44.006838 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:44.006788    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:44.006838 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:44.006814    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:44.122349 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:44.122314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" event={"ID":"9bcb1827-6071-4063-8635-23c24a7e4f26","Type":"ContainerStarted","Data":"e43b7d59ced69165959567ae3bebd6e9451f83205ef6f42422a6296e6cfe9a9b"}
Sep 17 23:18:44.122621 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:44.122601    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" event={"ID":"9bcb1827-6071-4063-8635-23c24a7e4f26","Type":"ContainerStarted","Data":"65bcac03d161570c2fc43b0f381a5bd76fc818e2e05d991ccdab886d48d19ad5"}
Sep 17 23:18:44.144283 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:44.144223    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" podStartSLOduration=1.144202429 podStartE2EDuration="1.144202429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:44.142482889 +0000 UTC m=+735.750060560" watchObservedRunningTime="2026-09-17 23:18:44.144202429 +0000 UTC m=+735.751780092"
Sep 17 23:18:44.705300 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:44.705263    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:45.710359 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:45.710329    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:46.133057 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:46.133019    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:46.134128 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:46.134109    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:18:51.872836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:51.872791    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"]
Sep 17 23:18:51.888735 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:51.888701    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"]
Sep 17 23:18:51.889158 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:51.889078    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:18:51.892078 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:51.892055    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-61e623-dockercfg-kcn6c\""
Sep 17 23:18:51.892792 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:51.892492    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-61e623\""
Sep 17 23:18:51.946703 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:51.946654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fc5d882-af12-41dd-88b1-de7f3df177d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl\" (UID: \"5fc5d882-af12-41dd-88b1-de7f3df177d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:18:51.947182 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:51.947135    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54vnh\" (UniqueName: \"kubernetes.io/projected/5fc5d882-af12-41dd-88b1-de7f3df177d5-kube-api-access-54vnh\") pod \"payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl\" (UID: \"5fc5d882-af12-41dd-88b1-de7f3df177d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:18:52.051170 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:52.051130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54vnh\" (UniqueName: \"kubernetes.io/projected/5fc5d882-af12-41dd-88b1-de7f3df177d5-kube-api-access-54vnh\") pod \"payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl\" (UID: \"5fc5d882-af12-41dd-88b1-de7f3df177d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:18:52.051558 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:52.051523    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fc5d882-af12-41dd-88b1-de7f3df177d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl\" (UID: \"5fc5d882-af12-41dd-88b1-de7f3df177d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:18:52.052825 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:52.052800    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fc5d882-af12-41dd-88b1-de7f3df177d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl\" (UID: \"5fc5d882-af12-41dd-88b1-de7f3df177d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:18:52.070495 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:52.069298    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54vnh\" (UniqueName: \"kubernetes.io/projected/5fc5d882-af12-41dd-88b1-de7f3df177d5-kube-api-access-54vnh\") pod \"payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl\" (UID: \"5fc5d882-af12-41dd-88b1-de7f3df177d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:18:52.210987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:52.210890    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:18:52.588448 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:52.588417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"]
Sep 17 23:18:52.599507 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:18:52.596742    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc5d882_af12_41dd_88b1_de7f3df177d5.slice/crio-01d74c5b2ff0863b18a16296a3d017f7ec3dc7b28bcdd5d2b738a124ab30eb9c WatchSource:0}: Error finding container 01d74c5b2ff0863b18a16296a3d017f7ec3dc7b28bcdd5d2b738a124ab30eb9c: Status 404 returned error can't find the container with id 01d74c5b2ff0863b18a16296a3d017f7ec3dc7b28bcdd5d2b738a124ab30eb9c
Sep 17 23:18:53.221869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:53.221825    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl" event={"ID":"5fc5d882-af12-41dd-88b1-de7f3df177d5","Type":"ContainerStarted","Data":"2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7"}
Sep 17 23:18:53.222606 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:53.222579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl" event={"ID":"5fc5d882-af12-41dd-88b1-de7f3df177d5","Type":"ContainerStarted","Data":"01d74c5b2ff0863b18a16296a3d017f7ec3dc7b28bcdd5d2b738a124ab30eb9c"}
Sep 17 23:18:53.223600 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:53.223581    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:18:53.255264 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:53.254646    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl" podStartSLOduration=2.254607993 podStartE2EDuration="2.254607993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:53.25120235 +0000 UTC m=+744.858780030" watchObservedRunningTime="2026-09-17 23:18:53.254607993 +0000 UTC m=+744.862185653"
Sep 17 23:18:54.125058 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:54.124959    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:18:54.125269 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:54.125249    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:18:59.272891 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.272848    2583 generic.go:356] "Generic (PLEG): container finished" podID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerID="064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435" exitCode=0
Sep 17 23:18:59.273432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.272921    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" event={"ID":"df975f9c-c0af-4750-aba8-dc2d5bb2da66","Type":"ContainerDied","Data":"064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435"}
Sep 17 23:18:59.273546 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.273501    2583 scope.go:117] "RemoveContainer" containerID="064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435"
Sep 17 23:18:59.275004 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.274967    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:59.275120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.275035    2583 generic.go:356] "Generic (PLEG): container finished" podID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerID="550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26" exitCode=0
Sep 17 23:18:59.275120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.275065    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:59.275233 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.275110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" event={"ID":"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6","Type":"ContainerDied","Data":"550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26"}
Sep 17 23:18:59.275233 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.275114    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:59.275591 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.275565    2583 scope.go:117] "RemoveContainer" containerID="550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26"
Sep 17 23:18:59.276711 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.276686    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:59.276808 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.276743    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:59.276808 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.276779    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:59.277140 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.277120    2583 generic.go:356] "Generic (PLEG): container finished" podID="6b646954-840c-4deb-b022-7c8040605f08" containerID="ccd05e09360649165ed79e87e2691fc0339e9864e3946f0728ec22d964a38df8" exitCode=0
Sep 17 23:18:59.277258 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.277193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" event={"ID":"6b646954-840c-4deb-b022-7c8040605f08","Type":"ContainerDied","Data":"ccd05e09360649165ed79e87e2691fc0339e9864e3946f0728ec22d964a38df8"}
Sep 17 23:18:59.277708 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.277608    2583 scope.go:117] "RemoveContainer" containerID="ccd05e09360649165ed79e87e2691fc0339e9864e3946f0728ec22d964a38df8"
Sep 17 23:18:59.278774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.278689    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:59.278774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.278759    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:18:59.278879 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:18:59.278802    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:19:00.291103 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.291062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" event={"ID":"6b646954-840c-4deb-b022-7c8040605f08","Type":"ContainerStarted","Data":"c479537ee3f8c209ff64fe6254e29da243a6668c0412c8721dc640ab3b7cf205"}
Sep 17 23:19:00.294722 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.294688    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" event={"ID":"df975f9c-c0af-4750-aba8-dc2d5bb2da66","Type":"ContainerStarted","Data":"95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7"}
Sep 17 23:19:00.297891 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.297856    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" event={"ID":"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6","Type":"ContainerStarted","Data":"5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb"}
Sep 17 23:19:00.599540 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.599424    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:19:00.599918 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.599831    2583 patch_prober.go:28] interesting pod/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 23:19:00.600090 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.600069    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 23:19:00.663818 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.663783    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:19:00.664560 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.664512    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 23:19:00.664834 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.664804    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 23:19:00.752670 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.752637    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:19:00.753286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.752922    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 23:19:00.753414 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:00.753334    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 23:19:01.599638 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:01.599599    2583 patch_prober.go:28] interesting pod/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 23:19:01.600231 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:01.600199    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 23:19:01.664026 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:01.663973    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 23:19:01.664209 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:01.664045    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 23:19:01.751326 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:01.751284    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 23:19:01.751577 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:01.751356    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 23:19:02.575694 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.575656    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"]
Sep 17 23:19:02.610614 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.578746    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.610614 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.581823    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f38e68-openshift-default-dockercfg-5tgbc\""
Sep 17 23:19:02.610614 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.598337    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"]
Sep 17 23:19:02.610614 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.601057    2583 patch_prober.go:28] interesting pod/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 23:19:02.610614 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.601122    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 23:19:02.663865 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.663829    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 23:19:02.664110 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.664080    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 23:19:02.724240 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.724184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-certs\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.724578 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.724555    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-podinfo\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.724750 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.724733    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-envoy\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.724901 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.724885    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-credential-socket\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.725112 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.725094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-socket\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.725276 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.725261    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-token\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.725452 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.725423    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62mq7\" (UniqueName: \"kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-kube-api-access-62mq7\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.725620 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.725603    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f41f516b-db53-4fdd-999b-938e1d6985a1-istiod-ca-cert\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.725755 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.725739    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-data\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.751028 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.750994    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 23:19:02.751358 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.751325    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 23:19:02.827611 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.827496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-certs\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.827885 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.827852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-podinfo\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.828037 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.828022    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-envoy\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.828189 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.828175    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-credential-socket\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.828474 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.828444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-socket\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.828774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.828756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-token\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.828989 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.828934    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62mq7\" (UniqueName: \"kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-kube-api-access-62mq7\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.829176 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.829141    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f41f516b-db53-4fdd-999b-938e1d6985a1-istiod-ca-cert\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.830178 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.830151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-data\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.831001 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.828791    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-certs\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.831153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.829584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-credential-socket\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.831295 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.829928    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f41f516b-db53-4fdd-999b-938e1d6985a1-istiod-ca-cert\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.831419 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.829221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-socket\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.831543 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.830751    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-data\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.849492 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.836244    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-envoy\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.849492 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.838988    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-token\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.849492 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.840068    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62mq7\" (UniqueName: \"kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-kube-api-access-62mq7\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.850337 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.850306    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-podinfo\") pod \"e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") " pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:02.948151 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:02.948111    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:03.547649 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:03.545663    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"]
Sep 17 23:19:03.572660 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:19:03.568254    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41f516b_db53_4fdd_999b_938e1d6985a1.slice/crio-56910f3673c5875c72e87b0a002926ab3be335e8d8c803638b55a1ecf9f7d33d WatchSource:0}: Error finding container 56910f3673c5875c72e87b0a002926ab3be335e8d8c803638b55a1ecf9f7d33d: Status 404 returned error can't find the container with id 56910f3673c5875c72e87b0a002926ab3be335e8d8c803638b55a1ecf9f7d33d
Sep 17 23:19:03.589519 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:03.589480    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:19:03.589778 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:03.589755    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:19:03.589958 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:03.589930    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:19:03.615151 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:03.614689    2583 patch_prober.go:28] interesting pod/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 23:19:03.615151 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:03.614761    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 23:19:03.666255 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:03.665818    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 23:19:03.666255 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:03.665880    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 23:19:03.750970 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:03.750932    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 23:19:03.751157 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:03.751000    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 23:19:04.355396 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.355358    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" event={"ID":"f41f516b-db53-4fdd-999b-938e1d6985a1","Type":"ContainerStarted","Data":"dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9"}
Sep 17 23:19:04.355747 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.355723    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" event={"ID":"f41f516b-db53-4fdd-999b-938e1d6985a1","Type":"ContainerStarted","Data":"56910f3673c5875c72e87b0a002926ab3be335e8d8c803638b55a1ecf9f7d33d"}
Sep 17 23:19:04.382003 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.381926    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" podStartSLOduration=2.381903254 podStartE2EDuration="2.381903254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:19:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:19:04.376323598 +0000 UTC m=+755.983901260" watchObservedRunningTime="2026-09-17 23:19:04.381903254 +0000 UTC m=+755.989480916"
Sep 17 23:19:04.599419 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.599372    2583 patch_prober.go:28] interesting pod/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 23:19:04.599626 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.599454    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 23:19:04.664400 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.664293    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 23:19:04.664400 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.664367    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 23:19:04.758115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.758070    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 23:19:04.758311 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.758136    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 23:19:04.951055 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.949061    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:04.957600 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:04.957302    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:05.241119 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:05.240098    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:19:05.387275 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:05.387249    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:05.397983 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:05.397703    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:05.599759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:05.599283    2583 patch_prober.go:28] interesting pod/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 23:19:05.599759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:05.599360    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 23:19:05.664236 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:05.663784    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 23:19:05.664236 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:05.663848    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 23:19:05.751140 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:05.751099    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 17 23:19:05.751823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:05.751746    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 17 23:19:06.069539 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:06.068566    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:19:06.659883 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:06.659851    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:19:06.662585 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:06.662557    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:19:06.673104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:06.672036    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:19:06.673104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:06.673049    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:19:06.675778 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:06.675760    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:19:06.806198 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:06.804836    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:19:06.806748 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:06.806287    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:19:06.808011 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:06.807984    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:19:09.415538 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.415500    2583 generic.go:356] "Generic (PLEG): container finished" podID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerID="e43b7d59ced69165959567ae3bebd6e9451f83205ef6f42422a6296e6cfe9a9b" exitCode=0
Sep 17 23:19:09.416031 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.415553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" event={"ID":"9bcb1827-6071-4063-8635-23c24a7e4f26","Type":"ContainerDied","Data":"e43b7d59ced69165959567ae3bebd6e9451f83205ef6f42422a6296e6cfe9a9b"}
Sep 17 23:19:09.416104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.416046    2583 scope.go:117] "RemoveContainer" containerID="e43b7d59ced69165959567ae3bebd6e9451f83205ef6f42422a6296e6cfe9a9b"
Sep 17 23:19:09.417331 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.417301    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:19:09.417430 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.417383    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:19:09.417525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.417432    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:19:09.432994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.432971    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"]
Sep 17 23:19:09.436027 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.436006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:19:09.438653 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.438632    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-f38e68-dockercfg-lcv94\""
Sep 17 23:19:09.438653 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.438645    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-f38e68\""
Sep 17 23:19:09.446932 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.446907    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"]
Sep 17 23:19:09.538757 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.538712    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58sc8\" (UniqueName: \"kubernetes.io/projected/31c0253d-b72c-4ade-81ba-b872ffcc475b-kube-api-access-58sc8\") pod \"payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg\" (UID: \"31c0253d-b72c-4ade-81ba-b872ffcc475b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:19:09.538952 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.538856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31c0253d-b72c-4ade-81ba-b872ffcc475b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg\" (UID: \"31c0253d-b72c-4ade-81ba-b872ffcc475b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:19:09.640617 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.640573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31c0253d-b72c-4ade-81ba-b872ffcc475b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg\" (UID: \"31c0253d-b72c-4ade-81ba-b872ffcc475b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:19:09.640891 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.640855    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58sc8\" (UniqueName: \"kubernetes.io/projected/31c0253d-b72c-4ade-81ba-b872ffcc475b-kube-api-access-58sc8\") pod \"payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg\" (UID: \"31c0253d-b72c-4ade-81ba-b872ffcc475b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:19:09.641439 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.641414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31c0253d-b72c-4ade-81ba-b872ffcc475b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg\" (UID: \"31c0253d-b72c-4ade-81ba-b872ffcc475b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:19:09.648851 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.648827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58sc8\" (UniqueName: \"kubernetes.io/projected/31c0253d-b72c-4ade-81ba-b872ffcc475b-kube-api-access-58sc8\") pod \"payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg\" (UID: \"31c0253d-b72c-4ade-81ba-b872ffcc475b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:19:09.778479 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:09.778431    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:19:10.054559 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:10.054520    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"]
Sep 17 23:19:10.055407 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:19:10.055382    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c0253d_b72c_4ade_81ba_b872ffcc475b.slice/crio-bc28f427f0a36debf4de075365f7097ef933a6f09b7ab99fa46722e189b44736 WatchSource:0}: Error finding container bc28f427f0a36debf4de075365f7097ef933a6f09b7ab99fa46722e189b44736: Status 404 returned error can't find the container with id bc28f427f0a36debf4de075365f7097ef933a6f09b7ab99fa46722e189b44736
Sep 17 23:19:10.423293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:10.423185    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg" event={"ID":"31c0253d-b72c-4ade-81ba-b872ffcc475b","Type":"ContainerStarted","Data":"237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10"}
Sep 17 23:19:10.423293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:10.423256    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:19:10.423293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:10.423282    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg" event={"ID":"31c0253d-b72c-4ade-81ba-b872ffcc475b","Type":"ContainerStarted","Data":"bc28f427f0a36debf4de075365f7097ef933a6f09b7ab99fa46722e189b44736"}
Sep 17 23:19:10.425151 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:10.425130    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" event={"ID":"9bcb1827-6071-4063-8635-23c24a7e4f26","Type":"ContainerStarted","Data":"435e0ad52175b97e9cd90fc631bb3ff9aa57708298c119bffbc54b1f7df91854"}
Sep 17 23:19:10.462080 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:10.462006    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg" podStartSLOduration=1.461982695 podStartE2EDuration="1.461982695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:19:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:19:10.458202712 +0000 UTC m=+762.065780397" watchObservedRunningTime="2026-09-17 23:19:10.461982695 +0000 UTC m=+762.069560356"
Sep 17 23:19:10.704721 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:10.704632    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:19:10.704887 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:10.704822    2583 patch_prober.go:28] interesting pod/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 17 23:19:10.704966 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:10.704877    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 17 23:19:11.705164 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:11.705134    2583 patch_prober.go:28] interesting pod/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 17 23:19:11.705588 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:11.705196    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 17 23:19:12.706694 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:12.706652    2583 patch_prober.go:28] interesting pod/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 17 23:19:12.707220 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:12.706720    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 17 23:19:13.704579 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:13.704542    2583 patch_prober.go:28] interesting pod/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 17 23:19:13.704790 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:13.704599    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 17 23:19:13.849164 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:13.849127    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"]
Sep 17 23:19:13.853391 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:13.853365    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"
Sep 17 23:19:13.859996 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:13.859964    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"]
Sep 17 23:19:13.860616 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:13.860497    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:19:13.860888 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:13.860518    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:19:13.994391 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:13.994289    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7055231f-d7ba-42c7-85ab-371e0b29e17a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-54be2504-pdwzw\" (UID: \"7055231f-d7ba-42c7-85ab-371e0b29e17a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"
Sep 17 23:19:14.096075 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:14.096034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7055231f-d7ba-42c7-85ab-371e0b29e17a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-54be2504-pdwzw\" (UID: \"7055231f-d7ba-42c7-85ab-371e0b29e17a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"
Sep 17 23:19:14.096714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:14.096694    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7055231f-d7ba-42c7-85ab-371e0b29e17a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-54be2504-pdwzw\" (UID: \"7055231f-d7ba-42c7-85ab-371e0b29e17a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"
Sep 17 23:19:14.173978 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:14.173937    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"
Sep 17 23:19:14.454796 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:14.454763    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"]
Sep 17 23:19:14.704905 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:14.704819    2583 patch_prober.go:28] interesting pod/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 17 23:19:14.704905 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:14.704868    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 17 23:19:15.469050 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:15.469004    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw" event={"ID":"7055231f-d7ba-42c7-85ab-371e0b29e17a","Type":"ContainerStarted","Data":"4ed390c0c8cfaa4574c60f18f57f04a2663ea3593b255bc0f7723bf0c42f3fe8"}
Sep 17 23:19:15.705084 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:15.705046    2583 patch_prober.go:28] interesting pod/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 17 23:19:15.705281 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:15.705114    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 17 23:19:16.133394 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:16.133362    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:19:16.714416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:16.714381    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:19:16.715783 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:16.715762    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:19:17.482594 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:17.482504    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw" event={"ID":"7055231f-d7ba-42c7-85ab-371e0b29e17a","Type":"ContainerStarted","Data":"366cefc10976c071f576595c0ce6216c404d32ffd8874c5ee2188f5c104d8dd7"}
Sep 17 23:19:17.506956 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:17.506907    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw" podStartSLOduration=1.9157494050000001 podStartE2EDuration="4.506892541s" totalImagesPullingTime="2.591143136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:19:17.504809979 +0000 UTC m=+769.112387640" watchObservedRunningTime="2026-09-17 23:19:17.506892541 +0000 UTC m=+769.114470200"
Sep 17 23:19:18.489996 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:18.489962    2583 generic.go:356] "Generic (PLEG): container finished" podID="7055231f-d7ba-42c7-85ab-371e0b29e17a" containerID="366cefc10976c071f576595c0ce6216c404d32ffd8874c5ee2188f5c104d8dd7" exitCode=0
Sep 17 23:19:18.490405 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:18.490055    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw" event={"ID":"7055231f-d7ba-42c7-85ab-371e0b29e17a","Type":"ContainerDied","Data":"366cefc10976c071f576595c0ce6216c404d32ffd8874c5ee2188f5c104d8dd7"}
Sep 17 23:19:19.654589 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:19.654561    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"
Sep 17 23:19:19.758835 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:19.758741    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7055231f-d7ba-42c7-85ab-371e0b29e17a-maas-api-service-ca\") pod \"7055231f-d7ba-42c7-85ab-371e0b29e17a\" (UID: \"7055231f-d7ba-42c7-85ab-371e0b29e17a\") "
Sep 17 23:19:19.759094 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:19.759069    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7055231f-d7ba-42c7-85ab-371e0b29e17a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7055231f-d7ba-42c7-85ab-371e0b29e17a" (UID: "7055231f-d7ba-42c7-85ab-371e0b29e17a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:19:19.860369 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:19.860333    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7055231f-d7ba-42c7-85ab-371e0b29e17a-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:19:20.502880 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:20.502849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw" event={"ID":"7055231f-d7ba-42c7-85ab-371e0b29e17a","Type":"ContainerDied","Data":"4ed390c0c8cfaa4574c60f18f57f04a2663ea3593b255bc0f7723bf0c42f3fe8"}
Sep 17 23:19:20.503060 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:20.502904    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ed390c0c8cfaa4574c60f18f57f04a2663ea3593b255bc0f7723bf0c42f3fe8"
Sep 17 23:19:20.503060 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:20.502864    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"
Sep 17 23:19:21.432669 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:21.432639    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:19:30.533793 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:30.533758    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"]
Sep 17 23:19:30.537678 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:30.537646    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54be2504-pdwzw"]
Sep 17 23:19:30.576763 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:30.576734    2583 generic.go:356] "Generic (PLEG): container finished" podID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerID="dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9" exitCode=0
Sep 17 23:19:30.576928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:30.576801    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" event={"ID":"f41f516b-db53-4fdd-999b-938e1d6985a1","Type":"ContainerDied","Data":"dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9"}
Sep 17 23:19:30.577339 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:30.577323    2583 scope.go:117] "RemoveContainer" containerID="dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9"
Sep 17 23:19:30.578428 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:30.578404    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:19:30.578511 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:30.578489    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:19:30.578552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:30.578520    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:19:31.585115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:31.585078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" event={"ID":"f41f516b-db53-4fdd-999b-938e1d6985a1","Type":"ContainerStarted","Data":"c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560"}
Sep 17 23:19:31.949302 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:31.949204    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:31.950823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:31.950783    2583 patch_prober.go:28] interesting pod/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 23:19:31.951037 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:31.950847    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 23:19:32.487931 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:32.487895    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7055231f-d7ba-42c7-85ab-371e0b29e17a" path="/var/lib/kubelet/pods/7055231f-d7ba-42c7-85ab-371e0b29e17a/volumes"
Sep 17 23:19:32.948695 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:32.948653    2583 patch_prober.go:28] interesting pod/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 23:19:32.949220 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:32.948717    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 23:19:33.949036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:33.948990    2583 patch_prober.go:28] interesting pod/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 23:19:33.949552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:33.949067    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 23:19:34.948676 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:34.948638    2583 patch_prober.go:28] interesting pod/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 23:19:34.948873 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:34.948708    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 23:19:35.387556 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:35.387511    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:35.957494 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:35.955855    2583 patch_prober.go:28] interesting pod/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 23:19:35.957494 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:35.955941    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 23:19:36.948665 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:36.948633    2583 patch_prober.go:28] interesting pod/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 23:19:36.949065 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:36.948693    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 23:19:37.953063 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:37.953034    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:37.954007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:37.953987    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:19:38.885541 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.885502    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"]
Sep 17 23:19:38.885986 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.885967    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7055231f-d7ba-42c7-85ab-371e0b29e17a" containerName="revoke-keys"
Sep 17 23:19:38.886081 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.885989    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7055231f-d7ba-42c7-85ab-371e0b29e17a" containerName="revoke-keys"
Sep 17 23:19:38.886138 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.886124    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7055231f-d7ba-42c7-85ab-371e0b29e17a" containerName="revoke-keys"
Sep 17 23:19:38.893907 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.893877    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:38.897287 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.897263    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-736809\"/\"kube-root-ca.crt\""
Sep 17 23:19:38.897498 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.897449    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-736809\"/\"openshift-service-ca.crt\""
Sep 17 23:19:38.897498 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.897369    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-736809\"/\"default-dockercfg-64l8t\""
Sep 17 23:19:38.897674 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.897457    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-736809\"/\"simulator-w0-736809-kserve-self-signed-certs\""
Sep 17 23:19:38.899675 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.899653    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"]
Sep 17 23:19:38.966431 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.966397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-home\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:38.966836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.966495    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvglq\" (UniqueName: \"kubernetes.io/projected/91b65372-f14b-4803-96be-fbed8e37ce9b-kube-api-access-dvglq\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:38.966836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.966517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-dshm\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:38.966836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.966538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-model-cache\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:38.966836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.966563    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-tmp-dir\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:38.966836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:38.966652    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b65372-f14b-4803-96be-fbed8e37ce9b-tls-certs\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.067897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.067854    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvglq\" (UniqueName: \"kubernetes.io/projected/91b65372-f14b-4803-96be-fbed8e37ce9b-kube-api-access-dvglq\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.068082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.067906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-dshm\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.068082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.067942    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-model-cache\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.068082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.067985    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-tmp-dir\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.068082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.068039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b65372-f14b-4803-96be-fbed8e37ce9b-tls-certs\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.068296 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.068249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-home\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.068422 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.068381    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-model-cache\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.068602 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.068515    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-tmp-dir\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.068699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.068673    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-home\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.070322 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.070304    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-dshm\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.071035 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.071012    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b65372-f14b-4803-96be-fbed8e37ce9b-tls-certs\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.078020 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.077988    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvglq\" (UniqueName: \"kubernetes.io/projected/91b65372-f14b-4803-96be-fbed8e37ce9b-kube-api-access-dvglq\") pod \"simulator-w0-736809-kserve-588ff48cd4-465dl\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") " pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.204897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.204814    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:39.480268 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.480158    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"]
Sep 17 23:19:39.637457 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.637421    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl" event={"ID":"91b65372-f14b-4803-96be-fbed8e37ce9b","Type":"ContainerStarted","Data":"3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259"}
Sep 17 23:19:39.637457 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.637475    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl" event={"ID":"91b65372-f14b-4803-96be-fbed8e37ce9b","Type":"ContainerStarted","Data":"7116482995bf5b3a27968b1d086d959bba95310bf65fc64bde60a6f2cb977a08"}
Sep 17 23:19:39.656522 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:39.656459    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl" podStartSLOduration=1.656442813 podStartE2EDuration="1.656442813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:19:39.654189552 +0000 UTC m=+791.261767225" watchObservedRunningTime="2026-09-17 23:19:39.656442813 +0000 UTC m=+791.264020473"
Sep 17 23:19:49.205436 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:49.205350    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:49.205436 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:49.205424    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:49.217914 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:49.217892    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:49.714521 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:49.714456    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:19:59.720783 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:59.720745    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"]
Sep 17 23:19:59.724505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:59.724455    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"
Sep 17 23:19:59.727153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:59.727130    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:19:59.727291 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:59.727152    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:19:59.733642 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:59.733612    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"]
Sep 17 23:19:59.786256 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:59.786220    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/245a53a4-1187-425a-b319-87e365dbd6f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h\" (UID: \"245a53a4-1187-425a-b319-87e365dbd6f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"
Sep 17 23:19:59.887628 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:59.887589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/245a53a4-1187-425a-b319-87e365dbd6f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h\" (UID: \"245a53a4-1187-425a-b319-87e365dbd6f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"
Sep 17 23:19:59.888178 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:19:59.888159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/245a53a4-1187-425a-b319-87e365dbd6f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h\" (UID: \"245a53a4-1187-425a-b319-87e365dbd6f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"
Sep 17 23:20:00.037167 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:00.037130    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"
Sep 17 23:20:00.310650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:00.310621    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"]
Sep 17 23:20:00.312100 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:20:00.312072    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245a53a4_1187_425a_b319_87e365dbd6f6.slice/crio-d9685f2f2651201f9273562b66de7889129975939600e231e044afdb5091b383 WatchSource:0}: Error finding container d9685f2f2651201f9273562b66de7889129975939600e231e044afdb5091b383: Status 404 returned error can't find the container with id d9685f2f2651201f9273562b66de7889129975939600e231e044afdb5091b383
Sep 17 23:20:00.775685 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:00.775648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h" event={"ID":"245a53a4-1187-425a-b319-87e365dbd6f6","Type":"ContainerStarted","Data":"a2d562be71beabf5458b0c159e692765871afbf2636ebe19775323a1febed369"}
Sep 17 23:20:00.776156 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:00.775713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h" event={"ID":"245a53a4-1187-425a-b319-87e365dbd6f6","Type":"ContainerStarted","Data":"d9685f2f2651201f9273562b66de7889129975939600e231e044afdb5091b383"}
Sep 17 23:20:00.792628 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:00.792576    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h" podStartSLOduration=1.7925612549999999 podStartE2EDuration="1.792561255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:20:00.790792877 +0000 UTC m=+812.398370553" watchObservedRunningTime="2026-09-17 23:20:00.792561255 +0000 UTC m=+812.400138914"
Sep 17 23:20:01.783787 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:01.783753    2583 generic.go:356] "Generic (PLEG): container finished" podID="245a53a4-1187-425a-b319-87e365dbd6f6" containerID="a2d562be71beabf5458b0c159e692765871afbf2636ebe19775323a1febed369" exitCode=0
Sep 17 23:20:01.784160 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:01.783796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h" event={"ID":"245a53a4-1187-425a-b319-87e365dbd6f6","Type":"ContainerDied","Data":"a2d562be71beabf5458b0c159e692765871afbf2636ebe19775323a1febed369"}
Sep 17 23:20:02.945965 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:02.945936    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"
Sep 17 23:20:03.017072 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:03.017042    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/245a53a4-1187-425a-b319-87e365dbd6f6-maas-api-service-ca\") pod \"245a53a4-1187-425a-b319-87e365dbd6f6\" (UID: \"245a53a4-1187-425a-b319-87e365dbd6f6\") "
Sep 17 23:20:03.017394 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:03.017368    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/245a53a4-1187-425a-b319-87e365dbd6f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "245a53a4-1187-425a-b319-87e365dbd6f6" (UID: "245a53a4-1187-425a-b319-87e365dbd6f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:20:03.118319 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:03.118227    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/245a53a4-1187-425a-b319-87e365dbd6f6-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:20:03.797628 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:03.797601    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"
Sep 17 23:20:03.797810 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:03.797600    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h" event={"ID":"245a53a4-1187-425a-b319-87e365dbd6f6","Type":"ContainerDied","Data":"d9685f2f2651201f9273562b66de7889129975939600e231e044afdb5091b383"}
Sep 17 23:20:03.797810 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:03.797723    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9685f2f2651201f9273562b66de7889129975939600e231e044afdb5091b383"
Sep 17 23:20:06.924184 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:06.924152    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"]
Sep 17 23:20:06.926720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:06.926696    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-eb3352f3-w7g7h"]
Sep 17 23:20:08.488012 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:08.487977    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="245a53a4-1187-425a-b319-87e365dbd6f6" path="/var/lib/kubelet/pods/245a53a4-1187-425a-b319-87e365dbd6f6/volumes"
Sep 17 23:20:35.622443 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.622408    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"]
Sep 17 23:20:35.622936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.622825    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245a53a4-1187-425a-b319-87e365dbd6f6" containerName="revoke-keys"
Sep 17 23:20:35.622936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.622838    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="245a53a4-1187-425a-b319-87e365dbd6f6" containerName="revoke-keys"
Sep 17 23:20:35.622936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.622923    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="245a53a4-1187-425a-b319-87e365dbd6f6" containerName="revoke-keys"
Sep 17 23:20:35.626363 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.626344    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"
Sep 17 23:20:35.628917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.628892    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:20:35.628917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.628914    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:20:35.633996 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.633974    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"]
Sep 17 23:20:35.671800 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.671768    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb\" (UID: \"90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"
Sep 17 23:20:35.772551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.772523    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb\" (UID: \"90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"
Sep 17 23:20:35.773105 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.773084    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb\" (UID: \"90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"
Sep 17 23:20:35.939793 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:35.939714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"
Sep 17 23:20:36.215864 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:36.215187    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"]
Sep 17 23:20:36.218622 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:20:36.218590    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c95d4a_af37_4bd7_8bb8_2f5d5ac8d38a.slice/crio-879584551c01b08e7abcfd4acd92f6636638ef8e46c0006886adaacfa7e947a1 WatchSource:0}: Error finding container 879584551c01b08e7abcfd4acd92f6636638ef8e46c0006886adaacfa7e947a1: Status 404 returned error can't find the container with id 879584551c01b08e7abcfd4acd92f6636638ef8e46c0006886adaacfa7e947a1
Sep 17 23:20:37.010033 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:37.009995    2583 generic.go:356] "Generic (PLEG): container finished" podID="90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a" containerID="df14cfbeaea3fa99b988da6b0dd5a7c2cf63f49a57ba6cf8ea4bbfe7dc6def86" exitCode=0
Sep 17 23:20:37.010454 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:37.010042    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb" event={"ID":"90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a","Type":"ContainerDied","Data":"df14cfbeaea3fa99b988da6b0dd5a7c2cf63f49a57ba6cf8ea4bbfe7dc6def86"}
Sep 17 23:20:37.010454 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:37.010088    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb" event={"ID":"90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a","Type":"ContainerStarted","Data":"879584551c01b08e7abcfd4acd92f6636638ef8e46c0006886adaacfa7e947a1"}
Sep 17 23:20:38.157911 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.157888    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"
Sep 17 23:20:38.216672 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.216639    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"]
Sep 17 23:20:38.217082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.217069    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a" containerName="revoke-keys"
Sep 17 23:20:38.217148 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.217084    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a" containerName="revoke-keys"
Sep 17 23:20:38.217199 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.217170    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a" containerName="revoke-keys"
Sep 17 23:20:38.220420 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.220396    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.222772 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.222749    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-61e623\"/\"openshift-service-ca.crt\""
Sep 17 23:20:38.223119 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.223100    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-61e623\"/\"autores-model-61e623-kserve-self-signed-certs\""
Sep 17 23:20:38.223119 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.223111    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-61e623\"/\"default-dockercfg-hrrcp\""
Sep 17 23:20:38.223263 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.223245    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-61e623\"/\"kube-root-ca.crt\""
Sep 17 23:20:38.230279 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.230252    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"]
Sep 17 23:20:38.299848 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.299739    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a-maas-api-service-ca\") pod \"90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a\" (UID: \"90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a\") "
Sep 17 23:20:38.300084 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.300065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-home\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.300187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.300101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-dshm\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.300187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.300121    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-model-cache\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.300187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.300140    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5p2q\" (UniqueName: \"kubernetes.io/projected/45051071-7ace-4ae7-9c78-8cbad6c67af9-kube-api-access-m5p2q\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.300187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.300139    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a" (UID: "90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:20:38.300357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.300193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-tmp-dir\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.300357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.300279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45051071-7ace-4ae7-9c78-8cbad6c67af9-tls-certs\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.300434 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.300358    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:20:38.401762 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.401723    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-tmp-dir\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.401948 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.401827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45051071-7ace-4ae7-9c78-8cbad6c67af9-tls-certs\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.401948 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.401928    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-home\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.402056 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.401968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-dshm\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.402056 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.401997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-model-cache\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.402231 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.402204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5p2q\" (UniqueName: \"kubernetes.io/projected/45051071-7ace-4ae7-9c78-8cbad6c67af9-kube-api-access-m5p2q\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.402310 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.402297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-model-cache\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.402379 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.402216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-tmp-dir\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.402445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.402404    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-home\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.404336 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.404309    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-dshm\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.404969 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.404946    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45051071-7ace-4ae7-9c78-8cbad6c67af9-tls-certs\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.409644 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.409623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5p2q\" (UniqueName: \"kubernetes.io/projected/45051071-7ace-4ae7-9c78-8cbad6c67af9-kube-api-access-m5p2q\") pod \"autores-model-61e623-kserve-657f9ccb7f-zkb4z\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") " pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.532513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.532475    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:38.809412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:38.809381    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"]
Sep 17 23:20:38.810487 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:20:38.810452    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45051071_7ace_4ae7_9c78_8cbad6c67af9.slice/crio-a011795fdaecb4c67d451117f37c668e2c038ebbb2ed916a4ab27a9a472d6873 WatchSource:0}: Error finding container a011795fdaecb4c67d451117f37c668e2c038ebbb2ed916a4ab27a9a472d6873: Status 404 returned error can't find the container with id a011795fdaecb4c67d451117f37c668e2c038ebbb2ed916a4ab27a9a472d6873
Sep 17 23:20:39.025402 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:39.025375    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"
Sep 17 23:20:39.025614 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:39.025411    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb" event={"ID":"90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a","Type":"ContainerDied","Data":"879584551c01b08e7abcfd4acd92f6636638ef8e46c0006886adaacfa7e947a1"}
Sep 17 23:20:39.025614 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:39.025458    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="879584551c01b08e7abcfd4acd92f6636638ef8e46c0006886adaacfa7e947a1"
Sep 17 23:20:39.027302 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:39.027267    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z" event={"ID":"45051071-7ace-4ae7-9c78-8cbad6c67af9","Type":"ContainerStarted","Data":"42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2"}
Sep 17 23:20:39.027302 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:39.027304    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z" event={"ID":"45051071-7ace-4ae7-9c78-8cbad6c67af9","Type":"ContainerStarted","Data":"a011795fdaecb4c67d451117f37c668e2c038ebbb2ed916a4ab27a9a472d6873"}
Sep 17 23:20:39.044524 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:39.044440    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z" podStartSLOduration=1.044427787 podStartE2EDuration="1.044427787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:20:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:20:39.043211701 +0000 UTC m=+850.650789377" watchObservedRunningTime="2026-09-17 23:20:39.044427787 +0000 UTC m=+850.652005495"
Sep 17 23:20:42.291473 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:42.291433    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"]
Sep 17 23:20:42.294125 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:42.294104    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5ab8e6b6-hgkvb"]
Sep 17 23:20:42.504500 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:42.504442    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a" path="/var/lib/kubelet/pods/90c95d4a-af37-4bd7-8bb8-2f5d5ac8d38a/volumes"
Sep 17 23:20:48.533257 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:48.533216    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:48.533649 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:48.533275    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:48.545953 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:48.545927    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:20:49.113233 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:20:49.113199    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:21:17.084208 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:17.084123    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"]
Sep 17 23:21:17.087727 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:17.087706    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"
Sep 17 23:21:17.090712 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:17.090694    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:21:17.090913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:17.090900    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:21:17.098209 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:17.097831    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"]
Sep 17 23:21:17.218796 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:17.218767    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f7c79b-1cd6-4869-a993-e7074eb1422f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv\" (UID: \"19f7c79b-1cd6-4869-a993-e7074eb1422f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"
Sep 17 23:21:17.320029 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:17.319998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f7c79b-1cd6-4869-a993-e7074eb1422f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv\" (UID: \"19f7c79b-1cd6-4869-a993-e7074eb1422f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"
Sep 17 23:21:17.320643 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:17.320625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f7c79b-1cd6-4869-a993-e7074eb1422f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv\" (UID: \"19f7c79b-1cd6-4869-a993-e7074eb1422f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"
Sep 17 23:21:17.426387 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:17.426303    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"
Sep 17 23:21:17.701028 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:17.700997    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"]
Sep 17 23:21:17.702344 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:21:17.702319    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f7c79b_1cd6_4869_a993_e7074eb1422f.slice/crio-0db2ba9cb87f4e9cddd4099ab18a8981f9b6642edc690cb312e72b3262f9bd22 WatchSource:0}: Error finding container 0db2ba9cb87f4e9cddd4099ab18a8981f9b6642edc690cb312e72b3262f9bd22: Status 404 returned error can't find the container with id 0db2ba9cb87f4e9cddd4099ab18a8981f9b6642edc690cb312e72b3262f9bd22
Sep 17 23:21:18.276970 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:18.276933    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv" event={"ID":"19f7c79b-1cd6-4869-a993-e7074eb1422f","Type":"ContainerStarted","Data":"ab8048cd4298b20e377dce20aa86d47f5bf2838c31b006d3dc6eda1449422180"}
Sep 17 23:21:18.277371 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:18.276996    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv" event={"ID":"19f7c79b-1cd6-4869-a993-e7074eb1422f","Type":"ContainerStarted","Data":"0db2ba9cb87f4e9cddd4099ab18a8981f9b6642edc690cb312e72b3262f9bd22"}
Sep 17 23:21:18.293189 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:18.293132    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv" podStartSLOduration=1.293116984 podStartE2EDuration="1.293116984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:21:18.291837968 +0000 UTC m=+889.899415648" watchObservedRunningTime="2026-09-17 23:21:18.293116984 +0000 UTC m=+889.900694643"
Sep 17 23:21:19.284915 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:19.284878    2583 generic.go:356] "Generic (PLEG): container finished" podID="19f7c79b-1cd6-4869-a993-e7074eb1422f" containerID="ab8048cd4298b20e377dce20aa86d47f5bf2838c31b006d3dc6eda1449422180" exitCode=0
Sep 17 23:21:19.285324 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:19.284966    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv" event={"ID":"19f7c79b-1cd6-4869-a993-e7074eb1422f","Type":"ContainerDied","Data":"ab8048cd4298b20e377dce20aa86d47f5bf2838c31b006d3dc6eda1449422180"}
Sep 17 23:21:20.424383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:20.424360    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"
Sep 17 23:21:20.556184 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:20.556096    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f7c79b-1cd6-4869-a993-e7074eb1422f-maas-api-service-ca\") pod \"19f7c79b-1cd6-4869-a993-e7074eb1422f\" (UID: \"19f7c79b-1cd6-4869-a993-e7074eb1422f\") "
Sep 17 23:21:20.556555 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:20.556534    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f7c79b-1cd6-4869-a993-e7074eb1422f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "19f7c79b-1cd6-4869-a993-e7074eb1422f" (UID: "19f7c79b-1cd6-4869-a993-e7074eb1422f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:21:20.657634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:20.657599    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f7c79b-1cd6-4869-a993-e7074eb1422f-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:21:21.299247 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.299218    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"
Sep 17 23:21:21.299433 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.299269    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv" event={"ID":"19f7c79b-1cd6-4869-a993-e7074eb1422f","Type":"ContainerDied","Data":"0db2ba9cb87f4e9cddd4099ab18a8981f9b6642edc690cb312e72b3262f9bd22"}
Sep 17 23:21:21.299433 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.299321    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0db2ba9cb87f4e9cddd4099ab18a8981f9b6642edc690cb312e72b3262f9bd22"
Sep 17 23:21:21.448036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.448004    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"]
Sep 17 23:21:21.448516 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.448247    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl" podUID="5fc5d882-af12-41dd-88b1-de7f3df177d5" containerName="payload-pre-processing" containerID="cri-o://2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7" gracePeriod=30
Sep 17 23:21:21.706440 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.706409    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:21:21.782095 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.782064    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fc5d882-af12-41dd-88b1-de7f3df177d5-plugins-config-volume\") pod \"5fc5d882-af12-41dd-88b1-de7f3df177d5\" (UID: \"5fc5d882-af12-41dd-88b1-de7f3df177d5\") "
Sep 17 23:21:21.782262 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.782223    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54vnh\" (UniqueName: \"kubernetes.io/projected/5fc5d882-af12-41dd-88b1-de7f3df177d5-kube-api-access-54vnh\") pod \"5fc5d882-af12-41dd-88b1-de7f3df177d5\" (UID: \"5fc5d882-af12-41dd-88b1-de7f3df177d5\") "
Sep 17 23:21:21.782442 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.782416    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fc5d882-af12-41dd-88b1-de7f3df177d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5fc5d882-af12-41dd-88b1-de7f3df177d5" (UID: "5fc5d882-af12-41dd-88b1-de7f3df177d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:21:21.782638 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.782621    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fc5d882-af12-41dd-88b1-de7f3df177d5-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:21:21.784384 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.784358    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc5d882-af12-41dd-88b1-de7f3df177d5-kube-api-access-54vnh" (OuterVolumeSpecName: "kube-api-access-54vnh") pod "5fc5d882-af12-41dd-88b1-de7f3df177d5" (UID: "5fc5d882-af12-41dd-88b1-de7f3df177d5"). InnerVolumeSpecName "kube-api-access-54vnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:21:21.883500 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:21.883378    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54vnh\" (UniqueName: \"kubernetes.io/projected/5fc5d882-af12-41dd-88b1-de7f3df177d5-kube-api-access-54vnh\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:21:22.306902 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:22.306863    2583 generic.go:356] "Generic (PLEG): container finished" podID="5fc5d882-af12-41dd-88b1-de7f3df177d5" containerID="2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7" exitCode=0
Sep 17 23:21:22.307077 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:22.306913    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"
Sep 17 23:21:22.307077 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:22.306943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl" event={"ID":"5fc5d882-af12-41dd-88b1-de7f3df177d5","Type":"ContainerDied","Data":"2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7"}
Sep 17 23:21:22.307077 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:22.307019    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl" event={"ID":"5fc5d882-af12-41dd-88b1-de7f3df177d5","Type":"ContainerDied","Data":"01d74c5b2ff0863b18a16296a3d017f7ec3dc7b28bcdd5d2b738a124ab30eb9c"}
Sep 17 23:21:22.307077 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:22.307041    2583 scope.go:117] "RemoveContainer" containerID="2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7"
Sep 17 23:21:22.316936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:22.316919    2583 scope.go:117] "RemoveContainer" containerID="2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7"
Sep 17 23:21:22.317232 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:21:22.317214    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7\": container with ID starting with 2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7 not found: ID does not exist" containerID="2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7"
Sep 17 23:21:22.317279 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:22.317241    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7"} err="failed to get container status \"2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7\": rpc error: code = NotFound desc = could not find container \"2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7\": container with ID starting with 2ddf2f4f6d86e7dd8ebd05e45b95fe3d27c80eaf2b22c7db1bb52af35306dbe7 not found: ID does not exist"
Sep 17 23:21:22.328766 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:22.328736    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"]
Sep 17 23:21:22.332535 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:22.332514    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl"]
Sep 17 23:21:22.488541 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:22.488511    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fc5d882-af12-41dd-88b1-de7f3df177d5" path="/var/lib/kubelet/pods/5fc5d882-af12-41dd-88b1-de7f3df177d5/volumes"
Sep 17 23:21:26.944917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:26.944882    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"]
Sep 17 23:21:29.419221 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:29.419183    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"]
Sep 17 23:21:29.421823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:29.421793    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-46ccf8cf-kvfzv"]
Sep 17 23:21:30.489821 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:30.489788    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19f7c79b-1cd6-4869-a993-e7074eb1422f" path="/var/lib/kubelet/pods/19f7c79b-1cd6-4869-a993-e7074eb1422f/volumes"
Sep 17 23:21:41.970930 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:41.970867    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z" podUID="45051071-7ace-4ae7-9c78-8cbad6c67af9" containerName="main" containerID="cri-o://42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2" gracePeriod=45
Sep 17 23:21:42.228013 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.227952    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:21:42.308530 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.308448    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-home\") pod \"45051071-7ace-4ae7-9c78-8cbad6c67af9\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") "
Sep 17 23:21:42.308720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.308549    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-tmp-dir\") pod \"45051071-7ace-4ae7-9c78-8cbad6c67af9\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") "
Sep 17 23:21:42.308720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.308577    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-dshm\") pod \"45051071-7ace-4ae7-9c78-8cbad6c67af9\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") "
Sep 17 23:21:42.308720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.308614    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5p2q\" (UniqueName: \"kubernetes.io/projected/45051071-7ace-4ae7-9c78-8cbad6c67af9-kube-api-access-m5p2q\") pod \"45051071-7ace-4ae7-9c78-8cbad6c67af9\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") "
Sep 17 23:21:42.308720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.308671    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-model-cache\") pod \"45051071-7ace-4ae7-9c78-8cbad6c67af9\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") "
Sep 17 23:21:42.308720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.308699    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45051071-7ace-4ae7-9c78-8cbad6c67af9-tls-certs\") pod \"45051071-7ace-4ae7-9c78-8cbad6c67af9\" (UID: \"45051071-7ace-4ae7-9c78-8cbad6c67af9\") "
Sep 17 23:21:42.308998 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.308743    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-home" (OuterVolumeSpecName: "home") pod "45051071-7ace-4ae7-9c78-8cbad6c67af9" (UID: "45051071-7ace-4ae7-9c78-8cbad6c67af9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:21:42.308998 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.308781    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "45051071-7ace-4ae7-9c78-8cbad6c67af9" (UID: "45051071-7ace-4ae7-9c78-8cbad6c67af9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:21:42.308998 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.308974    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-model-cache" (OuterVolumeSpecName: "model-cache") pod "45051071-7ace-4ae7-9c78-8cbad6c67af9" (UID: "45051071-7ace-4ae7-9c78-8cbad6c67af9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:21:42.309117 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.309095    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:21:42.309117 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.309110    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:21:42.309117 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.309120    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:21:42.310872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.310843    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-dshm" (OuterVolumeSpecName: "dshm") pod "45051071-7ace-4ae7-9c78-8cbad6c67af9" (UID: "45051071-7ace-4ae7-9c78-8cbad6c67af9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:21:42.310872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.310855    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45051071-7ace-4ae7-9c78-8cbad6c67af9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "45051071-7ace-4ae7-9c78-8cbad6c67af9" (UID: "45051071-7ace-4ae7-9c78-8cbad6c67af9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:21:42.311012 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.310901    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45051071-7ace-4ae7-9c78-8cbad6c67af9-kube-api-access-m5p2q" (OuterVolumeSpecName: "kube-api-access-m5p2q") pod "45051071-7ace-4ae7-9c78-8cbad6c67af9" (UID: "45051071-7ace-4ae7-9c78-8cbad6c67af9"). InnerVolumeSpecName "kube-api-access-m5p2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:21:42.410532 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.410493    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45051071-7ace-4ae7-9c78-8cbad6c67af9-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:21:42.410532 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.410528    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5p2q\" (UniqueName: \"kubernetes.io/projected/45051071-7ace-4ae7-9c78-8cbad6c67af9-kube-api-access-m5p2q\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:21:42.410532 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.410542    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45051071-7ace-4ae7-9c78-8cbad6c67af9-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:21:42.430529 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.430495    2583 generic.go:356] "Generic (PLEG): container finished" podID="45051071-7ace-4ae7-9c78-8cbad6c67af9" containerID="42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2" exitCode=0
Sep 17 23:21:42.430529 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.430531    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"
Sep 17 23:21:42.430759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.430576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z" event={"ID":"45051071-7ace-4ae7-9c78-8cbad6c67af9","Type":"ContainerDied","Data":"42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2"}
Sep 17 23:21:42.430759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.430629    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z" event={"ID":"45051071-7ace-4ae7-9c78-8cbad6c67af9","Type":"ContainerDied","Data":"a011795fdaecb4c67d451117f37c668e2c038ebbb2ed916a4ab27a9a472d6873"}
Sep 17 23:21:42.430759 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.430654    2583 scope.go:117] "RemoveContainer" containerID="42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2"
Sep 17 23:21:42.440545 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.440528    2583 scope.go:117] "RemoveContainer" containerID="42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2"
Sep 17 23:21:42.440837 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:21:42.440816    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2\": container with ID starting with 42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2 not found: ID does not exist" containerID="42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2"
Sep 17 23:21:42.440910 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.440847    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2"} err="failed to get container status \"42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2\": rpc error: code = NotFound desc = could not find container \"42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2\": container with ID starting with 42a99ff3a7d0cd9cdefd6cd74ceaa549ff45f4c0a403774b0e4d72bcee0c7ae2 not found: ID does not exist"
Sep 17 23:21:42.451523 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.451499    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"]
Sep 17 23:21:42.455701 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.455674    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-61e623/autores-model-61e623-kserve-657f9ccb7f-zkb4z"]
Sep 17 23:21:42.494558 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:42.494456    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45051071-7ace-4ae7-9c78-8cbad6c67af9" path="/var/lib/kubelet/pods/45051071-7ace-4ae7-9c78-8cbad6c67af9/volumes"
Sep 17 23:21:55.403753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.403713    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"]
Sep 17 23:21:55.404224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.404168    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45051071-7ace-4ae7-9c78-8cbad6c67af9" containerName="main"
Sep 17 23:21:55.404224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.404180    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="45051071-7ace-4ae7-9c78-8cbad6c67af9" containerName="main"
Sep 17 23:21:55.404224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.404207    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19f7c79b-1cd6-4869-a993-e7074eb1422f" containerName="revoke-keys"
Sep 17 23:21:55.404224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.404213    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="19f7c79b-1cd6-4869-a993-e7074eb1422f" containerName="revoke-keys"
Sep 17 23:21:55.404224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.404224    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc5d882-af12-41dd-88b1-de7f3df177d5" containerName="payload-pre-processing"
Sep 17 23:21:55.404385 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.404229    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc5d882-af12-41dd-88b1-de7f3df177d5" containerName="payload-pre-processing"
Sep 17 23:21:55.404385 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.404309    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="45051071-7ace-4ae7-9c78-8cbad6c67af9" containerName="main"
Sep 17 23:21:55.404385 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.404322    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="19f7c79b-1cd6-4869-a993-e7074eb1422f" containerName="revoke-keys"
Sep 17 23:21:55.404385 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.404328    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc5d882-af12-41dd-88b1-de7f3df177d5" containerName="payload-pre-processing"
Sep 17 23:21:55.407669 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.407643    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.410211 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.410188    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-736809\"/\"premium-w0-736809-kserve-self-signed-certs\""
Sep 17 23:21:55.417004 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.416978    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"]
Sep 17 23:21:55.436387 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.436352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-tmp-dir\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.436550 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.436408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-home\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.436550 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.436428    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-model-cache\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.436550 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.436453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vpw6\" (UniqueName: \"kubernetes.io/projected/3366b1a3-96f0-480e-a818-16283b2e9558-kube-api-access-6vpw6\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.436550 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.436515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3366b1a3-96f0-480e-a818-16283b2e9558-tls-certs\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.436694 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.436575    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-dshm\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.537593 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.537548    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-home\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.537593 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.537596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-model-cache\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.537828 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.537630    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpw6\" (UniqueName: \"kubernetes.io/projected/3366b1a3-96f0-480e-a818-16283b2e9558-kube-api-access-6vpw6\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.537828 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.537665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3366b1a3-96f0-480e-a818-16283b2e9558-tls-certs\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.537828 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.537752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-dshm\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.537828 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.537785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-tmp-dir\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.538063 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.538039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-home\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.538190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.538056    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-model-cache\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.538190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.538159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-tmp-dir\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.540110 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.540087    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-dshm\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.540278 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.540261    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3366b1a3-96f0-480e-a818-16283b2e9558-tls-certs\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.545172 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.545152    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vpw6\" (UniqueName: \"kubernetes.io/projected/3366b1a3-96f0-480e-a818-16283b2e9558-kube-api-access-6vpw6\") pod \"premium-w0-736809-kserve-589b7479b5-zpf7c\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") " pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.719644 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.719545    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:21:55.993242 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:55.993212    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"]
Sep 17 23:21:55.994726 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:21:55.994695    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3366b1a3_96f0_480e_a818_16283b2e9558.slice/crio-f8d490bd62be5aec0d571b54c72346eff9c240c7cc21e7eec1cd1dbd4ed4697b WatchSource:0}: Error finding container f8d490bd62be5aec0d571b54c72346eff9c240c7cc21e7eec1cd1dbd4ed4697b: Status 404 returned error can't find the container with id f8d490bd62be5aec0d571b54c72346eff9c240c7cc21e7eec1cd1dbd4ed4697b
Sep 17 23:21:56.517413 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:56.517377    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c" event={"ID":"3366b1a3-96f0-480e-a818-16283b2e9558","Type":"ContainerStarted","Data":"c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9"}
Sep 17 23:21:56.517848 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:56.517425    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c" event={"ID":"3366b1a3-96f0-480e-a818-16283b2e9558","Type":"ContainerStarted","Data":"f8d490bd62be5aec0d571b54c72346eff9c240c7cc21e7eec1cd1dbd4ed4697b"}
Sep 17 23:21:56.536445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:21:56.536397    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c" podStartSLOduration=1.536380869 podStartE2EDuration="1.536380869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:21:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:21:56.535116254 +0000 UTC m=+928.142693914" watchObservedRunningTime="2026-09-17 23:21:56.536380869 +0000 UTC m=+928.143958528"
Sep 17 23:22:04.347509 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:04.347475    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"]
Sep 17 23:22:04.347928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:04.347674    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy" containerID="cri-o://435e0ad52175b97e9cd90fc631bb3ff9aa57708298c119bffbc54b1f7df91854" gracePeriod=30
Sep 17 23:22:05.719768 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:05.719731    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:22:05.720164 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:05.719811    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:22:05.732856 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:05.732830    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:22:06.592260 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:06.592235    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:22:09.606956 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.606925    2583 generic.go:356] "Generic (PLEG): container finished" podID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerID="435e0ad52175b97e9cd90fc631bb3ff9aa57708298c119bffbc54b1f7df91854" exitCode=0
Sep 17 23:22:09.607362 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.606998    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" event={"ID":"9bcb1827-6071-4063-8635-23c24a7e4f26","Type":"ContainerDied","Data":"435e0ad52175b97e9cd90fc631bb3ff9aa57708298c119bffbc54b1f7df91854"}
Sep 17 23:22:09.607362 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.607054    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd" event={"ID":"9bcb1827-6071-4063-8635-23c24a7e4f26","Type":"ContainerDied","Data":"65bcac03d161570c2fc43b0f381a5bd76fc818e2e05d991ccdab886d48d19ad5"}
Sep 17 23:22:09.607362 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.607078    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65bcac03d161570c2fc43b0f381a5bd76fc818e2e05d991ccdab886d48d19ad5"
Sep 17 23:22:09.607362 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.607094    2583 scope.go:117] "RemoveContainer" containerID="e43b7d59ced69165959567ae3bebd6e9451f83205ef6f42422a6296e6cfe9a9b"
Sep 17 23:22:09.614713 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.614689    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:22:09.693345 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693307    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf74m\" (UniqueName: \"kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-kube-api-access-vf74m\") pod \"9bcb1827-6071-4063-8635-23c24a7e4f26\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") "
Sep 17 23:22:09.693562 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693356    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-socket\") pod \"9bcb1827-6071-4063-8635-23c24a7e4f26\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") "
Sep 17 23:22:09.693562 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693399    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-certs\") pod \"9bcb1827-6071-4063-8635-23c24a7e4f26\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") "
Sep 17 23:22:09.693562 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693431    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-token\") pod \"9bcb1827-6071-4063-8635-23c24a7e4f26\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") "
Sep 17 23:22:09.693562 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693455    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bcb1827-6071-4063-8635-23c24a7e4f26-istiod-ca-cert\") pod \"9bcb1827-6071-4063-8635-23c24a7e4f26\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") "
Sep 17 23:22:09.693776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693582    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-envoy\") pod \"9bcb1827-6071-4063-8635-23c24a7e4f26\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") "
Sep 17 23:22:09.693776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693632    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-podinfo\") pod \"9bcb1827-6071-4063-8635-23c24a7e4f26\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") "
Sep 17 23:22:09.693776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693660    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-data\") pod \"9bcb1827-6071-4063-8635-23c24a7e4f26\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") "
Sep 17 23:22:09.693776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693710    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-credential-socket\") pod \"9bcb1827-6071-4063-8635-23c24a7e4f26\" (UID: \"9bcb1827-6071-4063-8635-23c24a7e4f26\") "
Sep 17 23:22:09.693776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693746    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9bcb1827-6071-4063-8635-23c24a7e4f26" (UID: "9bcb1827-6071-4063-8635-23c24a7e4f26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:22:09.694038 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693755    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9bcb1827-6071-4063-8635-23c24a7e4f26" (UID: "9bcb1827-6071-4063-8635-23c24a7e4f26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:22:09.694038 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.693936    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bcb1827-6071-4063-8635-23c24a7e4f26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9bcb1827-6071-4063-8635-23c24a7e4f26" (UID: "9bcb1827-6071-4063-8635-23c24a7e4f26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:22:09.694141 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.694025    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-data" (OuterVolumeSpecName: "istio-data") pod "9bcb1827-6071-4063-8635-23c24a7e4f26" (UID: "9bcb1827-6071-4063-8635-23c24a7e4f26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:22:09.694201 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.694135    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-data\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:22:09.694201 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.694158    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:22:09.694201 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.694173    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-workload-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:22:09.694201 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.694188    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bcb1827-6071-4063-8635-23c24a7e4f26-istiod-ca-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:22:09.694362 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.694230    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9bcb1827-6071-4063-8635-23c24a7e4f26" (UID: "9bcb1827-6071-4063-8635-23c24a7e4f26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:22:09.695648 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.695628    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-kube-api-access-vf74m" (OuterVolumeSpecName: "kube-api-access-vf74m") pod "9bcb1827-6071-4063-8635-23c24a7e4f26" (UID: "9bcb1827-6071-4063-8635-23c24a7e4f26"). InnerVolumeSpecName "kube-api-access-vf74m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:22:09.695836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.695820    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9bcb1827-6071-4063-8635-23c24a7e4f26" (UID: "9bcb1827-6071-4063-8635-23c24a7e4f26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:22:09.696075 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.696048    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9bcb1827-6071-4063-8635-23c24a7e4f26" (UID: "9bcb1827-6071-4063-8635-23c24a7e4f26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:22:09.696177 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.696086    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-token" (OuterVolumeSpecName: "istio-token") pod "9bcb1827-6071-4063-8635-23c24a7e4f26" (UID: "9bcb1827-6071-4063-8635-23c24a7e4f26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:22:09.795505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.795455    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-credential-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:22:09.795505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.795504    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf74m\" (UniqueName: \"kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-kube-api-access-vf74m\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:22:09.795505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.795515    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:22:09.795505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.795524    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-envoy\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:22:09.795784 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:09.795532    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bcb1827-6071-4063-8635-23c24a7e4f26-istio-podinfo\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:22:10.614010 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:10.613975    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"
Sep 17 23:22:10.658426 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:10.658391    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"]
Sep 17 23:22:10.663108 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:10.663080    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd"]
Sep 17 23:22:12.487927 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:12.487896    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" path="/var/lib/kubelet/pods/9bcb1827-6071-4063-8635-23c24a7e4f26/volumes"
Sep 17 23:22:31.306022 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.305992    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"]
Sep 17 23:22:31.306415 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.306376    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy"
Sep 17 23:22:31.306415 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.306386    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy"
Sep 17 23:22:31.306415 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.306403    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy"
Sep 17 23:22:31.306415 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.306409    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy"
Sep 17 23:22:31.306581 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.306495    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy"
Sep 17 23:22:31.306581 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.306506    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bcb1827-6071-4063-8635-23c24a7e4f26" containerName="istio-proxy"
Sep 17 23:22:31.310758 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.310738    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.313106 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.313084    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f38e68\"/\"openshift-service-ca.crt\""
Sep 17 23:22:31.314212 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.314191    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f38e68\"/\"default-dockercfg-5qvwb\""
Sep 17 23:22:31.314303 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.314219    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f38e68\"/\"kube-root-ca.crt\""
Sep 17 23:22:31.314303 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.314234    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f38e68\"/\"test-model-f38e68-kserve-self-signed-certs\""
Sep 17 23:22:31.318229 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.318204    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"]
Sep 17 23:22:31.409296 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.409261    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-model-cache\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.409475 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.409367    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-tmp-dir\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.409475 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.409402    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-dshm\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.409584 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.409488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/731f4442-d99d-4a70-a76a-99049546ba98-tls-certs\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.409584 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.409531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc7nt\" (UniqueName: \"kubernetes.io/projected/731f4442-d99d-4a70-a76a-99049546ba98-kube-api-access-tc7nt\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.409656 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.409628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-home\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.511123 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.511086    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-home\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.511123 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.511130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-model-cache\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.511378 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.511175    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-tmp-dir\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.511378 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.511193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-dshm\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.511378 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.511244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/731f4442-d99d-4a70-a76a-99049546ba98-tls-certs\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.511378 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.511270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7nt\" (UniqueName: \"kubernetes.io/projected/731f4442-d99d-4a70-a76a-99049546ba98-kube-api-access-tc7nt\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.511625 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.511591    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-home\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.511684 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.511658    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-tmp-dir\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.511732 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.511686    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-model-cache\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.513573 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.513545    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-dshm\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.513874 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.513856    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/731f4442-d99d-4a70-a76a-99049546ba98-tls-certs\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.519237 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.519215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc7nt\" (UniqueName: \"kubernetes.io/projected/731f4442-d99d-4a70-a76a-99049546ba98-kube-api-access-tc7nt\") pod \"test-model-f38e68-kserve-544c49cb85-9qx5z\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") " pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.621117 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.621031    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:31.900687 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:31.900661    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"]
Sep 17 23:22:31.902001 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:22:31.901963    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod731f4442_d99d_4a70_a76a_99049546ba98.slice/crio-23c17365ca0bf191d1d97a59914bbf897de60cb3fc5fe8528fb07a4e178fe68b WatchSource:0}: Error finding container 23c17365ca0bf191d1d97a59914bbf897de60cb3fc5fe8528fb07a4e178fe68b: Status 404 returned error can't find the container with id 23c17365ca0bf191d1d97a59914bbf897de60cb3fc5fe8528fb07a4e178fe68b
Sep 17 23:22:32.765708 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:32.765655    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z" event={"ID":"731f4442-d99d-4a70-a76a-99049546ba98","Type":"ContainerStarted","Data":"20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e"}
Sep 17 23:22:32.765708 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:32.765707    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z" event={"ID":"731f4442-d99d-4a70-a76a-99049546ba98","Type":"ContainerStarted","Data":"23c17365ca0bf191d1d97a59914bbf897de60cb3fc5fe8528fb07a4e178fe68b"}
Sep 17 23:22:32.797279 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:32.797224    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z" podStartSLOduration=1.797205283 podStartE2EDuration="1.797205283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:22:32.793908011 +0000 UTC m=+964.401485694" watchObservedRunningTime="2026-09-17 23:22:32.797205283 +0000 UTC m=+964.404782943"
Sep 17 23:22:41.621395 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:41.621362    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:41.621962 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:41.621419    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:41.633801 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:41.633779    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:22:41.832073 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:22:41.832043    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:23:04.865222 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.865127    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"]
Sep 17 23:23:04.868761 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.868739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:04.871898 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.871871    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-85682bb8-openshift-default-dockercfg-zz8pq\""
Sep 17 23:23:04.880814 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.880789    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"]
Sep 17 23:23:04.948650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.948612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-certs\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:04.948857 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.948659    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-data\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:04.948857 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.948697    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-credential-socket\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:04.948857 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.948735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-envoy\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:04.948857 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.948833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-token\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:04.949062 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.948856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-socket\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:04.949062 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.948924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istiod-ca-cert\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:04.949062 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.949016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-podinfo\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:04.949188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:04.949067    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kw8w\" (UniqueName: \"kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-kube-api-access-7kw8w\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.050361 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-token\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.050361 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-socket\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.050676 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istiod-ca-cert\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.050676 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-podinfo\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.050676 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kw8w\" (UniqueName: \"kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-kube-api-access-7kw8w\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.050676 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-certs\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.050676 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-data\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.050676 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-credential-socket\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.050963 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-envoy\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.050963 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050835    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-socket\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.051035 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.050991    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-certs\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.051095 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.051074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-data\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.051206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.051189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istiod-ca-cert\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.051263 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.051202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-credential-socket\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.053021 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.053002    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-envoy\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.053080 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.053062    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-podinfo\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.058733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.058698    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-token\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.059070 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.059054    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kw8w\" (UniqueName: \"kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-kube-api-access-7kw8w\") pod \"e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") " pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.182383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.182302    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:05.516210 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:23:05.516175    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13e1d6f_1fb7_4121_858c_7fe82ec156eb.slice/crio-6d630f0876158b5dc7f6ae6598af8d8a266d5e8daf77382d5f380bfc1dcca7b5 WatchSource:0}: Error finding container 6d630f0876158b5dc7f6ae6598af8d8a266d5e8daf77382d5f380bfc1dcca7b5: Status 404 returned error can't find the container with id 6d630f0876158b5dc7f6ae6598af8d8a266d5e8daf77382d5f380bfc1dcca7b5
Sep 17 23:23:05.518923 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.518849    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:23:05.519036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.518976    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:23:05.519036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.519025    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:23:05.519396 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.519372    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"]
Sep 17 23:23:05.977813 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.977775    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" event={"ID":"a13e1d6f-1fb7-4121-858c-7fe82ec156eb","Type":"ContainerStarted","Data":"fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613"}
Sep 17 23:23:05.978213 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:05.977832    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" event={"ID":"a13e1d6f-1fb7-4121-858c-7fe82ec156eb","Type":"ContainerStarted","Data":"6d630f0876158b5dc7f6ae6598af8d8a266d5e8daf77382d5f380bfc1dcca7b5"}
Sep 17 23:23:06.000528 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:06.000441    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" podStartSLOduration=2.000424117 podStartE2EDuration="2.000424117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:23:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:23:05.998108876 +0000 UTC m=+997.605686562" watchObservedRunningTime="2026-09-17 23:23:06.000424117 +0000 UTC m=+997.608001778"
Sep 17 23:23:06.183395 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:06.183357    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:06.188138 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:06.188115    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:06.985682 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:06.985651    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:06.986624 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:06.986605    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:15.990053 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:15.990023    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"]
Sep 17 23:23:15.993852 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:15.993824    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:15.997267 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:15.997247    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-85682bb8-dockercfg-nj6bb\""
Sep 17 23:23:15.997744 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:15.997729    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-85682bb8\""
Sep 17 23:23:16.005631 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:16.005607    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"]
Sep 17 23:23:16.066452 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:16.066411    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56dc9\" (UniqueName: \"kubernetes.io/projected/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-kube-api-access-56dc9\") pod \"payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8\" (UID: \"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b\") " pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:16.066961 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:16.066934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-plugins-config-volume\") pod \"payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8\" (UID: \"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b\") " pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:16.168655 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:16.168612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-plugins-config-volume\") pod \"payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8\" (UID: \"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b\") " pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:16.168655 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:16.168662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56dc9\" (UniqueName: \"kubernetes.io/projected/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-kube-api-access-56dc9\") pod \"payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8\" (UID: \"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b\") " pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:16.169621 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:16.169598    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-plugins-config-volume\") pod \"payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8\" (UID: \"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b\") " pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:16.177515 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:16.177494    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56dc9\" (UniqueName: \"kubernetes.io/projected/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-kube-api-access-56dc9\") pod \"payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8\" (UID: \"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b\") " pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:16.305732 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:16.305699    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:16.579336 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:16.579303    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"]
Sep 17 23:23:16.580257 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:23:16.580229    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dac2794_b53e_4a2d_8ea9_8cc4c5b36a7b.slice/crio-feaf0c6e9d768d2a3a9a676e8178ea26fb26c3a41a1ae3399d84af8e55048606 WatchSource:0}: Error finding container feaf0c6e9d768d2a3a9a676e8178ea26fb26c3a41a1ae3399d84af8e55048606: Status 404 returned error can't find the container with id feaf0c6e9d768d2a3a9a676e8178ea26fb26c3a41a1ae3399d84af8e55048606
Sep 17 23:23:17.054919 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:17.054881    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8" event={"ID":"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b","Type":"ContainerStarted","Data":"6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e"}
Sep 17 23:23:17.055325 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:17.054946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8" event={"ID":"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b","Type":"ContainerStarted","Data":"feaf0c6e9d768d2a3a9a676e8178ea26fb26c3a41a1ae3399d84af8e55048606"}
Sep 17 23:23:17.055325 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:17.055079    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:17.087817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:17.087764    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8" podStartSLOduration=2.08774814 podStartE2EDuration="2.08774814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:23:17.086708628 +0000 UTC m=+1008.694286289" watchObservedRunningTime="2026-09-17 23:23:17.08774814 +0000 UTC m=+1008.695325800"
Sep 17 23:23:28.064617 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:28.064583    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:44.241010 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:44.240976    2583 generic.go:356] "Generic (PLEG): container finished" podID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerID="fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613" exitCode=0
Sep 17 23:23:44.241494 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:44.241045    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" event={"ID":"a13e1d6f-1fb7-4121-858c-7fe82ec156eb","Type":"ContainerDied","Data":"fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613"}
Sep 17 23:23:44.241494 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:44.241449    2583 scope.go:117] "RemoveContainer" containerID="fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613"
Sep 17 23:23:44.242610 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:44.242579    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:23:44.242697 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:44.242667    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:23:44.242755 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:44.242721    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:23:45.253579 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:45.253542    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" event={"ID":"a13e1d6f-1fb7-4121-858c-7fe82ec156eb","Type":"ContainerStarted","Data":"a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2"}
Sep 17 23:23:46.183321 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:46.183282    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:46.183606 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:46.183579    2583 patch_prober.go:28] interesting pod/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 17 23:23:46.183701 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:46.183641    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 17 23:23:47.183013 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:47.182975    2583 patch_prober.go:28] interesting pod/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 17 23:23:47.183508 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:47.183036    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 17 23:23:48.182847 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.182805    2583 patch_prober.go:28] interesting pod/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 17 23:23:48.183038 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.182864    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 17 23:23:48.274099 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.274027    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"]
Sep 17 23:23:48.280868 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.280841    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"
Sep 17 23:23:48.284091 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.284064    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:23:48.284514 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.284494    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:23:48.285556 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.285226    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"]
Sep 17 23:23:48.406032 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.405978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/359384c0-3f5b-4a53-a173-e2b63f740cb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-85682bb8-np6pt\" (UID: \"359384c0-3f5b-4a53-a173-e2b63f740cb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"
Sep 17 23:23:48.507606 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.507517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/359384c0-3f5b-4a53-a173-e2b63f740cb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-85682bb8-np6pt\" (UID: \"359384c0-3f5b-4a53-a173-e2b63f740cb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"
Sep 17 23:23:48.508127 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.508108    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/359384c0-3f5b-4a53-a173-e2b63f740cb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-85682bb8-np6pt\" (UID: \"359384c0-3f5b-4a53-a173-e2b63f740cb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"
Sep 17 23:23:48.593994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.593961    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"
Sep 17 23:23:48.889767 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:48.889740    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"]
Sep 17 23:23:49.183005 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:49.182966    2583 patch_prober.go:28] interesting pod/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 17 23:23:49.183176 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:49.183023    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 17 23:23:49.292541 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:49.292502    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt" event={"ID":"359384c0-3f5b-4a53-a173-e2b63f740cb5","Type":"ContainerStarted","Data":"98973184c2c354a85b199400cf313f5312fc26a4096c556d8d0ecc1e2082cad3"}
Sep 17 23:23:49.292711 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:49.292605    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt" event={"ID":"359384c0-3f5b-4a53-a173-e2b63f740cb5","Type":"ContainerStarted","Data":"24d36416151bbabf96a1aa9b8bdabf86825744643199e5577f3c5a64054cc981"}
Sep 17 23:23:49.309586 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:49.309537    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt" podStartSLOduration=1.3095215900000001 podStartE2EDuration="1.30952159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:23:49.30748996 +0000 UTC m=+1040.915067648" watchObservedRunningTime="2026-09-17 23:23:49.30952159 +0000 UTC m=+1040.917099249"
Sep 17 23:23:50.183042 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:50.182953    2583 patch_prober.go:28] interesting pod/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 17 23:23:50.183042 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:50.183027    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 17 23:23:50.302521 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:50.302441    2583 generic.go:356] "Generic (PLEG): container finished" podID="359384c0-3f5b-4a53-a173-e2b63f740cb5" containerID="98973184c2c354a85b199400cf313f5312fc26a4096c556d8d0ecc1e2082cad3" exitCode=0
Sep 17 23:23:50.302796 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:50.302754    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt" event={"ID":"359384c0-3f5b-4a53-a173-e2b63f740cb5","Type":"ContainerDied","Data":"98973184c2c354a85b199400cf313f5312fc26a4096c556d8d0ecc1e2082cad3"}
Sep 17 23:23:51.187000 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:51.186968    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:51.187458 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:51.187226    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:51.187915 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:51.187897    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:23:51.487995 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:51.487970    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"
Sep 17 23:23:51.540527 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:51.540489    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/359384c0-3f5b-4a53-a173-e2b63f740cb5-maas-api-service-ca\") pod \"359384c0-3f5b-4a53-a173-e2b63f740cb5\" (UID: \"359384c0-3f5b-4a53-a173-e2b63f740cb5\") "
Sep 17 23:23:51.540819 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:51.540798    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359384c0-3f5b-4a53-a173-e2b63f740cb5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "359384c0-3f5b-4a53-a173-e2b63f740cb5" (UID: "359384c0-3f5b-4a53-a173-e2b63f740cb5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:23:51.641613 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:51.641575    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/359384c0-3f5b-4a53-a173-e2b63f740cb5-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:23:52.316595 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:52.316560    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"
Sep 17 23:23:52.317049 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:52.316599    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt" event={"ID":"359384c0-3f5b-4a53-a173-e2b63f740cb5","Type":"ContainerDied","Data":"24d36416151bbabf96a1aa9b8bdabf86825744643199e5577f3c5a64054cc981"}
Sep 17 23:23:52.317049 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:52.316675    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24d36416151bbabf96a1aa9b8bdabf86825744643199e5577f3c5a64054cc981"
Sep 17 23:23:58.780892 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:58.780857    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"]
Sep 17 23:23:58.781364 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:58.781112    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8" podUID="6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b" containerName="payload-processing" containerID="cri-o://6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e" gracePeriod=30
Sep 17 23:23:58.947436 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:58.947387    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"]
Sep 17 23:23:58.950771 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:58.950741    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85682bb8-np6pt"]
Sep 17 23:23:59.052488 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.049079    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:59.118983 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.118944    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-plugins-config-volume\") pod \"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b\" (UID: \"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b\") "
Sep 17 23:23:59.119215 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.119003    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56dc9\" (UniqueName: \"kubernetes.io/projected/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-kube-api-access-56dc9\") pod \"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b\" (UID: \"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b\") "
Sep 17 23:23:59.119355 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.119331    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b" (UID: "6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:23:59.122426 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.122382    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-kube-api-access-56dc9" (OuterVolumeSpecName: "kube-api-access-56dc9") pod "6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b" (UID: "6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b"). InnerVolumeSpecName "kube-api-access-56dc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:23:59.220270 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.220236    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:23:59.220270 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.220264    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56dc9\" (UniqueName: \"kubernetes.io/projected/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b-kube-api-access-56dc9\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:23:59.365576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.365485    2583 generic.go:356] "Generic (PLEG): container finished" podID="6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b" containerID="6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e" exitCode=0
Sep 17 23:23:59.365576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.365530    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"
Sep 17 23:23:59.365576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.365553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8" event={"ID":"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b","Type":"ContainerDied","Data":"6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e"}
Sep 17 23:23:59.365791 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.365618    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8" event={"ID":"6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b","Type":"ContainerDied","Data":"feaf0c6e9d768d2a3a9a676e8178ea26fb26c3a41a1ae3399d84af8e55048606"}
Sep 17 23:23:59.365791 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.365640    2583 scope.go:117] "RemoveContainer" containerID="6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e"
Sep 17 23:23:59.376218 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.376194    2583 scope.go:117] "RemoveContainer" containerID="6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e"
Sep 17 23:23:59.376526 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:23:59.376506    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e\": container with ID starting with 6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e not found: ID does not exist" containerID="6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e"
Sep 17 23:23:59.376605 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.376535    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e"} err="failed to get container status \"6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e\": rpc error: code = NotFound desc = could not find container \"6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e\": container with ID starting with 6aadf4634615b0ef93ad73c9a0951748bec2d088b06b94cc64cd93e71962182e not found: ID does not exist"
Sep 17 23:23:59.391201 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.391152    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"]
Sep 17 23:23:59.394380 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.394360    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8"]
Sep 17 23:23:59.986036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.985995    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"]
Sep 17 23:23:59.986565 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.986410    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b" containerName="payload-processing"
Sep 17 23:23:59.986565 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.986422    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b" containerName="payload-processing"
Sep 17 23:23:59.986565 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.986439    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="359384c0-3f5b-4a53-a173-e2b63f740cb5" containerName="revoke-keys"
Sep 17 23:23:59.986565 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.986444    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="359384c0-3f5b-4a53-a173-e2b63f740cb5" containerName="revoke-keys"
Sep 17 23:23:59.986565 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.986521    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b" containerName="payload-processing"
Sep 17 23:23:59.986565 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.986530    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="359384c0-3f5b-4a53-a173-e2b63f740cb5" containerName="revoke-keys"
Sep 17 23:23:59.991007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.990983    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:23:59.993613 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.993587    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-825f30\"/\"kube-root-ca.crt\""
Sep 17 23:23:59.993923 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.993905    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-825f30\"/\"openshift-service-ca.crt\""
Sep 17 23:23:59.994677 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.994651    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-825f30\"/\"default-dockercfg-v6k5c\""
Sep 17 23:23:59.994885 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.994866    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-825f30\"/\"e2e-conflict-a-3df45c8d-kserve-self-signed-certs\""
Sep 17 23:23:59.997136 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:23:59.997113    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"]
Sep 17 23:24:00.127937 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.127904    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-dshm\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.128130 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.127978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d13a0b83-0788-42df-9e89-1c818c6cc296-tls-certs\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.128130 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.128039    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-model-cache\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.128130 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.128059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-home\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.128296 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.128129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-tmp-dir\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.128296 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.128186    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k24p4\" (UniqueName: \"kubernetes.io/projected/d13a0b83-0788-42df-9e89-1c818c6cc296-kube-api-access-k24p4\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.229580 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.229546    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-tmp-dir\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.229775 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.229595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k24p4\" (UniqueName: \"kubernetes.io/projected/d13a0b83-0788-42df-9e89-1c818c6cc296-kube-api-access-k24p4\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.229775 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.229627    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-dshm\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.229775 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.229685    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d13a0b83-0788-42df-9e89-1c818c6cc296-tls-certs\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.229775 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.229745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-model-cache\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.229775 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.229765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-home\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.230068 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.230043    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-tmp-dir\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.230129 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.230096    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-home\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.230129 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.230118    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-model-cache\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.231994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.231973    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-dshm\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.232218 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.232201    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d13a0b83-0788-42df-9e89-1c818c6cc296-tls-certs\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.238393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.238330    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k24p4\" (UniqueName: \"kubernetes.io/projected/d13a0b83-0788-42df-9e89-1c818c6cc296-kube-api-access-k24p4\") pod \"e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") " pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.302915 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.302882    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:00.487778 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.487745    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="359384c0-3f5b-4a53-a173-e2b63f740cb5" path="/var/lib/kubelet/pods/359384c0-3f5b-4a53-a173-e2b63f740cb5/volumes"
Sep 17 23:24:00.488171 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.488157    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b" path="/var/lib/kubelet/pods/6dac2794-b53e-4a2d-8ea9-8cc4c5b36a7b/volumes"
Sep 17 23:24:00.577219 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:00.577183    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"]
Sep 17 23:24:00.579396 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:24:00.579369    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd13a0b83_0788_42df_9e89_1c818c6cc296.slice/crio-8e5855357d3fee48fe95293b73733504784881fb32027880f456e9eb80c0b24b WatchSource:0}: Error finding container 8e5855357d3fee48fe95293b73733504784881fb32027880f456e9eb80c0b24b: Status 404 returned error can't find the container with id 8e5855357d3fee48fe95293b73733504784881fb32027880f456e9eb80c0b24b
Sep 17 23:24:01.402135 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:01.402099    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt" event={"ID":"d13a0b83-0788-42df-9e89-1c818c6cc296","Type":"ContainerStarted","Data":"b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6"}
Sep 17 23:24:01.402574 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:01.402146    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt" event={"ID":"d13a0b83-0788-42df-9e89-1c818c6cc296","Type":"ContainerStarted","Data":"8e5855357d3fee48fe95293b73733504784881fb32027880f456e9eb80c0b24b"}
Sep 17 23:24:01.420297 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:01.420248    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt" podStartSLOduration=2.420233906 podStartE2EDuration="2.420233906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:23:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:24:01.417300678 +0000 UTC m=+1053.024878357" watchObservedRunningTime="2026-09-17 23:24:01.420233906 +0000 UTC m=+1053.027811565"
Sep 17 23:24:05.486155 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:05.486122    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"]
Sep 17 23:24:05.486608 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:05.486332    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy" containerID="cri-o://a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2" gracePeriod=30
Sep 17 23:24:06.190037 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:06.190003    2583 patch_prober.go:28] interesting pod/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 17 23:24:06.190230 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:06.190057    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 23:24:10.303846 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.303807    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:10.304349 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.303862    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:10.316840 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.316812    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:10.474065 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.474034    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:24:10.755808 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.755786    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:24:10.850928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.850895    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istiod-ca-cert\") pod \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") "
Sep 17 23:24:10.850928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.850931    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-envoy\") pod \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") "
Sep 17 23:24:10.851186 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.850946    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-socket\") pod \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") "
Sep 17 23:24:10.851186 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851004    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-certs\") pod \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") "
Sep 17 23:24:10.851186 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851034    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kw8w\" (UniqueName: \"kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-kube-api-access-7kw8w\") pod \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") "
Sep 17 23:24:10.851186 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851065    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-token\") pod \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") "
Sep 17 23:24:10.851186 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851092    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-data\") pod \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") "
Sep 17 23:24:10.851186 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851115    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-podinfo\") pod \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") "
Sep 17 23:24:10.851186 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851145    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-credential-socket\") pod \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\" (UID: \"a13e1d6f-1fb7-4121-858c-7fe82ec156eb\") "
Sep 17 23:24:10.851586 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851268    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a13e1d6f-1fb7-4121-858c-7fe82ec156eb" (UID: "a13e1d6f-1fb7-4121-858c-7fe82ec156eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:24:10.851586 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851368    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a13e1d6f-1fb7-4121-858c-7fe82ec156eb" (UID: "a13e1d6f-1fb7-4121-858c-7fe82ec156eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:24:10.851586 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851545    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "a13e1d6f-1fb7-4121-858c-7fe82ec156eb" (UID: "a13e1d6f-1fb7-4121-858c-7fe82ec156eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:24:10.851729 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851660    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istiod-ca-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:24:10.851729 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851663    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a13e1d6f-1fb7-4121-858c-7fe82ec156eb" (UID: "a13e1d6f-1fb7-4121-858c-7fe82ec156eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:24:10.851729 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851680    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:24:10.851729 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851698    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-data\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:24:10.851729 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.851678    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a13e1d6f-1fb7-4121-858c-7fe82ec156eb" (UID: "a13e1d6f-1fb7-4121-858c-7fe82ec156eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:24:10.853306 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.853285    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-kube-api-access-7kw8w" (OuterVolumeSpecName: "kube-api-access-7kw8w") pod "a13e1d6f-1fb7-4121-858c-7fe82ec156eb" (UID: "a13e1d6f-1fb7-4121-858c-7fe82ec156eb"). InnerVolumeSpecName "kube-api-access-7kw8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:24:10.853396 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.853341    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "a13e1d6f-1fb7-4121-858c-7fe82ec156eb" (UID: "a13e1d6f-1fb7-4121-858c-7fe82ec156eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:24:10.853600 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.853574    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a13e1d6f-1fb7-4121-858c-7fe82ec156eb" (UID: "a13e1d6f-1fb7-4121-858c-7fe82ec156eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:24:10.853685 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.853642    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a13e1d6f-1fb7-4121-858c-7fe82ec156eb" (UID: "a13e1d6f-1fb7-4121-858c-7fe82ec156eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:24:10.952340 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.952305    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-workload-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:24:10.952340 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.952333    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kw8w\" (UniqueName: \"kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-kube-api-access-7kw8w\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:24:10.952576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.952356    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:24:10.952576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.952366    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-podinfo\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:24:10.952576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.952374    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-credential-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:24:10.952576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:10.952382    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a13e1d6f-1fb7-4121-858c-7fe82ec156eb-istio-envoy\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:24:11.470151 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.470110    2583 generic.go:356] "Generic (PLEG): container finished" podID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerID="a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2" exitCode=0
Sep 17 23:24:11.470641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.470178    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"
Sep 17 23:24:11.470641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.470193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" event={"ID":"a13e1d6f-1fb7-4121-858c-7fe82ec156eb","Type":"ContainerDied","Data":"a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2"}
Sep 17 23:24:11.470641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.470273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq" event={"ID":"a13e1d6f-1fb7-4121-858c-7fe82ec156eb","Type":"ContainerDied","Data":"6d630f0876158b5dc7f6ae6598af8d8a266d5e8daf77382d5f380bfc1dcca7b5"}
Sep 17 23:24:11.470641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.470296    2583 scope.go:117] "RemoveContainer" containerID="a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2"
Sep 17 23:24:11.480535 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.480520    2583 scope.go:117] "RemoveContainer" containerID="fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613"
Sep 17 23:24:11.489777 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.489214    2583 scope.go:117] "RemoveContainer" containerID="a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2"
Sep 17 23:24:11.489777 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:24:11.489521    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2\": container with ID starting with a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2 not found: ID does not exist" containerID="a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2"
Sep 17 23:24:11.489777 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.489558    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2"} err="failed to get container status \"a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2\": rpc error: code = NotFound desc = could not find container \"a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2\": container with ID starting with a11b5b92a7b56d1156e8f8dc60d86f11e59c8bc9f255c04bbf37a2759d0aaba2 not found: ID does not exist"
Sep 17 23:24:11.489777 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.489583    2583 scope.go:117] "RemoveContainer" containerID="fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613"
Sep 17 23:24:11.490005 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:24:11.489857    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613\": container with ID starting with fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613 not found: ID does not exist" containerID="fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613"
Sep 17 23:24:11.490005 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.489880    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613"} err="failed to get container status \"fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613\": rpc error: code = NotFound desc = could not find container \"fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613\": container with ID starting with fd17ec96a4f1e045f5d81164510184decb9d0fd22a9bbcdd29383c02e6fa0613 not found: ID does not exist"
Sep 17 23:24:11.492106 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.492086    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"]
Sep 17 23:24:11.496111 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:11.496091    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq"]
Sep 17 23:24:12.487255 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:12.487151    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" path="/var/lib/kubelet/pods/a13e1d6f-1fb7-4121-858c-7fe82ec156eb/volumes"
Sep 17 23:24:14.297368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.297335    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"]
Sep 17 23:24:14.297963 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.297942    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy"
Sep 17 23:24:14.298060 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.297965    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy"
Sep 17 23:24:14.298113 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.298059    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy"
Sep 17 23:24:14.302348 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.302326    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.304800 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.304781    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-736809\"/\"distinct-w0-736809-kserve-self-signed-certs\""
Sep 17 23:24:14.314266 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.314243    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"]
Sep 17 23:24:14.484939 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.484906    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tmp-dir\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.485200 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.485035    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-dshm\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.485200 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.485074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-model-cache\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.485200 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.485131    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tls-certs\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.485200 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.485162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-home\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.485426 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.485240    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm2ww\" (UniqueName: \"kubernetes.io/projected/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-kube-api-access-zm2ww\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.586649 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.586564    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-model-cache\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.586649 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.586611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tls-certs\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.586869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.586651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-home\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.586869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.586706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm2ww\" (UniqueName: \"kubernetes.io/projected/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-kube-api-access-zm2ww\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.586869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.586779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tmp-dir\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.587028 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.586932    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-dshm\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.587081 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.587030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-model-cache\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.587136 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.587087    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tmp-dir\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.587373 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.587345    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-home\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.589222 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.589193    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-dshm\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.589420 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.589405    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tls-certs\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.594681 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.594659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm2ww\" (UniqueName: \"kubernetes.io/projected/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-kube-api-access-zm2ww\") pod \"distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") " pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.612383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.612360    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:14.892677 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:14.892158    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"]
Sep 17 23:24:15.498064 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.498029    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v" event={"ID":"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f","Type":"ContainerStarted","Data":"5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17"}
Sep 17 23:24:15.498517 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.498077    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v" event={"ID":"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f","Type":"ContainerStarted","Data":"0a0dfb7878533a4645095801d79bf32afeb1e2c263fdedd3794c0d58fdd67a1d"}
Sep 17 23:24:15.521956 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.521851    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v" podStartSLOduration=1.521830316 podStartE2EDuration="1.521830316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:24:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:24:15.518872067 +0000 UTC m=+1067.126449750" watchObservedRunningTime="2026-09-17 23:24:15.521830316 +0000 UTC m=+1067.129407976"
Sep 17 23:24:15.812410 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.812371    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"]
Sep 17 23:24:15.812856 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.812842    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy"
Sep 17 23:24:15.812902 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.812858    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy"
Sep 17 23:24:15.812935 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.812929    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a13e1d6f-1fb7-4121-858c-7fe82ec156eb" containerName="istio-proxy"
Sep 17 23:24:15.816153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.816137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"
Sep 17 23:24:15.819678 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.819651    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:24:15.820141 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.820119    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:24:15.822627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:15.822605    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"]
Sep 17 23:24:16.003630 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:16.003591    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a342d8b-1788-465b-9475-3029b3fabd1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-35df6d-pm548\" (UID: \"8a342d8b-1788-465b-9475-3029b3fabd1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"
Sep 17 23:24:16.104448 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:16.104364    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a342d8b-1788-465b-9475-3029b3fabd1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-35df6d-pm548\" (UID: \"8a342d8b-1788-465b-9475-3029b3fabd1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"
Sep 17 23:24:16.105038 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:16.105018    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a342d8b-1788-465b-9475-3029b3fabd1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-35df6d-pm548\" (UID: \"8a342d8b-1788-465b-9475-3029b3fabd1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"
Sep 17 23:24:16.128355 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:16.128325    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"
Sep 17 23:24:16.403452 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:16.402967    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"]
Sep 17 23:24:16.404249 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:24:16.404221    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a342d8b_1788_465b_9475_3029b3fabd1f.slice/crio-c5f2e820027dfb8ebfafa98116baacb0aec564ce40567a37b19b0dc2408f6029 WatchSource:0}: Error finding container c5f2e820027dfb8ebfafa98116baacb0aec564ce40567a37b19b0dc2408f6029: Status 404 returned error can't find the container with id c5f2e820027dfb8ebfafa98116baacb0aec564ce40567a37b19b0dc2408f6029
Sep 17 23:24:16.505894 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:16.505863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548" event={"ID":"8a342d8b-1788-465b-9475-3029b3fabd1f","Type":"ContainerStarted","Data":"c5f2e820027dfb8ebfafa98116baacb0aec564ce40567a37b19b0dc2408f6029"}
Sep 17 23:24:17.514745 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:17.514662    2583 generic.go:356] "Generic (PLEG): container finished" podID="8a342d8b-1788-465b-9475-3029b3fabd1f" containerID="3931ff05c3c144f67eb239232ba28f5b5c9887bae6c702e9c239b7f441efb8ca" exitCode=0
Sep 17 23:24:17.515104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:17.514744    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548" event={"ID":"8a342d8b-1788-465b-9475-3029b3fabd1f","Type":"ContainerDied","Data":"3931ff05c3c144f67eb239232ba28f5b5c9887bae6c702e9c239b7f441efb8ca"}
Sep 17 23:24:18.655938 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:18.655907    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"
Sep 17 23:24:18.729205 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:18.729166    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a342d8b-1788-465b-9475-3029b3fabd1f-maas-api-service-ca\") pod \"8a342d8b-1788-465b-9475-3029b3fabd1f\" (UID: \"8a342d8b-1788-465b-9475-3029b3fabd1f\") "
Sep 17 23:24:18.729552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:18.729521    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a342d8b-1788-465b-9475-3029b3fabd1f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a342d8b-1788-465b-9475-3029b3fabd1f" (UID: "8a342d8b-1788-465b-9475-3029b3fabd1f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:24:18.729689 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:18.729621    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a342d8b-1788-465b-9475-3029b3fabd1f-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:24:19.528517 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:19.528456    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"
Sep 17 23:24:19.528517 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:19.528497    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548" event={"ID":"8a342d8b-1788-465b-9475-3029b3fabd1f","Type":"ContainerDied","Data":"c5f2e820027dfb8ebfafa98116baacb0aec564ce40567a37b19b0dc2408f6029"}
Sep 17 23:24:19.528785 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:19.528557    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5f2e820027dfb8ebfafa98116baacb0aec564ce40567a37b19b0dc2408f6029"
Sep 17 23:24:24.613140 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:24.613107    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:24.613599 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:24.613158    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:24.626019 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:24.625993    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:25.577247 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:25.577218    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:24:26.293392 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:26.293352    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"]
Sep 17 23:24:26.299619 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:26.299583    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-35df6d-pm548"]
Sep 17 23:24:26.488391 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:24:26.488358    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a342d8b-1788-465b-9475-3029b3fabd1f" path="/var/lib/kubelet/pods/8a342d8b-1788-465b-9475-3029b3fabd1f/volumes"
Sep 17 23:25:01.093687 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.093647    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"]
Sep 17 23:25:01.094303 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.094284    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a342d8b-1788-465b-9475-3029b3fabd1f" containerName="revoke-keys"
Sep 17 23:25:01.094349 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.094326    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a342d8b-1788-465b-9475-3029b3fabd1f" containerName="revoke-keys"
Sep 17 23:25:01.094445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.094433    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a342d8b-1788-465b-9475-3029b3fabd1f" containerName="revoke-keys"
Sep 17 23:25:01.098048 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.098025    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:25:01.100642 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.100619    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-efffde-dockercfg-qzszl\""
Sep 17 23:25:01.100777 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.100757    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-efffde\""
Sep 17 23:25:01.108724 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.108698    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"]
Sep 17 23:25:01.159917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.159887    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484\" (UID: \"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:25:01.160082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.159972    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rss2t\" (UniqueName: \"kubernetes.io/projected/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-kube-api-access-rss2t\") pod \"payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484\" (UID: \"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:25:01.260852 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.260817    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484\" (UID: \"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:25:01.261041 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.260903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rss2t\" (UniqueName: \"kubernetes.io/projected/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-kube-api-access-rss2t\") pod \"payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484\" (UID: \"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:25:01.261717 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.261691    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484\" (UID: \"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:25:01.269779 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.269749    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rss2t\" (UniqueName: \"kubernetes.io/projected/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-kube-api-access-rss2t\") pod \"payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484\" (UID: \"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:25:01.410099 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.410010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:25:01.687265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.687234    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"]
Sep 17 23:25:01.688397 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:25:01.688371    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b2ae823_a0f6_4ce6_9522_c81a7de2f25f.slice/crio-79d623b7c73c216ab0d32d618da1c542d706a72320cfd612e8f47a33661e6490 WatchSource:0}: Error finding container 79d623b7c73c216ab0d32d618da1c542d706a72320cfd612e8f47a33661e6490: Status 404 returned error can't find the container with id 79d623b7c73c216ab0d32d618da1c542d706a72320cfd612e8f47a33661e6490
Sep 17 23:25:01.803709 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.803678    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484" event={"ID":"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f","Type":"ContainerStarted","Data":"a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524"}
Sep 17 23:25:01.803896 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.803741    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484" event={"ID":"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f","Type":"ContainerStarted","Data":"79d623b7c73c216ab0d32d618da1c542d706a72320cfd612e8f47a33661e6490"}
Sep 17 23:25:01.803896 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.803770    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:25:01.825199 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:01.825133    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484" podStartSLOduration=0.825111764 podStartE2EDuration="825.111764ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:25:01.824094286 +0000 UTC m=+1113.431671971" watchObservedRunningTime="2026-09-17 23:25:01.825111764 +0000 UTC m=+1113.432689425"
Sep 17 23:25:12.812067 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:12.812034    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:25:25.485425 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:25.485385    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"]
Sep 17 23:25:25.489128 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:25.489109    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"
Sep 17 23:25:25.491594 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:25.491570    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:25:25.491594 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:25.491574    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:25:25.505853 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:25.499830    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"]
Sep 17 23:25:25.614159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:25.614121    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/784628af-7dc1-408b-b8bf-296350529cf2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn\" (UID: \"784628af-7dc1-408b-b8bf-296350529cf2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"
Sep 17 23:25:25.715874 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:25.715835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/784628af-7dc1-408b-b8bf-296350529cf2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn\" (UID: \"784628af-7dc1-408b-b8bf-296350529cf2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"
Sep 17 23:25:25.716539 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:25.716519    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/784628af-7dc1-408b-b8bf-296350529cf2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn\" (UID: \"784628af-7dc1-408b-b8bf-296350529cf2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"
Sep 17 23:25:25.809897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:25.809864    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"
Sep 17 23:25:26.084588 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:26.084557    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"]
Sep 17 23:25:26.086107 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:25:26.086085    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784628af_7dc1_408b_b8bf_296350529cf2.slice/crio-30a391b39f429875207ff9296b56067a0a0cb78483d88b959d07ec03682cd4d6 WatchSource:0}: Error finding container 30a391b39f429875207ff9296b56067a0a0cb78483d88b959d07ec03682cd4d6: Status 404 returned error can't find the container with id 30a391b39f429875207ff9296b56067a0a0cb78483d88b959d07ec03682cd4d6
Sep 17 23:25:26.963660 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:26.963625    2583 generic.go:356] "Generic (PLEG): container finished" podID="784628af-7dc1-408b-b8bf-296350529cf2" containerID="9e7fccfbfaf59f2729bc5606e378670231aedffcfff2d86f81c27b77654ab66c" exitCode=0
Sep 17 23:25:26.964101 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:26.963678    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn" event={"ID":"784628af-7dc1-408b-b8bf-296350529cf2","Type":"ContainerDied","Data":"9e7fccfbfaf59f2729bc5606e378670231aedffcfff2d86f81c27b77654ab66c"}
Sep 17 23:25:26.964101 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:26.963716    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn" event={"ID":"784628af-7dc1-408b-b8bf-296350529cf2","Type":"ContainerStarted","Data":"30a391b39f429875207ff9296b56067a0a0cb78483d88b959d07ec03682cd4d6"}
Sep 17 23:25:28.107737 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:28.107715    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"
Sep 17 23:25:28.243679 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:28.243589    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/784628af-7dc1-408b-b8bf-296350529cf2-maas-api-service-ca\") pod \"784628af-7dc1-408b-b8bf-296350529cf2\" (UID: \"784628af-7dc1-408b-b8bf-296350529cf2\") "
Sep 17 23:25:28.243986 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:28.243959    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/784628af-7dc1-408b-b8bf-296350529cf2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "784628af-7dc1-408b-b8bf-296350529cf2" (UID: "784628af-7dc1-408b-b8bf-296350529cf2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:25:28.344570 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:28.344542    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/784628af-7dc1-408b-b8bf-296350529cf2-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:25:28.979389 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:28.979345    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn" event={"ID":"784628af-7dc1-408b-b8bf-296350529cf2","Type":"ContainerDied","Data":"30a391b39f429875207ff9296b56067a0a0cb78483d88b959d07ec03682cd4d6"}
Sep 17 23:25:28.979629 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:28.979424    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30a391b39f429875207ff9296b56067a0a0cb78483d88b959d07ec03682cd4d6"
Sep 17 23:25:28.979629 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:28.979538    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"
Sep 17 23:25:30.574416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:30.574387    2583 scope.go:117] "RemoveContainer" containerID="366cefc10976c071f576595c0ce6216c404d32ffd8874c5ee2188f5c104d8dd7"
Sep 17 23:25:30.586764 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:30.586733    2583 scope.go:117] "RemoveContainer" containerID="435e0ad52175b97e9cd90fc631bb3ff9aa57708298c119bffbc54b1f7df91854"
Sep 17 23:25:36.502791 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:36.502757    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"]
Sep 17 23:25:36.505904 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:36.505876    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-48d98f-mbnsn"]
Sep 17 23:25:38.487777 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:38.487742    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="784628af-7dc1-408b-b8bf-296350529cf2" path="/var/lib/kubelet/pods/784628af-7dc1-408b-b8bf-296350529cf2/volumes"
Sep 17 23:25:42.515594 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.515514    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"]
Sep 17 23:25:42.515956 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.515928    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784628af-7dc1-408b-b8bf-296350529cf2" containerName="revoke-keys"
Sep 17 23:25:42.515956 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.515939    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="784628af-7dc1-408b-b8bf-296350529cf2" containerName="revoke-keys"
Sep 17 23:25:42.516032 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.516007    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="784628af-7dc1-408b-b8bf-296350529cf2" containerName="revoke-keys"
Sep 17 23:25:42.520522 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.520491    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:25:42.523072 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.523048    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-09450b8d-dockercfg-8dqmt\""
Sep 17 23:25:42.523366 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.523350    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-09450b8d\""
Sep 17 23:25:42.530691 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.530663    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"]
Sep 17 23:25:42.596203 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.596163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7764973f-3ba9-4a71-81fe-521035faf2e8-plugins-config-volume\") pod \"payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg\" (UID: \"7764973f-3ba9-4a71-81fe-521035faf2e8\") " pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:25:42.596607 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.596576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm9jv\" (UniqueName: \"kubernetes.io/projected/7764973f-3ba9-4a71-81fe-521035faf2e8-kube-api-access-qm9jv\") pod \"payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg\" (UID: \"7764973f-3ba9-4a71-81fe-521035faf2e8\") " pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:25:42.697326 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.697291    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7764973f-3ba9-4a71-81fe-521035faf2e8-plugins-config-volume\") pod \"payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg\" (UID: \"7764973f-3ba9-4a71-81fe-521035faf2e8\") " pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:25:42.697540 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.697370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm9jv\" (UniqueName: \"kubernetes.io/projected/7764973f-3ba9-4a71-81fe-521035faf2e8-kube-api-access-qm9jv\") pod \"payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg\" (UID: \"7764973f-3ba9-4a71-81fe-521035faf2e8\") " pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:25:42.698075 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.698054    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7764973f-3ba9-4a71-81fe-521035faf2e8-plugins-config-volume\") pod \"payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg\" (UID: \"7764973f-3ba9-4a71-81fe-521035faf2e8\") " pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:25:42.705344 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.705324    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm9jv\" (UniqueName: \"kubernetes.io/projected/7764973f-3ba9-4a71-81fe-521035faf2e8-kube-api-access-qm9jv\") pod \"payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg\" (UID: \"7764973f-3ba9-4a71-81fe-521035faf2e8\") " pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:25:42.832751 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:42.832648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:25:43.111744 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:43.111712    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"]
Sep 17 23:25:43.112680 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:25:43.112654    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7764973f_3ba9_4a71_81fe_521035faf2e8.slice/crio-2af1ed6a57e86e62e57a4176c10b7b4d79f4bae0723fef15864b0727e2a09a5e WatchSource:0}: Error finding container 2af1ed6a57e86e62e57a4176c10b7b4d79f4bae0723fef15864b0727e2a09a5e: Status 404 returned error can't find the container with id 2af1ed6a57e86e62e57a4176c10b7b4d79f4bae0723fef15864b0727e2a09a5e
Sep 17 23:25:44.076880 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:44.076846    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg" event={"ID":"7764973f-3ba9-4a71-81fe-521035faf2e8","Type":"ContainerStarted","Data":"d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf"}
Sep 17 23:25:44.077307 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:44.076908    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg" event={"ID":"7764973f-3ba9-4a71-81fe-521035faf2e8","Type":"ContainerStarted","Data":"2af1ed6a57e86e62e57a4176c10b7b4d79f4bae0723fef15864b0727e2a09a5e"}
Sep 17 23:25:44.077307 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:44.076935    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:25:44.093525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:44.093454    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg" podStartSLOduration=2.093433253 podStartE2EDuration="2.093433253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:25:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:25:44.092058199 +0000 UTC m=+1155.699635883" watchObservedRunningTime="2026-09-17 23:25:44.093433253 +0000 UTC m=+1155.701010914"
Sep 17 23:25:55.087637 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:25:55.087604    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:26:19.086126 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.086090    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"]
Sep 17 23:26:19.086713 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.086294    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy" containerID="cri-o://c479537ee3f8c209ff64fe6254e29da243a6668c0412c8721dc640ab3b7cf205" gracePeriod=30
Sep 17 23:26:19.464166 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.464083    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"]
Sep 17 23:26:19.468609 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.468587    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"
Sep 17 23:26:19.471398 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.471368    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:26:19.471562 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.471525    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:26:19.474736 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.474710    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"]
Sep 17 23:26:19.599430 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.599391    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d8b5e4-7761-4f02-9889-b75f5a6c5cd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9\" (UID: \"76d8b5e4-7761-4f02-9889-b75f5a6c5cd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"
Sep 17 23:26:19.700827 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.700788    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d8b5e4-7761-4f02-9889-b75f5a6c5cd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9\" (UID: \"76d8b5e4-7761-4f02-9889-b75f5a6c5cd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"
Sep 17 23:26:19.701438 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.701414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d8b5e4-7761-4f02-9889-b75f5a6c5cd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9\" (UID: \"76d8b5e4-7761-4f02-9889-b75f5a6c5cd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"
Sep 17 23:26:19.782111 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:19.782077    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"
Sep 17 23:26:20.059537 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:20.059506    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"]
Sep 17 23:26:20.060605 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:26:20.060582    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d8b5e4_7761_4f02_9889_b75f5a6c5cd1.slice/crio-4c43e69196ed9d54f110f68b8b3e5092f2a83c79ebd723201910ee953637bf11 WatchSource:0}: Error finding container 4c43e69196ed9d54f110f68b8b3e5092f2a83c79ebd723201910ee953637bf11: Status 404 returned error can't find the container with id 4c43e69196ed9d54f110f68b8b3e5092f2a83c79ebd723201910ee953637bf11
Sep 17 23:26:20.337360 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:20.337262    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9" event={"ID":"76d8b5e4-7761-4f02-9889-b75f5a6c5cd1","Type":"ContainerStarted","Data":"4c43e69196ed9d54f110f68b8b3e5092f2a83c79ebd723201910ee953637bf11"}
Sep 17 23:26:21.345745 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:21.345707    2583 generic.go:356] "Generic (PLEG): container finished" podID="76d8b5e4-7761-4f02-9889-b75f5a6c5cd1" containerID="2ab12b1330336cc171a4cdfb509c35b72c852c68a8ac60e089a0ca2cdec01ea2" exitCode=0
Sep 17 23:26:21.346290 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:21.345803    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9" event={"ID":"76d8b5e4-7761-4f02-9889-b75f5a6c5cd1","Type":"ContainerDied","Data":"2ab12b1330336cc171a4cdfb509c35b72c852c68a8ac60e089a0ca2cdec01ea2"}
Sep 17 23:26:21.663776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:21.663681    2583 patch_prober.go:28] interesting pod/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 23:26:21.663776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:21.663753    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 23:26:22.493932 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:22.493908    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"
Sep 17 23:26:22.631491 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:22.631371    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d8b5e4-7761-4f02-9889-b75f5a6c5cd1-maas-api-service-ca\") pod \"76d8b5e4-7761-4f02-9889-b75f5a6c5cd1\" (UID: \"76d8b5e4-7761-4f02-9889-b75f5a6c5cd1\") "
Sep 17 23:26:22.631750 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:22.631729    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76d8b5e4-7761-4f02-9889-b75f5a6c5cd1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "76d8b5e4-7761-4f02-9889-b75f5a6c5cd1" (UID: "76d8b5e4-7761-4f02-9889-b75f5a6c5cd1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:26:22.732972 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:22.732936    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d8b5e4-7761-4f02-9889-b75f5a6c5cd1-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:23.361086 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:23.361060    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"
Sep 17 23:26:23.361086 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:23.361065    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9" event={"ID":"76d8b5e4-7761-4f02-9889-b75f5a6c5cd1","Type":"ContainerDied","Data":"4c43e69196ed9d54f110f68b8b3e5092f2a83c79ebd723201910ee953637bf11"}
Sep 17 23:26:23.361318 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:23.361106    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c43e69196ed9d54f110f68b8b3e5092f2a83c79ebd723201910ee953637bf11"
Sep 17 23:26:24.198244 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.198206    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"]
Sep 17 23:26:24.370328 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.370305    2583 generic.go:356] "Generic (PLEG): container finished" podID="6b646954-840c-4deb-b022-7c8040605f08" containerID="c479537ee3f8c209ff64fe6254e29da243a6668c0412c8721dc640ab3b7cf205" exitCode=0
Sep 17 23:26:24.370450 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.370388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" event={"ID":"6b646954-840c-4deb-b022-7c8040605f08","Type":"ContainerDied","Data":"c479537ee3f8c209ff64fe6254e29da243a6668c0412c8721dc640ab3b7cf205"}
Sep 17 23:26:24.370525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.370450    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq" event={"ID":"6b646954-840c-4deb-b022-7c8040605f08","Type":"ContainerDied","Data":"ab0ec7c43ab8007813697ef8b975058ca41a1c0d76a9a274fd247e525f1043fc"}
Sep 17 23:26:24.370525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.370482    2583 scope.go:117] "RemoveContainer" containerID="ccd05e09360649165ed79e87e2691fc0339e9864e3946f0728ec22d964a38df8"
Sep 17 23:26:24.370525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.370504    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab0ec7c43ab8007813697ef8b975058ca41a1c0d76a9a274fd247e525f1043fc"
Sep 17 23:26:24.376791 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.376772    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:26:24.451700 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.451659    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-socket\") pod \"6b646954-840c-4deb-b022-7c8040605f08\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") "
Sep 17 23:26:24.451884 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.451735    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-credential-socket\") pod \"6b646954-840c-4deb-b022-7c8040605f08\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") "
Sep 17 23:26:24.451884 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.451877    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b646954-840c-4deb-b022-7c8040605f08-istio-podinfo\") pod \"6b646954-840c-4deb-b022-7c8040605f08\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") "
Sep 17 23:26:24.451977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.451921    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b646954-840c-4deb-b022-7c8040605f08-istiod-ca-cert\") pod \"6b646954-840c-4deb-b022-7c8040605f08\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") "
Sep 17 23:26:24.451977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.451951    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7knm\" (UniqueName: \"kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-kube-api-access-b7knm\") pod \"6b646954-840c-4deb-b022-7c8040605f08\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") "
Sep 17 23:26:24.452083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.451974    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-data\") pod \"6b646954-840c-4deb-b022-7c8040605f08\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") "
Sep 17 23:26:24.452083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452014    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-istio-token\") pod \"6b646954-840c-4deb-b022-7c8040605f08\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") "
Sep 17 23:26:24.452083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.451995    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b646954-840c-4deb-b022-7c8040605f08" (UID: "6b646954-840c-4deb-b022-7c8040605f08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:24.452083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452045    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-envoy\") pod \"6b646954-840c-4deb-b022-7c8040605f08\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") "
Sep 17 23:26:24.452083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452045    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b646954-840c-4deb-b022-7c8040605f08" (UID: "6b646954-840c-4deb-b022-7c8040605f08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:24.452083 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452078    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-certs\") pod \"6b646954-840c-4deb-b022-7c8040605f08\" (UID: \"6b646954-840c-4deb-b022-7c8040605f08\") "
Sep 17 23:26:24.452499 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452207    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b646954-840c-4deb-b022-7c8040605f08" (UID: "6b646954-840c-4deb-b022-7c8040605f08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:24.452499 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452302    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b646954-840c-4deb-b022-7c8040605f08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b646954-840c-4deb-b022-7c8040605f08" (UID: "6b646954-840c-4deb-b022-7c8040605f08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:26:24.452499 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452439    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b646954-840c-4deb-b022-7c8040605f08" (UID: "6b646954-840c-4deb-b022-7c8040605f08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:24.452627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452555    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:24.452627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452576    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-credential-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:24.452627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452588    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b646954-840c-4deb-b022-7c8040605f08-istiod-ca-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:24.452627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.452601    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-data\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:24.454383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.454356    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b646954-840c-4deb-b022-7c8040605f08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b646954-840c-4deb-b022-7c8040605f08" (UID: "6b646954-840c-4deb-b022-7c8040605f08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:26:24.454687 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.454663    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b646954-840c-4deb-b022-7c8040605f08" (UID: "6b646954-840c-4deb-b022-7c8040605f08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:26:24.455014 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.454988    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b646954-840c-4deb-b022-7c8040605f08" (UID: "6b646954-840c-4deb-b022-7c8040605f08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:24.455014 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.454993    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-kube-api-access-b7knm" (OuterVolumeSpecName: "kube-api-access-b7knm") pod "6b646954-840c-4deb-b022-7c8040605f08" (UID: "6b646954-840c-4deb-b022-7c8040605f08"). InnerVolumeSpecName "kube-api-access-b7knm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:26:24.553487 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.553428    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-istio-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:24.553487 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.553456    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-istio-envoy\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:24.553667 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.553496    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b646954-840c-4deb-b022-7c8040605f08-workload-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:24.553667 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.553508    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b646954-840c-4deb-b022-7c8040605f08-istio-podinfo\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:24.553667 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:24.553520    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7knm\" (UniqueName: \"kubernetes.io/projected/6b646954-840c-4deb-b022-7c8040605f08-kube-api-access-b7knm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:25.378418 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:25.378389    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"
Sep 17 23:26:25.416318 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:25.416284    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"]
Sep 17 23:26:25.421394 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:25.421362    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq"]
Sep 17 23:26:26.488109 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:26.488076    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b646954-840c-4deb-b022-7c8040605f08" path="/var/lib/kubelet/pods/6b646954-840c-4deb-b022-7c8040605f08/volumes"
Sep 17 23:26:30.075884 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.075852    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"]
Sep 17 23:26:30.076326 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.076062    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg" podUID="31c0253d-b72c-4ade-81ba-b872ffcc475b" containerName="payload-pre-processing" containerID="cri-o://237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10" gracePeriod=30
Sep 17 23:26:30.235813 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.235774    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"]
Sep 17 23:26:30.238904 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.238879    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f38e68-hm9f9"]
Sep 17 23:26:30.344862 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.344837    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:26:30.440323 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.438247    2583 generic.go:356] "Generic (PLEG): container finished" podID="31c0253d-b72c-4ade-81ba-b872ffcc475b" containerID="237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10" exitCode=0
Sep 17 23:26:30.440323 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.438664    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"
Sep 17 23:26:30.440323 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.439029    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg" event={"ID":"31c0253d-b72c-4ade-81ba-b872ffcc475b","Type":"ContainerDied","Data":"237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10"}
Sep 17 23:26:30.440323 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.439114    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg" event={"ID":"31c0253d-b72c-4ade-81ba-b872ffcc475b","Type":"ContainerDied","Data":"bc28f427f0a36debf4de075365f7097ef933a6f09b7ab99fa46722e189b44736"}
Sep 17 23:26:30.440323 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.439146    2583 scope.go:117] "RemoveContainer" containerID="237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10"
Sep 17 23:26:30.458030 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.457998    2583 scope.go:117] "RemoveContainer" containerID="237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10"
Sep 17 23:26:30.458388 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:26:30.458368    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10\": container with ID starting with 237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10 not found: ID does not exist" containerID="237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10"
Sep 17 23:26:30.458501 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.458399    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10"} err="failed to get container status \"237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10\": rpc error: code = NotFound desc = could not find container \"237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10\": container with ID starting with 237fdbd392539bfe3f8df78cd36724b8eaca21d740358b2b6a7978b94eddfa10 not found: ID does not exist"
Sep 17 23:26:30.488932 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.488901    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76d8b5e4-7761-4f02-9889-b75f5a6c5cd1" path="/var/lib/kubelet/pods/76d8b5e4-7761-4f02-9889-b75f5a6c5cd1/volumes"
Sep 17 23:26:30.518569 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.518536    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31c0253d-b72c-4ade-81ba-b872ffcc475b-plugins-config-volume\") pod \"31c0253d-b72c-4ade-81ba-b872ffcc475b\" (UID: \"31c0253d-b72c-4ade-81ba-b872ffcc475b\") "
Sep 17 23:26:30.518742 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.518723    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58sc8\" (UniqueName: \"kubernetes.io/projected/31c0253d-b72c-4ade-81ba-b872ffcc475b-kube-api-access-58sc8\") pod \"31c0253d-b72c-4ade-81ba-b872ffcc475b\" (UID: \"31c0253d-b72c-4ade-81ba-b872ffcc475b\") "
Sep 17 23:26:30.518887 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.518866    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31c0253d-b72c-4ade-81ba-b872ffcc475b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "31c0253d-b72c-4ade-81ba-b872ffcc475b" (UID: "31c0253d-b72c-4ade-81ba-b872ffcc475b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:26:30.519168 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.519148    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31c0253d-b72c-4ade-81ba-b872ffcc475b-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:30.520802 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.520775    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c0253d-b72c-4ade-81ba-b872ffcc475b-kube-api-access-58sc8" (OuterVolumeSpecName: "kube-api-access-58sc8") pod "31c0253d-b72c-4ade-81ba-b872ffcc475b" (UID: "31c0253d-b72c-4ade-81ba-b872ffcc475b"). InnerVolumeSpecName "kube-api-access-58sc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:26:30.612644 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.612564    2583 scope.go:117] "RemoveContainer" containerID="a2d562be71beabf5458b0c159e692765871afbf2636ebe19775323a1febed369"
Sep 17 23:26:30.620548 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.620355    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58sc8\" (UniqueName: \"kubernetes.io/projected/31c0253d-b72c-4ade-81ba-b872ffcc475b-kube-api-access-58sc8\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:30.622352 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.622325    2583 scope.go:117] "RemoveContainer" containerID="c479537ee3f8c209ff64fe6254e29da243a6668c0412c8721dc640ab3b7cf205"
Sep 17 23:26:30.761004 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.760973    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"]
Sep 17 23:26:30.764981 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:30.764954    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg"]
Sep 17 23:26:32.495172 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:32.495136    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31c0253d-b72c-4ade-81ba-b872ffcc475b" path="/var/lib/kubelet/pods/31c0253d-b72c-4ade-81ba-b872ffcc475b/volumes"
Sep 17 23:26:39.218171 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.218134    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z" podUID="731f4442-d99d-4a70-a76a-99049546ba98" containerName="main" containerID="cri-o://20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e" gracePeriod=45
Sep 17 23:26:39.476357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.476297    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:26:39.505751 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.505719    2583 generic.go:356] "Generic (PLEG): container finished" podID="731f4442-d99d-4a70-a76a-99049546ba98" containerID="20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e" exitCode=0
Sep 17 23:26:39.505946 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.505763    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z" event={"ID":"731f4442-d99d-4a70-a76a-99049546ba98","Type":"ContainerDied","Data":"20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e"}
Sep 17 23:26:39.505946 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.505787    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"
Sep 17 23:26:39.505946 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.505809    2583 scope.go:117] "RemoveContainer" containerID="20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e"
Sep 17 23:26:39.505946 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.505798    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z" event={"ID":"731f4442-d99d-4a70-a76a-99049546ba98","Type":"ContainerDied","Data":"23c17365ca0bf191d1d97a59914bbf897de60cb3fc5fe8528fb07a4e178fe68b"}
Sep 17 23:26:39.508278 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.508253    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-home\") pod \"731f4442-d99d-4a70-a76a-99049546ba98\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") "
Sep 17 23:26:39.508392 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.508360    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-dshm\") pod \"731f4442-d99d-4a70-a76a-99049546ba98\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") "
Sep 17 23:26:39.508445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.508427    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/731f4442-d99d-4a70-a76a-99049546ba98-tls-certs\") pod \"731f4442-d99d-4a70-a76a-99049546ba98\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") "
Sep 17 23:26:39.508532 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.508512    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc7nt\" (UniqueName: \"kubernetes.io/projected/731f4442-d99d-4a70-a76a-99049546ba98-kube-api-access-tc7nt\") pod \"731f4442-d99d-4a70-a76a-99049546ba98\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") "
Sep 17 23:26:39.508601 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.508585    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-model-cache\") pod \"731f4442-d99d-4a70-a76a-99049546ba98\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") "
Sep 17 23:26:39.508659 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.508617    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-tmp-dir\") pod \"731f4442-d99d-4a70-a76a-99049546ba98\" (UID: \"731f4442-d99d-4a70-a76a-99049546ba98\") "
Sep 17 23:26:39.508659 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.508633    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-home" (OuterVolumeSpecName: "home") pod "731f4442-d99d-4a70-a76a-99049546ba98" (UID: "731f4442-d99d-4a70-a76a-99049546ba98"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:39.509026 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.508849    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-model-cache" (OuterVolumeSpecName: "model-cache") pod "731f4442-d99d-4a70-a76a-99049546ba98" (UID: "731f4442-d99d-4a70-a76a-99049546ba98"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:39.509131 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.509068    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:39.509131 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.509086    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:39.510127 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.509357    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "731f4442-d99d-4a70-a76a-99049546ba98" (UID: "731f4442-d99d-4a70-a76a-99049546ba98"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:39.511054 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.511021    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-dshm" (OuterVolumeSpecName: "dshm") pod "731f4442-d99d-4a70-a76a-99049546ba98" (UID: "731f4442-d99d-4a70-a76a-99049546ba98"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:39.511161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.511115    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/731f4442-d99d-4a70-a76a-99049546ba98-kube-api-access-tc7nt" (OuterVolumeSpecName: "kube-api-access-tc7nt") pod "731f4442-d99d-4a70-a76a-99049546ba98" (UID: "731f4442-d99d-4a70-a76a-99049546ba98"). InnerVolumeSpecName "kube-api-access-tc7nt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:26:39.511311 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.511296    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/731f4442-d99d-4a70-a76a-99049546ba98-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "731f4442-d99d-4a70-a76a-99049546ba98" (UID: "731f4442-d99d-4a70-a76a-99049546ba98"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:26:39.517152 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.517133    2583 scope.go:117] "RemoveContainer" containerID="20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e"
Sep 17 23:26:39.517547 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:26:39.517528    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e\": container with ID starting with 20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e not found: ID does not exist" containerID="20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e"
Sep 17 23:26:39.517632 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.517567    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e"} err="failed to get container status \"20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e\": rpc error: code = NotFound desc = could not find container \"20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e\": container with ID starting with 20279e5223f45dbba74bedc79dad39bc50bab81bb479f1ad6dca6a55fd1b6f5e not found: ID does not exist"
Sep 17 23:26:39.610445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.610409    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:39.610445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.610436    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/731f4442-d99d-4a70-a76a-99049546ba98-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:39.610445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.610445    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/731f4442-d99d-4a70-a76a-99049546ba98-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:39.610445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.610453    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc7nt\" (UniqueName: \"kubernetes.io/projected/731f4442-d99d-4a70-a76a-99049546ba98-kube-api-access-tc7nt\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:39.832002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.831972    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"]
Sep 17 23:26:39.836988 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:39.836957    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-f38e68/test-model-f38e68-kserve-544c49cb85-9qx5z"]
Sep 17 23:26:40.489321 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:40.489286    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="731f4442-d99d-4a70-a76a-99049546ba98" path="/var/lib/kubelet/pods/731f4442-d99d-4a70-a76a-99049546ba98/volumes"
Sep 17 23:26:41.579598 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:41.579563    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"]
Sep 17 23:26:41.580002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:41.579865    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy" containerID="cri-o://c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560" gracePeriod=30
Sep 17 23:26:46.850547 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.850446    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:26:46.884868 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.884836    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-data\") pod \"f41f516b-db53-4fdd-999b-938e1d6985a1\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") "
Sep 17 23:26:46.885017 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.884916    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-podinfo\") pod \"f41f516b-db53-4fdd-999b-938e1d6985a1\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") "
Sep 17 23:26:46.885017 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.884965    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-socket\") pod \"f41f516b-db53-4fdd-999b-938e1d6985a1\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") "
Sep 17 23:26:46.885017 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.884993    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f41f516b-db53-4fdd-999b-938e1d6985a1-istiod-ca-cert\") pod \"f41f516b-db53-4fdd-999b-938e1d6985a1\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") "
Sep 17 23:26:46.885126 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885014    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "f41f516b-db53-4fdd-999b-938e1d6985a1" (UID: "f41f516b-db53-4fdd-999b-938e1d6985a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:46.885126 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885046    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-credential-socket\") pod \"f41f516b-db53-4fdd-999b-938e1d6985a1\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") "
Sep 17 23:26:46.885126 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885096    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-envoy\") pod \"f41f516b-db53-4fdd-999b-938e1d6985a1\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") "
Sep 17 23:26:46.885126 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885121    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62mq7\" (UniqueName: \"kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-kube-api-access-62mq7\") pod \"f41f516b-db53-4fdd-999b-938e1d6985a1\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") "
Sep 17 23:26:46.885343 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885156    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-certs\") pod \"f41f516b-db53-4fdd-999b-938e1d6985a1\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") "
Sep 17 23:26:46.885343 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885160    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f41f516b-db53-4fdd-999b-938e1d6985a1" (UID: "f41f516b-db53-4fdd-999b-938e1d6985a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:46.885343 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885242    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-token\") pod \"f41f516b-db53-4fdd-999b-938e1d6985a1\" (UID: \"f41f516b-db53-4fdd-999b-938e1d6985a1\") "
Sep 17 23:26:46.885519 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885345    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f41f516b-db53-4fdd-999b-938e1d6985a1" (UID: "f41f516b-db53-4fdd-999b-938e1d6985a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:46.885519 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885380    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f41f516b-db53-4fdd-999b-938e1d6985a1" (UID: "f41f516b-db53-4fdd-999b-938e1d6985a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:46.885679 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885615    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41f516b-db53-4fdd-999b-938e1d6985a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f41f516b-db53-4fdd-999b-938e1d6985a1" (UID: "f41f516b-db53-4fdd-999b-938e1d6985a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:26:46.885753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885723    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-data\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:46.885753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885740    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:46.885822 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885755    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f41f516b-db53-4fdd-999b-938e1d6985a1-istiod-ca-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:46.885822 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885769    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-credential-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:46.885822 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.885782    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-workload-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:46.887841 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.887813    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f41f516b-db53-4fdd-999b-938e1d6985a1" (UID: "f41f516b-db53-4fdd-999b-938e1d6985a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:26:46.887943 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.887839    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "f41f516b-db53-4fdd-999b-938e1d6985a1" (UID: "f41f516b-db53-4fdd-999b-938e1d6985a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:26:46.887943 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.887850    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f41f516b-db53-4fdd-999b-938e1d6985a1" (UID: "f41f516b-db53-4fdd-999b-938e1d6985a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:26:46.887943 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.887859    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-kube-api-access-62mq7" (OuterVolumeSpecName: "kube-api-access-62mq7") pod "f41f516b-db53-4fdd-999b-938e1d6985a1" (UID: "f41f516b-db53-4fdd-999b-938e1d6985a1"). InnerVolumeSpecName "kube-api-access-62mq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:26:46.986661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.986623    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-podinfo\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:46.986661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.986653    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-envoy\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:46.986661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.986663    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62mq7\" (UniqueName: \"kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-kube-api-access-62mq7\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:46.986661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:46.986672    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f41f516b-db53-4fdd-999b-938e1d6985a1-istio-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:26:47.557826 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.557795    2583 generic.go:356] "Generic (PLEG): container finished" podID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerID="c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560" exitCode=0
Sep 17 23:26:47.558019 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.557845    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"
Sep 17 23:26:47.558019 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.557855    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" event={"ID":"f41f516b-db53-4fdd-999b-938e1d6985a1","Type":"ContainerDied","Data":"c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560"}
Sep 17 23:26:47.558019 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.557897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4" event={"ID":"f41f516b-db53-4fdd-999b-938e1d6985a1","Type":"ContainerDied","Data":"56910f3673c5875c72e87b0a002926ab3be335e8d8c803638b55a1ecf9f7d33d"}
Sep 17 23:26:47.558019 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.557918    2583 scope.go:117] "RemoveContainer" containerID="c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560"
Sep 17 23:26:47.568695 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.568677    2583 scope.go:117] "RemoveContainer" containerID="dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9"
Sep 17 23:26:47.578781 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.578762    2583 scope.go:117] "RemoveContainer" containerID="c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560"
Sep 17 23:26:47.579072 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:26:47.579053    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560\": container with ID starting with c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560 not found: ID does not exist" containerID="c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560"
Sep 17 23:26:47.579131 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.579085    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560"} err="failed to get container status \"c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560\": rpc error: code = NotFound desc = could not find container \"c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560\": container with ID starting with c37eab7503688f5cca5b878e0556577da720e6c9dc59338df6eacc91f32f8560 not found: ID does not exist"
Sep 17 23:26:47.579131 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.579104    2583 scope.go:117] "RemoveContainer" containerID="dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9"
Sep 17 23:26:47.579415 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:26:47.579396    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9\": container with ID starting with dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9 not found: ID does not exist" containerID="dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9"
Sep 17 23:26:47.579512 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.579418    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9"} err="failed to get container status \"dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9\": rpc error: code = NotFound desc = could not find container \"dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9\": container with ID starting with dab06d19de9d75c9540b78044935c1970486a4a61bde73ac9f83b92bbb3074e9 not found: ID does not exist"
Sep 17 23:26:47.580264 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.580246    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"]
Sep 17 23:26:47.584347 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:47.584326    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4"]
Sep 17 23:26:48.488769 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:48.488736    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" path="/var/lib/kubelet/pods/f41f516b-db53-4fdd-999b-938e1d6985a1/volumes"
Sep 17 23:26:50.431331 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431297    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"]
Sep 17 23:26:50.431907 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431887    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy"
Sep 17 23:26:50.432007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431910    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy"
Sep 17 23:26:50.432007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431923    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76d8b5e4-7761-4f02-9889-b75f5a6c5cd1" containerName="revoke-keys"
Sep 17 23:26:50.432007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431931    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="76d8b5e4-7761-4f02-9889-b75f5a6c5cd1" containerName="revoke-keys"
Sep 17 23:26:50.432007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431947    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy"
Sep 17 23:26:50.432007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431955    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy"
Sep 17 23:26:50.432007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431963    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy"
Sep 17 23:26:50.432007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431971    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy"
Sep 17 23:26:50.432007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431990    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c0253d-b72c-4ade-81ba-b872ffcc475b" containerName="payload-pre-processing"
Sep 17 23:26:50.432007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.431997    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c0253d-b72c-4ade-81ba-b872ffcc475b" containerName="payload-pre-processing"
Sep 17 23:26:50.432444 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.432032    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="731f4442-d99d-4a70-a76a-99049546ba98" containerName="main"
Sep 17 23:26:50.432444 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.432040    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="731f4442-d99d-4a70-a76a-99049546ba98" containerName="main"
Sep 17 23:26:50.432444 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.432135    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy"
Sep 17 23:26:50.432444 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.432150    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="76d8b5e4-7761-4f02-9889-b75f5a6c5cd1" containerName="revoke-keys"
Sep 17 23:26:50.432444 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.432159    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy"
Sep 17 23:26:50.432444 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.432167    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f41f516b-db53-4fdd-999b-938e1d6985a1" containerName="istio-proxy"
Sep 17 23:26:50.432444 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.432177    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="31c0253d-b72c-4ade-81ba-b872ffcc475b" containerName="payload-pre-processing"
Sep 17 23:26:50.432444 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.432187    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="731f4442-d99d-4a70-a76a-99049546ba98" containerName="main"
Sep 17 23:26:50.435441 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.435420    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:26:50.438115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.438092    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-f80c49\""
Sep 17 23:26:50.438342 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.438326    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-f80c49-dockercfg-nxc4t\""
Sep 17 23:26:50.446413 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.446391    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"]
Sep 17 23:26:50.463002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.462977    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"]
Sep 17 23:26:50.467627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.463947    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy"
Sep 17 23:26:50.467627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.464013    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy"
Sep 17 23:26:50.467627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.464346    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b646954-840c-4deb-b022-7c8040605f08" containerName="istio-proxy"
Sep 17 23:26:50.471081 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.469806    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:26:50.479038 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.479011    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"]
Sep 17 23:26:50.526076 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.525859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csj7z\" (UniqueName: \"kubernetes.io/projected/61d692d2-aecc-4e80-8141-a726775eb63f-kube-api-access-csj7z\") pod \"payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6\" (UID: \"61d692d2-aecc-4e80-8141-a726775eb63f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:26:50.526076 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.526021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49dbab4a-e50c-4b60-b81d-88dc64524ee2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq\" (UID: \"49dbab4a-e50c-4b60-b81d-88dc64524ee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:26:50.526412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.526110    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6knfs\" (UniqueName: \"kubernetes.io/projected/49dbab4a-e50c-4b60-b81d-88dc64524ee2-kube-api-access-6knfs\") pod \"payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq\" (UID: \"49dbab4a-e50c-4b60-b81d-88dc64524ee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:26:50.526412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.526236    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61d692d2-aecc-4e80-8141-a726775eb63f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6\" (UID: \"61d692d2-aecc-4e80-8141-a726775eb63f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:26:50.626985 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.626946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49dbab4a-e50c-4b60-b81d-88dc64524ee2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq\" (UID: \"49dbab4a-e50c-4b60-b81d-88dc64524ee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:26:50.627190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.627029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6knfs\" (UniqueName: \"kubernetes.io/projected/49dbab4a-e50c-4b60-b81d-88dc64524ee2-kube-api-access-6knfs\") pod \"payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq\" (UID: \"49dbab4a-e50c-4b60-b81d-88dc64524ee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:26:50.627190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.627052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61d692d2-aecc-4e80-8141-a726775eb63f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6\" (UID: \"61d692d2-aecc-4e80-8141-a726775eb63f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:26:50.627190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.627095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csj7z\" (UniqueName: \"kubernetes.io/projected/61d692d2-aecc-4e80-8141-a726775eb63f-kube-api-access-csj7z\") pod \"payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6\" (UID: \"61d692d2-aecc-4e80-8141-a726775eb63f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:26:50.627769 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.627743    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49dbab4a-e50c-4b60-b81d-88dc64524ee2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq\" (UID: \"49dbab4a-e50c-4b60-b81d-88dc64524ee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:26:50.627870 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.627776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61d692d2-aecc-4e80-8141-a726775eb63f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6\" (UID: \"61d692d2-aecc-4e80-8141-a726775eb63f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:26:50.635385 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.635357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csj7z\" (UniqueName: \"kubernetes.io/projected/61d692d2-aecc-4e80-8141-a726775eb63f-kube-api-access-csj7z\") pod \"payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6\" (UID: \"61d692d2-aecc-4e80-8141-a726775eb63f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:26:50.635513 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.635444    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6knfs\" (UniqueName: \"kubernetes.io/projected/49dbab4a-e50c-4b60-b81d-88dc64524ee2-kube-api-access-6knfs\") pod \"payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq\" (UID: \"49dbab4a-e50c-4b60-b81d-88dc64524ee2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:26:50.747729 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.747628    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:26:50.788165 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:50.787857    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:26:51.026427 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:51.026398    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"]
Sep 17 23:26:51.028026 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:26:51.028002    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49dbab4a_e50c_4b60_b81d_88dc64524ee2.slice/crio-875f145b55b0d4b70bb24d440bd6bbfd7fa572e9dee206900248c222ee13c550 WatchSource:0}: Error finding container 875f145b55b0d4b70bb24d440bd6bbfd7fa572e9dee206900248c222ee13c550: Status 404 returned error can't find the container with id 875f145b55b0d4b70bb24d440bd6bbfd7fa572e9dee206900248c222ee13c550
Sep 17 23:26:51.081044 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:51.081016    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"]
Sep 17 23:26:51.081897 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:26:51.081874    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d692d2_aecc_4e80_8141_a726775eb63f.slice/crio-20249e8690c264d6de03c136dbd4092dade404f5bc68cc1464412ef59977ac29 WatchSource:0}: Error finding container 20249e8690c264d6de03c136dbd4092dade404f5bc68cc1464412ef59977ac29: Status 404 returned error can't find the container with id 20249e8690c264d6de03c136dbd4092dade404f5bc68cc1464412ef59977ac29
Sep 17 23:26:51.588965 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:51.588924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6" event={"ID":"61d692d2-aecc-4e80-8141-a726775eb63f","Type":"ContainerStarted","Data":"db40621cfaed212174c35ea26f85760302d4c8535bb6b59ca38afe8fe8d02c7a"}
Sep 17 23:26:51.589455 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:51.589034    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:26:51.589455 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:51.589062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6" event={"ID":"61d692d2-aecc-4e80-8141-a726775eb63f","Type":"ContainerStarted","Data":"20249e8690c264d6de03c136dbd4092dade404f5bc68cc1464412ef59977ac29"}
Sep 17 23:26:51.590567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:51.590540    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq" event={"ID":"49dbab4a-e50c-4b60-b81d-88dc64524ee2","Type":"ContainerStarted","Data":"f00ac8a060dc1afabfd90fd5bb2e69b62fb2efc72c7da163b648956729bea8fa"}
Sep 17 23:26:51.590693 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:51.590587    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq" event={"ID":"49dbab4a-e50c-4b60-b81d-88dc64524ee2","Type":"ContainerStarted","Data":"875f145b55b0d4b70bb24d440bd6bbfd7fa572e9dee206900248c222ee13c550"}
Sep 17 23:26:51.590693 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:51.590674    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:26:51.606960 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:51.606909    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6" podStartSLOduration=1.606894155 podStartE2EDuration="1.606894155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:26:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:26:51.60417517 +0000 UTC m=+1223.211752856" watchObservedRunningTime="2026-09-17 23:26:51.606894155 +0000 UTC m=+1223.214471815"
Sep 17 23:26:51.622203 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:26:51.622155    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq" podStartSLOduration=1.622141879 podStartE2EDuration="1.622141879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:26:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:26:51.619779303 +0000 UTC m=+1223.227356982" watchObservedRunningTime="2026-09-17 23:26:51.622141879 +0000 UTC m=+1223.229719539"
Sep 17 23:27:02.599376 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:02.599342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:27:02.600076 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:02.600058    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:27:12.378972 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.378939    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"]
Sep 17 23:27:12.382312 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.382291    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.384758 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.384733    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-f6ac6e-openshift-default-dockercfg-7rnhj\""
Sep 17 23:27:12.393562 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.393534    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"]
Sep 17 23:27:12.463552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.458276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-certs\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.463552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.458348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e808fb8-abb3-4d7f-a760-f11aa279af15-istiod-ca-cert\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.463552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.458397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzbng\" (UniqueName: \"kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-kube-api-access-lzbng\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.463552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.458455    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-credential-socket\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.463552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.458503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-envoy\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.463552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.458562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-podinfo\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.463552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.458622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-socket\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.463552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.458696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-data\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.463552 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.458732    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-token\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.559528 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.559451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e808fb8-abb3-4d7f-a760-f11aa279af15-istiod-ca-cert\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.559725 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.559557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzbng\" (UniqueName: \"kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-kube-api-access-lzbng\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.559725 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.559615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-credential-socket\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.559725 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.559643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-envoy\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.559725 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.559698    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-podinfo\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.559961 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.559749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-socket\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.559961 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.559816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-data\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.559961 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.559846    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-token\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.559961 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.559900    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-certs\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.560177 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.560041    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-credential-socket\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.560239 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.560202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-certs\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.560321 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.560284    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e808fb8-abb3-4d7f-a760-f11aa279af15-istiod-ca-cert\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.560488 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.560451    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-socket\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.560656 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.560503    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-data\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.562293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.562263    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-envoy\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.562397 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.562312    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-podinfo\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.567985 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.567963    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzbng\" (UniqueName: \"kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-kube-api-access-lzbng\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.568088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.568039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-token\") pod \"e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") " pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.695153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.695065    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:12.973772 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.973746    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"]
Sep 17 23:27:12.975114 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:27:12.975092    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e808fb8_abb3_4d7f_a760_f11aa279af15.slice/crio-0ecd12bffe27595a2a81cbff64ebaee629932fdc9110fb89e776fe0561c7dcb3 WatchSource:0}: Error finding container 0ecd12bffe27595a2a81cbff64ebaee629932fdc9110fb89e776fe0561c7dcb3: Status 404 returned error can't find the container with id 0ecd12bffe27595a2a81cbff64ebaee629932fdc9110fb89e776fe0561c7dcb3
Sep 17 23:27:12.977541 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.977498    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:27:12.977657 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.977589    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:27:12.977657 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:12.977630    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:27:13.730345 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:13.730311    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" event={"ID":"8e808fb8-abb3-4d7f-a760-f11aa279af15","Type":"ContainerStarted","Data":"9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46"}
Sep 17 23:27:13.730741 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:13.730369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" event={"ID":"8e808fb8-abb3-4d7f-a760-f11aa279af15","Type":"ContainerStarted","Data":"0ecd12bffe27595a2a81cbff64ebaee629932fdc9110fb89e776fe0561c7dcb3"}
Sep 17 23:27:13.750763 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:13.750703    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" podStartSLOduration=1.75068958 podStartE2EDuration="1.75068958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:27:13.749641295 +0000 UTC m=+1245.357218980" watchObservedRunningTime="2026-09-17 23:27:13.75068958 +0000 UTC m=+1245.358267242"
Sep 17 23:27:14.695664 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:14.695629    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:14.700924 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:14.700898    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:14.739483 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:14.739437    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:14.740574 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:14.740554    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:18.133101 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.133066    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"]
Sep 17 23:27:18.136632 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.136615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:27:18.139082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.139058    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-f6ac6e-dockercfg-8989c\""
Sep 17 23:27:18.139203 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.139082    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-f6ac6e\""
Sep 17 23:27:18.149126 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.149100    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"]
Sep 17 23:27:18.213270 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.213231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b042c251-7c75-4ed5-9ee6-bdee0893e429-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc\" (UID: \"b042c251-7c75-4ed5-9ee6-bdee0893e429\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:27:18.213445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.213297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjz5c\" (UniqueName: \"kubernetes.io/projected/b042c251-7c75-4ed5-9ee6-bdee0893e429-kube-api-access-pjz5c\") pod \"payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc\" (UID: \"b042c251-7c75-4ed5-9ee6-bdee0893e429\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:27:18.314010 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.313970    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjz5c\" (UniqueName: \"kubernetes.io/projected/b042c251-7c75-4ed5-9ee6-bdee0893e429-kube-api-access-pjz5c\") pod \"payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc\" (UID: \"b042c251-7c75-4ed5-9ee6-bdee0893e429\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:27:18.314211 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.314118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b042c251-7c75-4ed5-9ee6-bdee0893e429-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc\" (UID: \"b042c251-7c75-4ed5-9ee6-bdee0893e429\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:27:18.314919 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.314893    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b042c251-7c75-4ed5-9ee6-bdee0893e429-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc\" (UID: \"b042c251-7c75-4ed5-9ee6-bdee0893e429\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:27:18.323115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.323091    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjz5c\" (UniqueName: \"kubernetes.io/projected/b042c251-7c75-4ed5-9ee6-bdee0893e429-kube-api-access-pjz5c\") pod \"payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc\" (UID: \"b042c251-7c75-4ed5-9ee6-bdee0893e429\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:27:18.448961 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.448878    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:27:18.724404 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.724376    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"]
Sep 17 23:27:18.727605 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:27:18.727576    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb042c251_7c75_4ed5_9ee6_bdee0893e429.slice/crio-71e3a03eaf6565c47d5556042d72740c24d09ee49a3c104ae0c68ae6722f3b04 WatchSource:0}: Error finding container 71e3a03eaf6565c47d5556042d72740c24d09ee49a3c104ae0c68ae6722f3b04: Status 404 returned error can't find the container with id 71e3a03eaf6565c47d5556042d72740c24d09ee49a3c104ae0c68ae6722f3b04
Sep 17 23:27:18.764675 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:18.764649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc" event={"ID":"b042c251-7c75-4ed5-9ee6-bdee0893e429","Type":"ContainerStarted","Data":"71e3a03eaf6565c47d5556042d72740c24d09ee49a3c104ae0c68ae6722f3b04"}
Sep 17 23:27:19.772353 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:19.772314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc" event={"ID":"b042c251-7c75-4ed5-9ee6-bdee0893e429","Type":"ContainerStarted","Data":"347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b"}
Sep 17 23:27:19.772811 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:19.772405    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:27:19.797754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:19.797707    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc" podStartSLOduration=1.797691796 podStartE2EDuration="1.797691796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:27:19.795271395 +0000 UTC m=+1251.402849084" watchObservedRunningTime="2026-09-17 23:27:19.797691796 +0000 UTC m=+1251.405269456"
Sep 17 23:27:30.653663 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:30.653633    2583 scope.go:117] "RemoveContainer" containerID="ab8048cd4298b20e377dce20aa86d47f5bf2838c31b006d3dc6eda1449422180"
Sep 17 23:27:30.662626 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:30.662604    2583 scope.go:117] "RemoveContainer" containerID="df14cfbeaea3fa99b988da6b0dd5a7c2cf63f49a57ba6cf8ea4bbfe7dc6def86"
Sep 17 23:27:30.781654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:30.781620    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:27:48.961813 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:48.961736    2583 generic.go:356] "Generic (PLEG): container finished" podID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerID="9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46" exitCode=0
Sep 17 23:27:48.962208 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:48.961812    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" event={"ID":"8e808fb8-abb3-4d7f-a760-f11aa279af15","Type":"ContainerDied","Data":"9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46"}
Sep 17 23:27:48.962257 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:48.962246    2583 scope.go:117] "RemoveContainer" containerID="9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46"
Sep 17 23:27:48.963437 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:48.963409    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:27:48.963521 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:48.963498    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:27:48.963559 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:48.963531    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:27:49.974750 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:49.974714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" event={"ID":"8e808fb8-abb3-4d7f-a760-f11aa279af15","Type":"ContainerStarted","Data":"83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0"}
Sep 17 23:27:50.695971 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:50.695933    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:50.696236 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:50.696214    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 17 23:27:50.696287 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:50.696266    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 17 23:27:51.696074 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:51.696039    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 17 23:27:51.696494 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:51.696096    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 17 23:27:52.695790 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:52.695751    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 17 23:27:52.695972 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:52.695813    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 17 23:27:53.695852 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:53.695815    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 17 23:27:53.696281 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:53.695872    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 17 23:27:54.695687 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:54.695643    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 17 23:27:54.695867 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:54.695700    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 17 23:27:55.700515 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:55.700484    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:55.700955 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:55.700855    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:27:55.701656 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:27:55.701635    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:28:02.040285 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:02.040253    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"]
Sep 17 23:28:02.043918 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:02.043901    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"
Sep 17 23:28:02.046597 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:02.046572    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:28:02.046740 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:02.046670    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:28:02.054763 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:02.054733    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"]
Sep 17 23:28:02.068014 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:02.067978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7097ea-da2f-435f-9f6e-5b193443add9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx\" (UID: \"5a7097ea-da2f-435f-9f6e-5b193443add9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"
Sep 17 23:28:02.169390 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:02.169346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7097ea-da2f-435f-9f6e-5b193443add9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx\" (UID: \"5a7097ea-da2f-435f-9f6e-5b193443add9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"
Sep 17 23:28:02.170043 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:02.170015    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7097ea-da2f-435f-9f6e-5b193443add9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx\" (UID: \"5a7097ea-da2f-435f-9f6e-5b193443add9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"
Sep 17 23:28:02.356368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:02.356277    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"
Sep 17 23:28:02.634268 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:02.634235    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"]
Sep 17 23:28:02.635636 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:28:02.635610    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7097ea_da2f_435f_9f6e_5b193443add9.slice/crio-976250e83b152b35c467046e1ad555460674621ea54d2aaa669a165b081ff66b WatchSource:0}: Error finding container 976250e83b152b35c467046e1ad555460674621ea54d2aaa669a165b081ff66b: Status 404 returned error can't find the container with id 976250e83b152b35c467046e1ad555460674621ea54d2aaa669a165b081ff66b
Sep 17 23:28:03.069664 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:03.069626    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx" event={"ID":"5a7097ea-da2f-435f-9f6e-5b193443add9","Type":"ContainerStarted","Data":"0e1ca4d62598fc0194c9bbe924ce1c58b4ca74347ee622ea52ffae341129f050"}
Sep 17 23:28:03.070050 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:03.069685    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx" event={"ID":"5a7097ea-da2f-435f-9f6e-5b193443add9","Type":"ContainerStarted","Data":"976250e83b152b35c467046e1ad555460674621ea54d2aaa669a165b081ff66b"}
Sep 17 23:28:03.089494 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:03.089416    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx" podStartSLOduration=1.089400589 podStartE2EDuration="1.089400589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:28:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:28:03.087155525 +0000 UTC m=+1294.694733186" watchObservedRunningTime="2026-09-17 23:28:03.089400589 +0000 UTC m=+1294.696978250"
Sep 17 23:28:04.077007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:04.076967    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a7097ea-da2f-435f-9f6e-5b193443add9" containerID="0e1ca4d62598fc0194c9bbe924ce1c58b4ca74347ee622ea52ffae341129f050" exitCode=0
Sep 17 23:28:04.077484 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:04.077058    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx" event={"ID":"5a7097ea-da2f-435f-9f6e-5b193443add9","Type":"ContainerDied","Data":"0e1ca4d62598fc0194c9bbe924ce1c58b4ca74347ee622ea52ffae341129f050"}
Sep 17 23:28:05.219416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:05.219388    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"
Sep 17 23:28:05.301336 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:05.301295    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7097ea-da2f-435f-9f6e-5b193443add9-maas-api-service-ca\") pod \"5a7097ea-da2f-435f-9f6e-5b193443add9\" (UID: \"5a7097ea-da2f-435f-9f6e-5b193443add9\") "
Sep 17 23:28:05.301671 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:05.301647    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7097ea-da2f-435f-9f6e-5b193443add9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5a7097ea-da2f-435f-9f6e-5b193443add9" (UID: "5a7097ea-da2f-435f-9f6e-5b193443add9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:28:05.402815 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:05.402732    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7097ea-da2f-435f-9f6e-5b193443add9-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:28:06.091033 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.091002    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"
Sep 17 23:28:06.091234 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.091040    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx" event={"ID":"5a7097ea-da2f-435f-9f6e-5b193443add9","Type":"ContainerDied","Data":"976250e83b152b35c467046e1ad555460674621ea54d2aaa669a165b081ff66b"}
Sep 17 23:28:06.091234 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.091083    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="976250e83b152b35c467046e1ad555460674621ea54d2aaa669a165b081ff66b"
Sep 17 23:28:06.402785 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.402711    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"]
Sep 17 23:28:06.403207 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.403192    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a7097ea-da2f-435f-9f6e-5b193443add9" containerName="revoke-keys"
Sep 17 23:28:06.403250 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.403208    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a7097ea-da2f-435f-9f6e-5b193443add9" containerName="revoke-keys"
Sep 17 23:28:06.403285 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.403280    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a7097ea-da2f-435f-9f6e-5b193443add9" containerName="revoke-keys"
Sep 17 23:28:06.405970 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.405950    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.408661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.408448    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-f80c49\"/\"openshift-service-ca.crt\""
Sep 17 23:28:06.408788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.408720    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-f80c49\"/\"auth-test-model-f80c49-kserve-self-signed-certs\""
Sep 17 23:28:06.409308 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.409287    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-f80c49\"/\"default-dockercfg-hhpdp\""
Sep 17 23:28:06.409561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.409357    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-f80c49\"/\"kube-root-ca.crt\""
Sep 17 23:28:06.415938 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.415913    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"]
Sep 17 23:28:06.512611 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.512582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-model-cache\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.512611 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.512611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-tmp-dir\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.512868 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.512650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a612bc81-8072-40f5-813d-36f136bff531-tls-certs\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.512868 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.512790    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-dshm\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.512868 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.512860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-home\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.513004 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.512959    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsph4\" (UniqueName: \"kubernetes.io/projected/a612bc81-8072-40f5-813d-36f136bff531-kube-api-access-gsph4\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.614432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.614397    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a612bc81-8072-40f5-813d-36f136bff531-tls-certs\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.614625 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.614496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-dshm\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.614625 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.614531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-home\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.614625 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.614600    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsph4\" (UniqueName: \"kubernetes.io/projected/a612bc81-8072-40f5-813d-36f136bff531-kube-api-access-gsph4\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.614819 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.614640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-model-cache\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.614819 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.614662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-tmp-dir\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.615043 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.615006    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-home\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.615184 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.615110    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-model-cache\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.615184 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.615137    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-tmp-dir\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.616964 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.616936    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-dshm\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.617124 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.617109    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a612bc81-8072-40f5-813d-36f136bff531-tls-certs\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.622577 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.622556    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsph4\" (UniqueName: \"kubernetes.io/projected/a612bc81-8072-40f5-813d-36f136bff531-kube-api-access-gsph4\") pod \"auth-test-model-f80c49-kserve-795bcf799f-nnv47\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.718686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.718597    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:06.992793 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:06.992764    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"]
Sep 17 23:28:06.994115 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:28:06.994090    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda612bc81_8072_40f5_813d_36f136bff531.slice/crio-c11a43210078908902b4c43389b739461f9eee896750a78654c5bc5ab994310c WatchSource:0}: Error finding container c11a43210078908902b4c43389b739461f9eee896750a78654c5bc5ab994310c: Status 404 returned error can't find the container with id c11a43210078908902b4c43389b739461f9eee896750a78654c5bc5ab994310c
Sep 17 23:28:07.099751 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:07.099713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47" event={"ID":"a612bc81-8072-40f5-813d-36f136bff531","Type":"ContainerStarted","Data":"c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89"}
Sep 17 23:28:07.099929 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:07.099763    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47" event={"ID":"a612bc81-8072-40f5-813d-36f136bff531","Type":"ContainerStarted","Data":"c11a43210078908902b4c43389b739461f9eee896750a78654c5bc5ab994310c"}
Sep 17 23:28:07.118708 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:07.118649    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47" podStartSLOduration=1.118632897 podStartE2EDuration="1.118632897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:28:07.115732078 +0000 UTC m=+1298.723309767" watchObservedRunningTime="2026-09-17 23:28:07.118632897 +0000 UTC m=+1298.726210556"
Sep 17 23:28:09.388208 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:09.388172    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"]
Sep 17 23:28:16.719173 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:16.719131    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:16.719823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:16.719201    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:16.731992 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:16.731970    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:17.172355 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:17.172329    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:28:17.690383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:17.690347    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"]
Sep 17 23:28:17.690684 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:17.690653    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg" podUID="7764973f-3ba9-4a71-81fe-521035faf2e8" containerName="payload-processing" containerID="cri-o://d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf" gracePeriod=30
Sep 17 23:28:17.863762 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:17.863727    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"]
Sep 17 23:28:17.872410 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:17.872378    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-09450b8d-wp8rx"]
Sep 17 23:28:17.954434 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:17.954373    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:28:18.037909 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.037869    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7764973f-3ba9-4a71-81fe-521035faf2e8-plugins-config-volume\") pod \"7764973f-3ba9-4a71-81fe-521035faf2e8\" (UID: \"7764973f-3ba9-4a71-81fe-521035faf2e8\") "
Sep 17 23:28:18.038107 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.038018    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm9jv\" (UniqueName: \"kubernetes.io/projected/7764973f-3ba9-4a71-81fe-521035faf2e8-kube-api-access-qm9jv\") pod \"7764973f-3ba9-4a71-81fe-521035faf2e8\" (UID: \"7764973f-3ba9-4a71-81fe-521035faf2e8\") "
Sep 17 23:28:18.039179 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.039147    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7764973f-3ba9-4a71-81fe-521035faf2e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7764973f-3ba9-4a71-81fe-521035faf2e8" (UID: "7764973f-3ba9-4a71-81fe-521035faf2e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:28:18.048706 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.048663    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7764973f-3ba9-4a71-81fe-521035faf2e8-kube-api-access-qm9jv" (OuterVolumeSpecName: "kube-api-access-qm9jv") pod "7764973f-3ba9-4a71-81fe-521035faf2e8" (UID: "7764973f-3ba9-4a71-81fe-521035faf2e8"). InnerVolumeSpecName "kube-api-access-qm9jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:28:18.139537 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.139498    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7764973f-3ba9-4a71-81fe-521035faf2e8-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:28:18.139537 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.139529    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm9jv\" (UniqueName: \"kubernetes.io/projected/7764973f-3ba9-4a71-81fe-521035faf2e8-kube-api-access-qm9jv\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:28:18.170082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.170038    2583 generic.go:356] "Generic (PLEG): container finished" podID="7764973f-3ba9-4a71-81fe-521035faf2e8" containerID="d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf" exitCode=0
Sep 17 23:28:18.170292 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.170102    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"
Sep 17 23:28:18.170292 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.170122    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg" event={"ID":"7764973f-3ba9-4a71-81fe-521035faf2e8","Type":"ContainerDied","Data":"d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf"}
Sep 17 23:28:18.170292 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.170194    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg" event={"ID":"7764973f-3ba9-4a71-81fe-521035faf2e8","Type":"ContainerDied","Data":"2af1ed6a57e86e62e57a4176c10b7b4d79f4bae0723fef15864b0727e2a09a5e"}
Sep 17 23:28:18.170292 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.170228    2583 scope.go:117] "RemoveContainer" containerID="d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf"
Sep 17 23:28:18.181945 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.181925    2583 scope.go:117] "RemoveContainer" containerID="d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf"
Sep 17 23:28:18.182209 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:28:18.182189    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf\": container with ID starting with d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf not found: ID does not exist" containerID="d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf"
Sep 17 23:28:18.182260 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.182217    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf"} err="failed to get container status \"d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf\": rpc error: code = NotFound desc = could not find container \"d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf\": container with ID starting with d0f3746c0cecd87fd65c02bda76a7bc4a9912dbad6c21988f7cbd144bb3541cf not found: ID does not exist"
Sep 17 23:28:18.201885 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.201846    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"]
Sep 17 23:28:18.207653 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.207585    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg"]
Sep 17 23:28:18.489197 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.489118    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a7097ea-da2f-435f-9f6e-5b193443add9" path="/var/lib/kubelet/pods/5a7097ea-da2f-435f-9f6e-5b193443add9/volumes"
Sep 17 23:28:18.489568 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:18.489553    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7764973f-3ba9-4a71-81fe-521035faf2e8" path="/var/lib/kubelet/pods/7764973f-3ba9-4a71-81fe-521035faf2e8/volumes"
Sep 17 23:28:24.409596 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.409553    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt" podUID="d13a0b83-0788-42df-9e89-1c818c6cc296" containerName="main" containerID="cri-o://b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6" gracePeriod=45
Sep 17 23:28:24.671944 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.671878    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:28:24.810072 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810041    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-model-cache\") pod \"d13a0b83-0788-42df-9e89-1c818c6cc296\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") "
Sep 17 23:28:24.810216 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810143    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-dshm\") pod \"d13a0b83-0788-42df-9e89-1c818c6cc296\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") "
Sep 17 23:28:24.810216 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810173    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-home\") pod \"d13a0b83-0788-42df-9e89-1c818c6cc296\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") "
Sep 17 23:28:24.810333 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810243    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-tmp-dir\") pod \"d13a0b83-0788-42df-9e89-1c818c6cc296\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") "
Sep 17 23:28:24.810333 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810265    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d13a0b83-0788-42df-9e89-1c818c6cc296-tls-certs\") pod \"d13a0b83-0788-42df-9e89-1c818c6cc296\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") "
Sep 17 23:28:24.810333 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810289    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k24p4\" (UniqueName: \"kubernetes.io/projected/d13a0b83-0788-42df-9e89-1c818c6cc296-kube-api-access-k24p4\") pod \"d13a0b83-0788-42df-9e89-1c818c6cc296\" (UID: \"d13a0b83-0788-42df-9e89-1c818c6cc296\") "
Sep 17 23:28:24.810547 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810352    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-model-cache" (OuterVolumeSpecName: "model-cache") pod "d13a0b83-0788-42df-9e89-1c818c6cc296" (UID: "d13a0b83-0788-42df-9e89-1c818c6cc296"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:28:24.810620 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810542    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-home" (OuterVolumeSpecName: "home") pod "d13a0b83-0788-42df-9e89-1c818c6cc296" (UID: "d13a0b83-0788-42df-9e89-1c818c6cc296"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:28:24.810620 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810556    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d13a0b83-0788-42df-9e89-1c818c6cc296" (UID: "d13a0b83-0788-42df-9e89-1c818c6cc296"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:28:24.810727 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810628    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:28:24.810727 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810645    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:28:24.810727 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.810673    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:28:24.812600 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.812576    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-dshm" (OuterVolumeSpecName: "dshm") pod "d13a0b83-0788-42df-9e89-1c818c6cc296" (UID: "d13a0b83-0788-42df-9e89-1c818c6cc296"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:28:24.812738 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.812717    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d13a0b83-0788-42df-9e89-1c818c6cc296-kube-api-access-k24p4" (OuterVolumeSpecName: "kube-api-access-k24p4") pod "d13a0b83-0788-42df-9e89-1c818c6cc296" (UID: "d13a0b83-0788-42df-9e89-1c818c6cc296"). InnerVolumeSpecName "kube-api-access-k24p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:28:24.812797 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.812767    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d13a0b83-0788-42df-9e89-1c818c6cc296-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d13a0b83-0788-42df-9e89-1c818c6cc296" (UID: "d13a0b83-0788-42df-9e89-1c818c6cc296"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:28:24.911760 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.911724    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d13a0b83-0788-42df-9e89-1c818c6cc296-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:28:24.911760 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.911757    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d13a0b83-0788-42df-9e89-1c818c6cc296-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:28:24.911977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:24.911772    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k24p4\" (UniqueName: \"kubernetes.io/projected/d13a0b83-0788-42df-9e89-1c818c6cc296-kube-api-access-k24p4\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:28:25.217829 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:25.217792    2583 generic.go:356] "Generic (PLEG): container finished" podID="d13a0b83-0788-42df-9e89-1c818c6cc296" containerID="b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6" exitCode=0
Sep 17 23:28:25.218002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:25.217843    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"
Sep 17 23:28:25.218002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:25.217877    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt" event={"ID":"d13a0b83-0788-42df-9e89-1c818c6cc296","Type":"ContainerDied","Data":"b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6"}
Sep 17 23:28:25.218002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:25.217918    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt" event={"ID":"d13a0b83-0788-42df-9e89-1c818c6cc296","Type":"ContainerDied","Data":"8e5855357d3fee48fe95293b73733504784881fb32027880f456e9eb80c0b24b"}
Sep 17 23:28:25.218002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:25.217935    2583 scope.go:117] "RemoveContainer" containerID="b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6"
Sep 17 23:28:25.229385 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:25.229362    2583 scope.go:117] "RemoveContainer" containerID="b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6"
Sep 17 23:28:25.229733 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:28:25.229715    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6\": container with ID starting with b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6 not found: ID does not exist" containerID="b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6"
Sep 17 23:28:25.229790 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:25.229742    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6"} err="failed to get container status \"b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6\": rpc error: code = NotFound desc = could not find container \"b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6\": container with ID starting with b63741056c707e317b3ca7ab9d3bbb7e9e461908214a0026f62e6222b64b0ba6 not found: ID does not exist"
Sep 17 23:28:25.241456 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:25.241431    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"]
Sep 17 23:28:25.246445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:25.246418    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-825f30/e2e-conflict-a-3df45c8d-kserve-64b955fccd-g7qzt"]
Sep 17 23:28:26.488364 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:28:26.488333    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d13a0b83-0788-42df-9e89-1c818c6cc296" path="/var/lib/kubelet/pods/d13a0b83-0788-42df-9e89-1c818c6cc296/volumes"
Sep 17 23:30:00.154983 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.154948    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc"]
Sep 17 23:30:00.155567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.155363    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7764973f-3ba9-4a71-81fe-521035faf2e8" containerName="payload-processing"
Sep 17 23:30:00.155567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.155375    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7764973f-3ba9-4a71-81fe-521035faf2e8" containerName="payload-processing"
Sep 17 23:30:00.155567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.155395    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d13a0b83-0788-42df-9e89-1c818c6cc296" containerName="main"
Sep 17 23:30:00.155567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.155400    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d13a0b83-0788-42df-9e89-1c818c6cc296" containerName="main"
Sep 17 23:30:00.155567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.155489    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7764973f-3ba9-4a71-81fe-521035faf2e8" containerName="payload-processing"
Sep 17 23:30:00.155567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.155498    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d13a0b83-0788-42df-9e89-1c818c6cc296" containerName="main"
Sep 17 23:30:00.158627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.158610    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg"]
Sep 17 23:30:00.158754 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.158734    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc"
Sep 17 23:30:00.161884 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.161858    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9"]
Sep 17 23:30:00.161991 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.161961    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg"
Sep 17 23:30:00.164090 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.164073    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:30:00.165110 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.165079    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9"
Sep 17 23:30:00.169816 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.169799    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc"
Sep 17 23:30:00.177949 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.176702    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc"]
Sep 17 23:30:00.181269 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.180908    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg"
Sep 17 23:30:00.181486 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.181430    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg"]
Sep 17 23:30:00.191607 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.191582    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828130-mpbx8"]
Sep 17 23:30:00.196288 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.196266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828130-mpbx8"
Sep 17 23:30:00.203635 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.203598    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9"]
Sep 17 23:30:00.213340 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.212965    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828130-mpbx8"]
Sep 17 23:30:00.230761 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.230560    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9"
Sep 17 23:30:00.239959 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.239824    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828130-mpbx8"
Sep 17 23:30:00.468737 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.468708    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc"]
Sep 17 23:30:00.471092 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:30:00.471069    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14934634_42eb_4160_a699_bdfcb5bbd39e.slice/crio-b073c95d0b4dc228de7674f4e151ebddc85dfeaf4ec7c9a3f18dd8608153da5f WatchSource:0}: Error finding container b073c95d0b4dc228de7674f4e151ebddc85dfeaf4ec7c9a3f18dd8608153da5f: Status 404 returned error can't find the container with id b073c95d0b4dc228de7674f4e151ebddc85dfeaf4ec7c9a3f18dd8608153da5f
Sep 17 23:30:00.488641 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:30:00.488614    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4e3d9a_9794_4831_9feb_61f0c02353f2.slice/crio-e3c2cc5474b1076193ed56b1116a39b6e4e429590844cde6405a430ba03bb5bb WatchSource:0}: Error finding container e3c2cc5474b1076193ed56b1116a39b6e4e429590844cde6405a430ba03bb5bb: Status 404 returned error can't find the container with id e3c2cc5474b1076193ed56b1116a39b6e4e429590844cde6405a430ba03bb5bb
Sep 17 23:30:00.490861 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.490840    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg"]
Sep 17 23:30:00.532733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.532705    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9"]
Sep 17 23:30:00.534517 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:30:00.534454    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592b391d_6fbc_458c_a90f_922c6ef8b919.slice/crio-c4e0dafc377e5c75cafbd1fefc5b351eb1605c1b894473f74cf2d701061e4b4b WatchSource:0}: Error finding container c4e0dafc377e5c75cafbd1fefc5b351eb1605c1b894473f74cf2d701061e4b4b: Status 404 returned error can't find the container with id c4e0dafc377e5c75cafbd1fefc5b351eb1605c1b894473f74cf2d701061e4b4b
Sep 17 23:30:00.559745 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.559722    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29828130-mpbx8"]
Sep 17 23:30:00.571640 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:30:00.571615    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38dc6de1_28d4_456b_88f6_92dc49848dd2.slice/crio-38e5d6000550743df3117b01660c059f56955346e7b909fe9d13c5b63f663699 WatchSource:0}: Error finding container 38e5d6000550743df3117b01660c059f56955346e7b909fe9d13c5b63f663699: Status 404 returned error can't find the container with id 38e5d6000550743df3117b01660c059f56955346e7b909fe9d13c5b63f663699
Sep 17 23:30:00.819384 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.819349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9" event={"ID":"592b391d-6fbc-458c-a90f-922c6ef8b919","Type":"ContainerStarted","Data":"c4e0dafc377e5c75cafbd1fefc5b351eb1605c1b894473f74cf2d701061e4b4b"}
Sep 17 23:30:00.820762 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.820733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828130-mpbx8" event={"ID":"38dc6de1-28d4-456b-88f6-92dc49848dd2","Type":"ContainerStarted","Data":"38e5d6000550743df3117b01660c059f56955346e7b909fe9d13c5b63f663699"}
Sep 17 23:30:00.822299 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.822268    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc" event={"ID":"14934634-42eb-4160-a699-bdfcb5bbd39e","Type":"ContainerStarted","Data":"8f812c9fe57943d6461452446f915885b6e40f4aaa8a8e5d896b4f67195b2567"}
Sep 17 23:30:00.822394 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.822314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc" event={"ID":"14934634-42eb-4160-a699-bdfcb5bbd39e","Type":"ContainerStarted","Data":"b073c95d0b4dc228de7674f4e151ebddc85dfeaf4ec7c9a3f18dd8608153da5f"}
Sep 17 23:30:00.823495 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.823450    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg" event={"ID":"cf4e3d9a-9794-4831-9feb-61f0c02353f2","Type":"ContainerStarted","Data":"e3c2cc5474b1076193ed56b1116a39b6e4e429590844cde6405a430ba03bb5bb"}
Sep 17 23:30:00.840104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:00.840060    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc" podStartSLOduration=0.840046414 podStartE2EDuration="840.046414ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:30:00.839493719 +0000 UTC m=+1412.447071392" watchObservedRunningTime="2026-09-17 23:30:00.840046414 +0000 UTC m=+1412.447624075"
Sep 17 23:30:01.831742 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:01.831655    2583 generic.go:356] "Generic (PLEG): container finished" podID="cf4e3d9a-9794-4831-9feb-61f0c02353f2" containerID="6a159bf0cecd5968734521a249d72e2d57957c5f3e25b1895d5087f807c21ee0" exitCode=0
Sep 17 23:30:01.832132 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:01.831742    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg" event={"ID":"cf4e3d9a-9794-4831-9feb-61f0c02353f2","Type":"ContainerDied","Data":"6a159bf0cecd5968734521a249d72e2d57957c5f3e25b1895d5087f807c21ee0"}
Sep 17 23:30:01.833368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:01.833345    2583 generic.go:356] "Generic (PLEG): container finished" podID="592b391d-6fbc-458c-a90f-922c6ef8b919" containerID="027374d0ca80713ecf32230233a03552783fc7d5784e50fddd23a2e4ef00ec43" exitCode=0
Sep 17 23:30:01.833505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:01.833373    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9" event={"ID":"592b391d-6fbc-458c-a90f-922c6ef8b919","Type":"ContainerDied","Data":"027374d0ca80713ecf32230233a03552783fc7d5784e50fddd23a2e4ef00ec43"}
Sep 17 23:30:01.834887 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:01.834858    2583 generic.go:356] "Generic (PLEG): container finished" podID="38dc6de1-28d4-456b-88f6-92dc49848dd2" containerID="91e95bf625c57b5c26f75a56a9c63179329fd867168b2b975155b9d31e84c499" exitCode=0
Sep 17 23:30:01.834991 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:01.834886    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828130-mpbx8" event={"ID":"38dc6de1-28d4-456b-88f6-92dc49848dd2","Type":"ContainerDied","Data":"91e95bf625c57b5c26f75a56a9c63179329fd867168b2b975155b9d31e84c499"}
Sep 17 23:30:01.836493 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:01.836458    2583 generic.go:356] "Generic (PLEG): container finished" podID="14934634-42eb-4160-a699-bdfcb5bbd39e" containerID="8f812c9fe57943d6461452446f915885b6e40f4aaa8a8e5d896b4f67195b2567" exitCode=0
Sep 17 23:30:01.836584 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:01.836499    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc" event={"ID":"14934634-42eb-4160-a699-bdfcb5bbd39e","Type":"ContainerDied","Data":"8f812c9fe57943d6461452446f915885b6e40f4aaa8a8e5d896b4f67195b2567"}
Sep 17 23:30:03.055007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.054979    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9"
Sep 17 23:30:03.058794 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.058768    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg"
Sep 17 23:30:03.094287 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.094260    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828130-mpbx8"
Sep 17 23:30:03.098588 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.098517    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc"
Sep 17 23:30:03.854686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.854657    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc"
Sep 17 23:30:03.854864 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.854701    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc" event={"ID":"14934634-42eb-4160-a699-bdfcb5bbd39e","Type":"ContainerDied","Data":"b073c95d0b4dc228de7674f4e151ebddc85dfeaf4ec7c9a3f18dd8608153da5f"}
Sep 17 23:30:03.854864 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.854757    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b073c95d0b4dc228de7674f4e151ebddc85dfeaf4ec7c9a3f18dd8608153da5f"
Sep 17 23:30:03.856134 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.856108    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg"
Sep 17 23:30:03.856258 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.856146    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg" event={"ID":"cf4e3d9a-9794-4831-9feb-61f0c02353f2","Type":"ContainerDied","Data":"e3c2cc5474b1076193ed56b1116a39b6e4e429590844cde6405a430ba03bb5bb"}
Sep 17 23:30:03.856258 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.856181    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3c2cc5474b1076193ed56b1116a39b6e4e429590844cde6405a430ba03bb5bb"
Sep 17 23:30:03.857676 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.857654    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9"
Sep 17 23:30:03.857771 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.857670    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9" event={"ID":"592b391d-6fbc-458c-a90f-922c6ef8b919","Type":"ContainerDied","Data":"c4e0dafc377e5c75cafbd1fefc5b351eb1605c1b894473f74cf2d701061e4b4b"}
Sep 17 23:30:03.857771 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.857723    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4e0dafc377e5c75cafbd1fefc5b351eb1605c1b894473f74cf2d701061e4b4b"
Sep 17 23:30:03.859018 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.858995    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828130-mpbx8" event={"ID":"38dc6de1-28d4-456b-88f6-92dc49848dd2","Type":"ContainerDied","Data":"38e5d6000550743df3117b01660c059f56955346e7b909fe9d13c5b63f663699"}
Sep 17 23:30:03.859109 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.859034    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29828130-mpbx8"
Sep 17 23:30:03.859161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:03.859035    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38e5d6000550743df3117b01660c059f56955346e7b909fe9d13c5b63f663699"
Sep 17 23:30:27.269897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.269815    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"]
Sep 17 23:30:27.270335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270218    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592b391d-6fbc-458c-a90f-922c6ef8b919" containerName="cleanup"
Sep 17 23:30:27.270335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270229    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="592b391d-6fbc-458c-a90f-922c6ef8b919" containerName="cleanup"
Sep 17 23:30:27.270335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270243    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4e3d9a-9794-4831-9feb-61f0c02353f2" containerName="cleanup"
Sep 17 23:30:27.270335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270248    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4e3d9a-9794-4831-9feb-61f0c02353f2" containerName="cleanup"
Sep 17 23:30:27.270335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270258    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38dc6de1-28d4-456b-88f6-92dc49848dd2" containerName="cleanup"
Sep 17 23:30:27.270335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270264    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38dc6de1-28d4-456b-88f6-92dc49848dd2" containerName="cleanup"
Sep 17 23:30:27.270335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270274    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14934634-42eb-4160-a699-bdfcb5bbd39e" containerName="cleanup"
Sep 17 23:30:27.270335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270279    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="14934634-42eb-4160-a699-bdfcb5bbd39e" containerName="cleanup"
Sep 17 23:30:27.270625 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270344    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf4e3d9a-9794-4831-9feb-61f0c02353f2" containerName="cleanup"
Sep 17 23:30:27.270625 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270352    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="14934634-42eb-4160-a699-bdfcb5bbd39e" containerName="cleanup"
Sep 17 23:30:27.270625 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270362    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="38dc6de1-28d4-456b-88f6-92dc49848dd2" containerName="cleanup"
Sep 17 23:30:27.270625 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.270367    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="592b391d-6fbc-458c-a90f-922c6ef8b919" containerName="cleanup"
Sep 17 23:30:27.273534 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.273506    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:30:27.276093 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.276070    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-9148ad\""
Sep 17 23:30:27.276210 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.276158    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-9148ad-dockercfg-bdm8q\""
Sep 17 23:30:27.284655 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.284628    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"]
Sep 17 23:30:27.293923 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.293890    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"]
Sep 17 23:30:27.298296 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.298266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:30:27.309370 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.309341    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"]
Sep 17 23:30:27.382639 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.382163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4181e55-4f34-485b-a0b2-fa4a55e9a140-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk\" (UID: \"e4181e55-4f34-485b-a0b2-fa4a55e9a140\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:30:27.382639 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.382283    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqh7q\" (UniqueName: \"kubernetes.io/projected/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-kube-api-access-fqh7q\") pod \"payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw\" (UID: \"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2\") " pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:30:27.382639 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.382330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw\" (UID: \"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2\") " pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:30:27.382639 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.382380    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqwxr\" (UniqueName: \"kubernetes.io/projected/e4181e55-4f34-485b-a0b2-fa4a55e9a140-kube-api-access-zqwxr\") pod \"payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk\" (UID: \"e4181e55-4f34-485b-a0b2-fa4a55e9a140\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:30:27.483987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.483953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqwxr\" (UniqueName: \"kubernetes.io/projected/e4181e55-4f34-485b-a0b2-fa4a55e9a140-kube-api-access-zqwxr\") pod \"payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk\" (UID: \"e4181e55-4f34-485b-a0b2-fa4a55e9a140\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:30:27.484157 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.484050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4181e55-4f34-485b-a0b2-fa4a55e9a140-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk\" (UID: \"e4181e55-4f34-485b-a0b2-fa4a55e9a140\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:30:27.484157 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.484145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqh7q\" (UniqueName: \"kubernetes.io/projected/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-kube-api-access-fqh7q\") pod \"payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw\" (UID: \"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2\") " pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:30:27.484231 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.484190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw\" (UID: \"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2\") " pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:30:27.484890 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.484869    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4181e55-4f34-485b-a0b2-fa4a55e9a140-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk\" (UID: \"e4181e55-4f34-485b-a0b2-fa4a55e9a140\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:30:27.484936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.484876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw\" (UID: \"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2\") " pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:30:27.492641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.492610    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqwxr\" (UniqueName: \"kubernetes.io/projected/e4181e55-4f34-485b-a0b2-fa4a55e9a140-kube-api-access-zqwxr\") pod \"payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk\" (UID: \"e4181e55-4f34-485b-a0b2-fa4a55e9a140\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:30:27.492641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.492627    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqh7q\" (UniqueName: \"kubernetes.io/projected/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-kube-api-access-fqh7q\") pod \"payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw\" (UID: \"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2\") " pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:30:27.585375 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.585283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:30:27.610657 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.610626    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:30:27.867709 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.867678    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"]
Sep 17 23:30:27.869277 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:30:27.869253    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4181e55_4f34_485b_a0b2_fa4a55e9a140.slice/crio-410559178f0c8c95bcc163ce8e0ceff4ab8f51b597a26866a4b1180d1e4df4cd WatchSource:0}: Error finding container 410559178f0c8c95bcc163ce8e0ceff4ab8f51b597a26866a4b1180d1e4df4cd: Status 404 returned error can't find the container with id 410559178f0c8c95bcc163ce8e0ceff4ab8f51b597a26866a4b1180d1e4df4cd
Sep 17 23:30:27.904281 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:27.904244    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"]
Sep 17 23:30:27.907767 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:30:27.907733    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0f6467_e6f9_4c21_9e63_36f15ae84cc2.slice/crio-f644b9a0608eda896457ad0e69c7580c553a204fb5675245a782e296b225d9a4 WatchSource:0}: Error finding container f644b9a0608eda896457ad0e69c7580c553a204fb5675245a782e296b225d9a4: Status 404 returned error can't find the container with id f644b9a0608eda896457ad0e69c7580c553a204fb5675245a782e296b225d9a4
Sep 17 23:30:28.026942 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:28.026909    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw" event={"ID":"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2","Type":"ContainerStarted","Data":"0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e"}
Sep 17 23:30:28.027128 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:28.026969    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:30:28.027128 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:28.026991    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw" event={"ID":"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2","Type":"ContainerStarted","Data":"f644b9a0608eda896457ad0e69c7580c553a204fb5675245a782e296b225d9a4"}
Sep 17 23:30:28.028787 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:28.028756    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk" event={"ID":"e4181e55-4f34-485b-a0b2-fa4a55e9a140","Type":"ContainerStarted","Data":"573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb"}
Sep 17 23:30:28.028897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:28.028812    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk" event={"ID":"e4181e55-4f34-485b-a0b2-fa4a55e9a140","Type":"ContainerStarted","Data":"410559178f0c8c95bcc163ce8e0ceff4ab8f51b597a26866a4b1180d1e4df4cd"}
Sep 17 23:30:28.028897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:28.028844    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:30:28.046568 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:28.046505    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw" podStartSLOduration=1.046484021 podStartE2EDuration="1.046484021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:30:28.043914359 +0000 UTC m=+1439.651492044" watchObservedRunningTime="2026-09-17 23:30:28.046484021 +0000 UTC m=+1439.654061679"
Sep 17 23:30:28.063969 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:28.063913    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk" podStartSLOduration=1.06389513 podStartE2EDuration="1.06389513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:30:28.06161746 +0000 UTC m=+1439.669195147" watchObservedRunningTime="2026-09-17 23:30:28.06389513 +0000 UTC m=+1439.671472813"
Sep 17 23:30:30.731265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:30.731229    2583 scope.go:117] "RemoveContainer" containerID="3931ff05c3c144f67eb239232ba28f5b5c9887bae6c702e9c239b7f441efb8ca"
Sep 17 23:30:30.741057 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:30.741030    2583 scope.go:117] "RemoveContainer" containerID="98973184c2c354a85b199400cf313f5312fc26a4096c556d8d0ecc1e2082cad3"
Sep 17 23:30:39.038052 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:39.038016    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:30:39.038577 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:30:39.038146    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:31:02.110978 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.110939    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"]
Sep 17 23:31:02.114324 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.114306    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:31:02.118873 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.118852    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-b54c32-dockercfg-sdcnh\""
Sep 17 23:31:02.118873 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.118852    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-b54c32\""
Sep 17 23:31:02.130551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.130526    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"]
Sep 17 23:31:02.241560 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.241519    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krctm\" (UniqueName: \"kubernetes.io/projected/4263be0b-de86-4690-a3e7-daf0c74086dd-kube-api-access-krctm\") pod \"payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88\" (UID: \"4263be0b-de86-4690-a3e7-daf0c74086dd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:31:02.241740 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.241589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4263be0b-de86-4690-a3e7-daf0c74086dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88\" (UID: \"4263be0b-de86-4690-a3e7-daf0c74086dd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:31:02.343093 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.343058    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krctm\" (UniqueName: \"kubernetes.io/projected/4263be0b-de86-4690-a3e7-daf0c74086dd-kube-api-access-krctm\") pod \"payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88\" (UID: \"4263be0b-de86-4690-a3e7-daf0c74086dd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:31:02.343093 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.343098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4263be0b-de86-4690-a3e7-daf0c74086dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88\" (UID: \"4263be0b-de86-4690-a3e7-daf0c74086dd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:31:02.343846 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.343825    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4263be0b-de86-4690-a3e7-daf0c74086dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88\" (UID: \"4263be0b-de86-4690-a3e7-daf0c74086dd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:31:02.359201 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.359174    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krctm\" (UniqueName: \"kubernetes.io/projected/4263be0b-de86-4690-a3e7-daf0c74086dd-kube-api-access-krctm\") pod \"payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88\" (UID: \"4263be0b-de86-4690-a3e7-daf0c74086dd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:31:02.425384 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.425280    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:31:02.710830 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:02.710795    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"]
Sep 17 23:31:02.711710 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:31:02.711676    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4263be0b_de86_4690_a3e7_daf0c74086dd.slice/crio-c495d38428fd8499c0edb75d2111e03feb31692fa2dacfd68955fadea62e1511 WatchSource:0}: Error finding container c495d38428fd8499c0edb75d2111e03feb31692fa2dacfd68955fadea62e1511: Status 404 returned error can't find the container with id c495d38428fd8499c0edb75d2111e03feb31692fa2dacfd68955fadea62e1511
Sep 17 23:31:03.275343 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:03.275302    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88" event={"ID":"4263be0b-de86-4690-a3e7-daf0c74086dd","Type":"ContainerStarted","Data":"ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560"}
Sep 17 23:31:03.275828 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:03.275363    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88" event={"ID":"4263be0b-de86-4690-a3e7-daf0c74086dd","Type":"ContainerStarted","Data":"c495d38428fd8499c0edb75d2111e03feb31692fa2dacfd68955fadea62e1511"}
Sep 17 23:31:03.275828 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:03.275392    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:31:03.292897 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:03.292853    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88" podStartSLOduration=1.29283829 podStartE2EDuration="1.29283829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:31:03.29128928 +0000 UTC m=+1474.898866957" watchObservedRunningTime="2026-09-17 23:31:03.29283829 +0000 UTC m=+1474.900415950"
Sep 17 23:31:14.284502 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:14.284455    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:31:28.118323 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:28.118288    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"]
Sep 17 23:31:28.121995 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:28.121976    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"
Sep 17 23:31:28.124762 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:28.124741    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:31:28.124870 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:28.124778    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:31:28.132884 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:28.132857    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"]
Sep 17 23:31:28.210927 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:28.210890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0939465b-c998-4f42-9580-18600641c8c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9148ad-fksj9\" (UID: \"0939465b-c998-4f42-9580-18600641c8c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"
Sep 17 23:31:28.311503 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:28.311453    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0939465b-c998-4f42-9580-18600641c8c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9148ad-fksj9\" (UID: \"0939465b-c998-4f42-9580-18600641c8c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"
Sep 17 23:31:28.312098 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:28.312074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0939465b-c998-4f42-9580-18600641c8c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9148ad-fksj9\" (UID: \"0939465b-c998-4f42-9580-18600641c8c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"
Sep 17 23:31:28.434412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:28.434332    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"
Sep 17 23:31:28.709192 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:28.709163    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"]
Sep 17 23:31:28.710358 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:31:28.710331    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0939465b_c998_4f42_9580_18600641c8c9.slice/crio-e41d2328ec9119b7df74d6fdf21879f6c5d0f535d961031b3857094042ce4b02 WatchSource:0}: Error finding container e41d2328ec9119b7df74d6fdf21879f6c5d0f535d961031b3857094042ce4b02: Status 404 returned error can't find the container with id e41d2328ec9119b7df74d6fdf21879f6c5d0f535d961031b3857094042ce4b02
Sep 17 23:31:29.449191 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:29.449145    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9" event={"ID":"0939465b-c998-4f42-9580-18600641c8c9","Type":"ContainerStarted","Data":"43f6c6fe97e7d92a55c99bfa39bd7861ca2d76df247057c2d415a6a19623eb6c"}
Sep 17 23:31:29.450097 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:29.449258    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9" event={"ID":"0939465b-c998-4f42-9580-18600641c8c9","Type":"ContainerStarted","Data":"e41d2328ec9119b7df74d6fdf21879f6c5d0f535d961031b3857094042ce4b02"}
Sep 17 23:31:29.468325 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:29.468272    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9" podStartSLOduration=1.468255613 podStartE2EDuration="1.468255613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:31:29.465639969 +0000 UTC m=+1501.073217650" watchObservedRunningTime="2026-09-17 23:31:29.468255613 +0000 UTC m=+1501.075833274"
Sep 17 23:31:30.457313 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:30.457281    2583 generic.go:356] "Generic (PLEG): container finished" podID="0939465b-c998-4f42-9580-18600641c8c9" containerID="43f6c6fe97e7d92a55c99bfa39bd7861ca2d76df247057c2d415a6a19623eb6c" exitCode=0
Sep 17 23:31:30.457716 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:30.457371    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9" event={"ID":"0939465b-c998-4f42-9580-18600641c8c9","Type":"ContainerDied","Data":"43f6c6fe97e7d92a55c99bfa39bd7861ca2d76df247057c2d415a6a19623eb6c"}
Sep 17 23:31:30.768336 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:30.768304    2583 scope.go:117] "RemoveContainer" containerID="9e7fccfbfaf59f2729bc5606e378670231aedffcfff2d86f81c27b77654ab66c"
Sep 17 23:31:31.593408 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:31.593376    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"
Sep 17 23:31:31.647334 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:31.647306    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0939465b-c998-4f42-9580-18600641c8c9-maas-api-service-ca\") pod \"0939465b-c998-4f42-9580-18600641c8c9\" (UID: \"0939465b-c998-4f42-9580-18600641c8c9\") "
Sep 17 23:31:31.647719 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:31.647694    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0939465b-c998-4f42-9580-18600641c8c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0939465b-c998-4f42-9580-18600641c8c9" (UID: "0939465b-c998-4f42-9580-18600641c8c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:31:31.748658 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:31.748570    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0939465b-c998-4f42-9580-18600641c8c9-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:31:32.471835 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:32.471809    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"
Sep 17 23:31:32.472040 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:32.471807    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9" event={"ID":"0939465b-c998-4f42-9580-18600641c8c9","Type":"ContainerDied","Data":"e41d2328ec9119b7df74d6fdf21879f6c5d0f535d961031b3857094042ce4b02"}
Sep 17 23:31:32.472040 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:32.471897    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e41d2328ec9119b7df74d6fdf21879f6c5d0f535d961031b3857094042ce4b02"
Sep 17 23:31:43.701286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:43.701072    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"]
Sep 17 23:31:43.701736 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:43.701367    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw" podUID="3e0f6467-e6f9-4c21-9e63-36f15ae84cc2" containerName="payload-processing" containerID="cri-o://0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e" gracePeriod=30
Sep 17 23:31:43.705977 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:43.705951    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"]
Sep 17 23:31:43.706338 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:43.706314    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk" podUID="e4181e55-4f34-485b-a0b2-fa4a55e9a140" containerName="payload-pre-processing" containerID="cri-o://573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb" gracePeriod=30
Sep 17 23:31:43.872662 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:43.872611    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"]
Sep 17 23:31:43.877630 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:43.877600    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9148ad-fksj9"]
Sep 17 23:31:43.992033 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:43.992003    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:31:44.035611 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.030646    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:31:44.084520 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.083627    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-plugins-config-volume\") pod \"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2\" (UID: \"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2\") "
Sep 17 23:31:44.084520 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.083756    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqh7q\" (UniqueName: \"kubernetes.io/projected/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-kube-api-access-fqh7q\") pod \"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2\" (UID: \"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2\") "
Sep 17 23:31:44.085278 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.085233    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3e0f6467-e6f9-4c21-9e63-36f15ae84cc2" (UID: "3e0f6467-e6f9-4c21-9e63-36f15ae84cc2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:31:44.089628 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.089594    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-kube-api-access-fqh7q" (OuterVolumeSpecName: "kube-api-access-fqh7q") pod "3e0f6467-e6f9-4c21-9e63-36f15ae84cc2" (UID: "3e0f6467-e6f9-4c21-9e63-36f15ae84cc2"). InnerVolumeSpecName "kube-api-access-fqh7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:44.185294 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.185263    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4181e55-4f34-485b-a0b2-fa4a55e9a140-plugins-config-volume\") pod \"e4181e55-4f34-485b-a0b2-fa4a55e9a140\" (UID: \"e4181e55-4f34-485b-a0b2-fa4a55e9a140\") "
Sep 17 23:31:44.185529 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.185391    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqwxr\" (UniqueName: \"kubernetes.io/projected/e4181e55-4f34-485b-a0b2-fa4a55e9a140-kube-api-access-zqwxr\") pod \"e4181e55-4f34-485b-a0b2-fa4a55e9a140\" (UID: \"e4181e55-4f34-485b-a0b2-fa4a55e9a140\") "
Sep 17 23:31:44.185641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.185614    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4181e55-4f34-485b-a0b2-fa4a55e9a140-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e4181e55-4f34-485b-a0b2-fa4a55e9a140" (UID: "e4181e55-4f34-485b-a0b2-fa4a55e9a140"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:31:44.185875 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.185856    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4181e55-4f34-485b-a0b2-fa4a55e9a140-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:31:44.185923 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.185880    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:31:44.185923 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.185894    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqh7q\" (UniqueName: \"kubernetes.io/projected/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2-kube-api-access-fqh7q\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:31:44.187933 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.187906    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4181e55-4f34-485b-a0b2-fa4a55e9a140-kube-api-access-zqwxr" (OuterVolumeSpecName: "kube-api-access-zqwxr") pod "e4181e55-4f34-485b-a0b2-fa4a55e9a140" (UID: "e4181e55-4f34-485b-a0b2-fa4a55e9a140"). InnerVolumeSpecName "kube-api-access-zqwxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:44.286843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.286813    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqwxr\" (UniqueName: \"kubernetes.io/projected/e4181e55-4f34-485b-a0b2-fa4a55e9a140-kube-api-access-zqwxr\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:31:44.495000 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.494964    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0939465b-c998-4f42-9580-18600641c8c9" path="/var/lib/kubelet/pods/0939465b-c998-4f42-9580-18600641c8c9/volumes"
Sep 17 23:31:44.555852 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.555765    2583 generic.go:356] "Generic (PLEG): container finished" podID="e4181e55-4f34-485b-a0b2-fa4a55e9a140" containerID="573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb" exitCode=0
Sep 17 23:31:44.555852 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.555819    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"
Sep 17 23:31:44.556034 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.555842    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk" event={"ID":"e4181e55-4f34-485b-a0b2-fa4a55e9a140","Type":"ContainerDied","Data":"573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb"}
Sep 17 23:31:44.556034 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.555896    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk" event={"ID":"e4181e55-4f34-485b-a0b2-fa4a55e9a140","Type":"ContainerDied","Data":"410559178f0c8c95bcc163ce8e0ceff4ab8f51b597a26866a4b1180d1e4df4cd"}
Sep 17 23:31:44.556034 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.555918    2583 scope.go:117] "RemoveContainer" containerID="573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb"
Sep 17 23:31:44.557450 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.557427    2583 generic.go:356] "Generic (PLEG): container finished" podID="3e0f6467-e6f9-4c21-9e63-36f15ae84cc2" containerID="0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e" exitCode=0
Sep 17 23:31:44.557555 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.557500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw" event={"ID":"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2","Type":"ContainerDied","Data":"0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e"}
Sep 17 23:31:44.557555 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.557514    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"
Sep 17 23:31:44.557555 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.557547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw" event={"ID":"3e0f6467-e6f9-4c21-9e63-36f15ae84cc2","Type":"ContainerDied","Data":"f644b9a0608eda896457ad0e69c7580c553a204fb5675245a782e296b225d9a4"}
Sep 17 23:31:44.566036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.566019    2583 scope.go:117] "RemoveContainer" containerID="573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb"
Sep 17 23:31:44.566315 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:31:44.566296    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb\": container with ID starting with 573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb not found: ID does not exist" containerID="573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb"
Sep 17 23:31:44.566376 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.566323    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb"} err="failed to get container status \"573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb\": rpc error: code = NotFound desc = could not find container \"573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb\": container with ID starting with 573d17f447256141d9e5b7c8a35591b4a4056eeb28f3966d655ca2b16b7f6beb not found: ID does not exist"
Sep 17 23:31:44.566376 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.566338    2583 scope.go:117] "RemoveContainer" containerID="0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e"
Sep 17 23:31:44.576049 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.576030    2583 scope.go:117] "RemoveContainer" containerID="0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e"
Sep 17 23:31:44.576224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.576205    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"]
Sep 17 23:31:44.576386 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:31:44.576365    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e\": container with ID starting with 0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e not found: ID does not exist" containerID="0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e"
Sep 17 23:31:44.576511 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.576393    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e"} err="failed to get container status \"0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e\": rpc error: code = NotFound desc = could not find container \"0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e\": container with ID starting with 0bb0f3731c7f7028fd81136c2bc67ad429f48fa1498c7f157040ebbf0a4c6c2e not found: ID does not exist"
Sep 17 23:31:44.580330 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.580309    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw"]
Sep 17 23:31:44.591892 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.591868    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"]
Sep 17 23:31:44.594579 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:44.594558    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk"]
Sep 17 23:31:46.492898 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:46.492867    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e0f6467-e6f9-4c21-9e63-36f15ae84cc2" path="/var/lib/kubelet/pods/3e0f6467-e6f9-4c21-9e63-36f15ae84cc2/volumes"
Sep 17 23:31:46.493371 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:46.493262    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4181e55-4f34-485b-a0b2-fa4a55e9a140" path="/var/lib/kubelet/pods/e4181e55-4f34-485b-a0b2-fa4a55e9a140/volumes"
Sep 17 23:31:50.696892 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.696856    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"]
Sep 17 23:31:50.697346 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.697331    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0939465b-c998-4f42-9580-18600641c8c9" containerName="revoke-keys"
Sep 17 23:31:50.697393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.697348    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0939465b-c998-4f42-9580-18600641c8c9" containerName="revoke-keys"
Sep 17 23:31:50.697393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.697359    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e0f6467-e6f9-4c21-9e63-36f15ae84cc2" containerName="payload-processing"
Sep 17 23:31:50.697393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.697365    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e0f6467-e6f9-4c21-9e63-36f15ae84cc2" containerName="payload-processing"
Sep 17 23:31:50.697393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.697375    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4181e55-4f34-485b-a0b2-fa4a55e9a140" containerName="payload-pre-processing"
Sep 17 23:31:50.697393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.697381    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4181e55-4f34-485b-a0b2-fa4a55e9a140" containerName="payload-pre-processing"
Sep 17 23:31:50.697585 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.697453    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4181e55-4f34-485b-a0b2-fa4a55e9a140" containerName="payload-pre-processing"
Sep 17 23:31:50.697585 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.697480    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e0f6467-e6f9-4c21-9e63-36f15ae84cc2" containerName="payload-processing"
Sep 17 23:31:50.697585 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.697486    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0939465b-c998-4f42-9580-18600641c8c9" containerName="revoke-keys"
Sep 17 23:31:50.700588 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.700569    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"
Sep 17 23:31:50.703023 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.703000    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:31:50.703109 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.703045    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:31:50.708451 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.708426    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"]
Sep 17 23:31:50.856560 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.856524    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a0dae4-fc7f-4e7f-8720-4ca719047270-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b54c32-sd245\" (UID: \"99a0dae4-fc7f-4e7f-8720-4ca719047270\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"
Sep 17 23:31:50.958115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.958013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a0dae4-fc7f-4e7f-8720-4ca719047270-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b54c32-sd245\" (UID: \"99a0dae4-fc7f-4e7f-8720-4ca719047270\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"
Sep 17 23:31:50.958865 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:50.958834    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a0dae4-fc7f-4e7f-8720-4ca719047270-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b54c32-sd245\" (UID: \"99a0dae4-fc7f-4e7f-8720-4ca719047270\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"
Sep 17 23:31:51.015305 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:51.015276    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"
Sep 17 23:31:51.287505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:51.287478    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"]
Sep 17 23:31:51.288839 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:31:51.288815    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a0dae4_fc7f_4e7f_8720_4ca719047270.slice/crio-fb62209774f92f8b0a2a2e17f71d80b337ab592cdb0801ef1e49144309340e6b WatchSource:0}: Error finding container fb62209774f92f8b0a2a2e17f71d80b337ab592cdb0801ef1e49144309340e6b: Status 404 returned error can't find the container with id fb62209774f92f8b0a2a2e17f71d80b337ab592cdb0801ef1e49144309340e6b
Sep 17 23:31:51.610212 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:51.610178    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245" event={"ID":"99a0dae4-fc7f-4e7f-8720-4ca719047270","Type":"ContainerStarted","Data":"27bdea94b26625b45109e95c63f0e053100be7bee1bf398c8ddb7fb5f5be732c"}
Sep 17 23:31:51.610394 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:51.610234    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245" event={"ID":"99a0dae4-fc7f-4e7f-8720-4ca719047270","Type":"ContainerStarted","Data":"fb62209774f92f8b0a2a2e17f71d80b337ab592cdb0801ef1e49144309340e6b"}
Sep 17 23:31:51.631425 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:51.631362    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245" podStartSLOduration=1.631338617 podStartE2EDuration="1.631338617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:31:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:31:51.629400135 +0000 UTC m=+1523.236977821" watchObservedRunningTime="2026-09-17 23:31:51.631338617 +0000 UTC m=+1523.238916279"
Sep 17 23:31:52.618115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:52.618073    2583 generic.go:356] "Generic (PLEG): container finished" podID="99a0dae4-fc7f-4e7f-8720-4ca719047270" containerID="27bdea94b26625b45109e95c63f0e053100be7bee1bf398c8ddb7fb5f5be732c" exitCode=0
Sep 17 23:31:52.618516 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:52.618165    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245" event={"ID":"99a0dae4-fc7f-4e7f-8720-4ca719047270","Type":"ContainerDied","Data":"27bdea94b26625b45109e95c63f0e053100be7bee1bf398c8ddb7fb5f5be732c"}
Sep 17 23:31:53.764853 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:53.764829    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"
Sep 17 23:31:53.887740 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:53.887656    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a0dae4-fc7f-4e7f-8720-4ca719047270-maas-api-service-ca\") pod \"99a0dae4-fc7f-4e7f-8720-4ca719047270\" (UID: \"99a0dae4-fc7f-4e7f-8720-4ca719047270\") "
Sep 17 23:31:53.887985 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:53.887962    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99a0dae4-fc7f-4e7f-8720-4ca719047270-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "99a0dae4-fc7f-4e7f-8720-4ca719047270" (UID: "99a0dae4-fc7f-4e7f-8720-4ca719047270"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:31:53.988929 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:53.988894    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a0dae4-fc7f-4e7f-8720-4ca719047270-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:31:54.633871 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:54.633840    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"
Sep 17 23:31:54.634040 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:54.633864    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245" event={"ID":"99a0dae4-fc7f-4e7f-8720-4ca719047270","Type":"ContainerDied","Data":"fb62209774f92f8b0a2a2e17f71d80b337ab592cdb0801ef1e49144309340e6b"}
Sep 17 23:31:54.634040 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:31:54.633920    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb62209774f92f8b0a2a2e17f71d80b337ab592cdb0801ef1e49144309340e6b"
Sep 17 23:32:06.323108 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.323070    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"]
Sep 17 23:32:06.323671 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.323314    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88" podUID="4263be0b-de86-4690-a3e7-daf0c74086dd" containerName="payload-pre-processing" containerID="cri-o://ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560" gracePeriod=30
Sep 17 23:32:06.489086 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.489044    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"]
Sep 17 23:32:06.490071 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.490043    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b54c32-sd245"]
Sep 17 23:32:06.586014 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.585953    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:32:06.625589 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.625555    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krctm\" (UniqueName: \"kubernetes.io/projected/4263be0b-de86-4690-a3e7-daf0c74086dd-kube-api-access-krctm\") pod \"4263be0b-de86-4690-a3e7-daf0c74086dd\" (UID: \"4263be0b-de86-4690-a3e7-daf0c74086dd\") "
Sep 17 23:32:06.625774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.625649    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4263be0b-de86-4690-a3e7-daf0c74086dd-plugins-config-volume\") pod \"4263be0b-de86-4690-a3e7-daf0c74086dd\" (UID: \"4263be0b-de86-4690-a3e7-daf0c74086dd\") "
Sep 17 23:32:06.626066 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.626043    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4263be0b-de86-4690-a3e7-daf0c74086dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4263be0b-de86-4690-a3e7-daf0c74086dd" (UID: "4263be0b-de86-4690-a3e7-daf0c74086dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:32:06.627669 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.627642    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4263be0b-de86-4690-a3e7-daf0c74086dd-kube-api-access-krctm" (OuterVolumeSpecName: "kube-api-access-krctm") pod "4263be0b-de86-4690-a3e7-daf0c74086dd" (UID: "4263be0b-de86-4690-a3e7-daf0c74086dd"). InnerVolumeSpecName "kube-api-access-krctm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:32:06.722871 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.722841    2583 generic.go:356] "Generic (PLEG): container finished" podID="4263be0b-de86-4690-a3e7-daf0c74086dd" containerID="ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560" exitCode=0
Sep 17 23:32:06.723048 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.722893    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"
Sep 17 23:32:06.723048 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.722889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88" event={"ID":"4263be0b-de86-4690-a3e7-daf0c74086dd","Type":"ContainerDied","Data":"ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560"}
Sep 17 23:32:06.723048 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.723014    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88" event={"ID":"4263be0b-de86-4690-a3e7-daf0c74086dd","Type":"ContainerDied","Data":"c495d38428fd8499c0edb75d2111e03feb31692fa2dacfd68955fadea62e1511"}
Sep 17 23:32:06.723048 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.723037    2583 scope.go:117] "RemoveContainer" containerID="ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560"
Sep 17 23:32:06.726636 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.726613    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krctm\" (UniqueName: \"kubernetes.io/projected/4263be0b-de86-4690-a3e7-daf0c74086dd-kube-api-access-krctm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:06.726636 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.726637    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4263be0b-de86-4690-a3e7-daf0c74086dd-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:06.733642 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.733626    2583 scope.go:117] "RemoveContainer" containerID="ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560"
Sep 17 23:32:06.733884 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:32:06.733864    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560\": container with ID starting with ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560 not found: ID does not exist" containerID="ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560"
Sep 17 23:32:06.733943 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.733891    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560"} err="failed to get container status \"ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560\": rpc error: code = NotFound desc = could not find container \"ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560\": container with ID starting with ca42e8121c61132051dbc86b091355d1d345dda73a74bfc49422db97a8f32560 not found: ID does not exist"
Sep 17 23:32:06.745519 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.745496    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"]
Sep 17 23:32:06.749303 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:06.749281    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88"]
Sep 17 23:32:08.487918 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:08.487881    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4263be0b-de86-4690-a3e7-daf0c74086dd" path="/var/lib/kubelet/pods/4263be0b-de86-4690-a3e7-daf0c74086dd/volumes"
Sep 17 23:32:08.488292 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:08.488282    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99a0dae4-fc7f-4e7f-8720-4ca719047270" path="/var/lib/kubelet/pods/99a0dae4-fc7f-4e7f-8720-4ca719047270/volumes"
Sep 17 23:32:13.510626 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.510592    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"]
Sep 17 23:32:13.511011 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.510998    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a0dae4-fc7f-4e7f-8720-4ca719047270" containerName="revoke-keys"
Sep 17 23:32:13.511073 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.511012    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a0dae4-fc7f-4e7f-8720-4ca719047270" containerName="revoke-keys"
Sep 17 23:32:13.511073 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.511032    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4263be0b-de86-4690-a3e7-daf0c74086dd" containerName="payload-pre-processing"
Sep 17 23:32:13.511073 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.511037    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4263be0b-de86-4690-a3e7-daf0c74086dd" containerName="payload-pre-processing"
Sep 17 23:32:13.511167 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.511099    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a0dae4-fc7f-4e7f-8720-4ca719047270" containerName="revoke-keys"
Sep 17 23:32:13.511167 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.511110    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4263be0b-de86-4690-a3e7-daf0c74086dd" containerName="payload-pre-processing"
Sep 17 23:32:13.515631 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.515612    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"
Sep 17 23:32:13.518145 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.518100    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:32:13.519147 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.519119    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:32:13.522179 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.522157    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"]
Sep 17 23:32:13.593892 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.593858    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25fc7123-5e10-4fda-91cd-51675fa9e735-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb\" (UID: \"25fc7123-5e10-4fda-91cd-51675fa9e735\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"
Sep 17 23:32:13.694697 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.694664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25fc7123-5e10-4fda-91cd-51675fa9e735-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb\" (UID: \"25fc7123-5e10-4fda-91cd-51675fa9e735\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"
Sep 17 23:32:13.695321 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.695301    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25fc7123-5e10-4fda-91cd-51675fa9e735-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb\" (UID: \"25fc7123-5e10-4fda-91cd-51675fa9e735\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"
Sep 17 23:32:13.827706 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:13.827671    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"
Sep 17 23:32:14.103042 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:14.103011    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"]
Sep 17 23:32:14.104283 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:32:14.104260    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25fc7123_5e10_4fda_91cd_51675fa9e735.slice/crio-4bcdb08cc89a1144d231dc4179f3a5419ef2ce15699fbf532ce23cba02d8ee13 WatchSource:0}: Error finding container 4bcdb08cc89a1144d231dc4179f3a5419ef2ce15699fbf532ce23cba02d8ee13: Status 404 returned error can't find the container with id 4bcdb08cc89a1144d231dc4179f3a5419ef2ce15699fbf532ce23cba02d8ee13
Sep 17 23:32:14.777994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:14.777963    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb" event={"ID":"25fc7123-5e10-4fda-91cd-51675fa9e735","Type":"ContainerStarted","Data":"122dd6bcf8ceeae25ac6b3ae21f46b0418a3e0c1139bfb9c889496d574b16f1a"}
Sep 17 23:32:14.778430 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:14.778018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb" event={"ID":"25fc7123-5e10-4fda-91cd-51675fa9e735","Type":"ContainerStarted","Data":"4bcdb08cc89a1144d231dc4179f3a5419ef2ce15699fbf532ce23cba02d8ee13"}
Sep 17 23:32:14.796122 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:14.796072    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb" podStartSLOduration=1.796055676 podStartE2EDuration="1.796055676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:32:14.794689566 +0000 UTC m=+1546.402267227" watchObservedRunningTime="2026-09-17 23:32:14.796055676 +0000 UTC m=+1546.403633335"
Sep 17 23:32:15.786309 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:15.786271    2583 generic.go:356] "Generic (PLEG): container finished" podID="25fc7123-5e10-4fda-91cd-51675fa9e735" containerID="122dd6bcf8ceeae25ac6b3ae21f46b0418a3e0c1139bfb9c889496d574b16f1a" exitCode=0
Sep 17 23:32:15.786742 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:15.786360    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb" event={"ID":"25fc7123-5e10-4fda-91cd-51675fa9e735","Type":"ContainerDied","Data":"122dd6bcf8ceeae25ac6b3ae21f46b0418a3e0c1139bfb9c889496d574b16f1a"}
Sep 17 23:32:16.931570 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:16.931546    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"
Sep 17 23:32:17.028886 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:17.028853    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25fc7123-5e10-4fda-91cd-51675fa9e735-maas-api-service-ca\") pod \"25fc7123-5e10-4fda-91cd-51675fa9e735\" (UID: \"25fc7123-5e10-4fda-91cd-51675fa9e735\") "
Sep 17 23:32:17.029233 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:17.029202    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25fc7123-5e10-4fda-91cd-51675fa9e735-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "25fc7123-5e10-4fda-91cd-51675fa9e735" (UID: "25fc7123-5e10-4fda-91cd-51675fa9e735"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:32:17.130206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:17.130122    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25fc7123-5e10-4fda-91cd-51675fa9e735-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:17.801099 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:17.801066    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"
Sep 17 23:32:17.801375 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:17.801099    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb" event={"ID":"25fc7123-5e10-4fda-91cd-51675fa9e735","Type":"ContainerDied","Data":"4bcdb08cc89a1144d231dc4179f3a5419ef2ce15699fbf532ce23cba02d8ee13"}
Sep 17 23:32:17.801375 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:17.801157    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bcdb08cc89a1144d231dc4179f3a5419ef2ce15699fbf532ce23cba02d8ee13"
Sep 17 23:32:23.980047 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:23.980014    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg"]
Sep 17 23:32:23.983443 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:23.983415    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-b52922-29828130-lnssg"]
Sep 17 23:32:24.166522 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:24.166488    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"]
Sep 17 23:32:24.169239 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:24.169206    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b52922-sztrb"]
Sep 17 23:32:24.488521 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:24.488484    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25fc7123-5e10-4fda-91cd-51675fa9e735" path="/var/lib/kubelet/pods/25fc7123-5e10-4fda-91cd-51675fa9e735/volumes"
Sep 17 23:32:24.488843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:24.488830    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf4e3d9a-9794-4831-9feb-61f0c02353f2" path="/var/lib/kubelet/pods/cf4e3d9a-9794-4831-9feb-61f0c02353f2/volumes"
Sep 17 23:32:30.792535 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:30.792506    2583 scope.go:117] "RemoveContainer" containerID="2ab12b1330336cc171a4cdfb509c35b72c852c68a8ac60e089a0ca2cdec01ea2"
Sep 17 23:32:30.841036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:30.841004    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"]
Sep 17 23:32:30.841459 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:30.841446    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25fc7123-5e10-4fda-91cd-51675fa9e735" containerName="revoke-keys"
Sep 17 23:32:30.841521 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:30.841473    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="25fc7123-5e10-4fda-91cd-51675fa9e735" containerName="revoke-keys"
Sep 17 23:32:30.841567 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:30.841557    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="25fc7123-5e10-4fda-91cd-51675fa9e735" containerName="revoke-keys"
Sep 17 23:32:30.846237 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:30.846214    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"
Sep 17 23:32:30.848987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:30.848858    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:32:30.848987 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:30.848949    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:32:30.851749 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:30.851727    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"]
Sep 17 23:32:30.981596 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:30.981566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b803ce1-5ece-44cb-bb2b-271a0ff08c8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm\" (UID: \"8b803ce1-5ece-44cb-bb2b-271a0ff08c8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"
Sep 17 23:32:31.013779 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.013750    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"]
Sep 17 23:32:31.017236 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.017218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"
Sep 17 23:32:31.025947 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.025901    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"]
Sep 17 23:32:31.082542 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.082441    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b803ce1-5ece-44cb-bb2b-271a0ff08c8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm\" (UID: \"8b803ce1-5ece-44cb-bb2b-271a0ff08c8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"
Sep 17 23:32:31.083114 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.083088    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b803ce1-5ece-44cb-bb2b-271a0ff08c8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm\" (UID: \"8b803ce1-5ece-44cb-bb2b-271a0ff08c8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"
Sep 17 23:32:31.159604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.159568    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"
Sep 17 23:32:31.183220 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.183188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb605c77-7ba9-404c-9107-78085c43e212-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87\" (UID: \"bb605c77-7ba9-404c-9107-78085c43e212\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"
Sep 17 23:32:31.284930 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.284895    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb605c77-7ba9-404c-9107-78085c43e212-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87\" (UID: \"bb605c77-7ba9-404c-9107-78085c43e212\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"
Sep 17 23:32:31.285597 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.285578    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb605c77-7ba9-404c-9107-78085c43e212-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87\" (UID: \"bb605c77-7ba9-404c-9107-78085c43e212\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"
Sep 17 23:32:31.350183 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.350097    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"
Sep 17 23:32:31.437661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.437604    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"]
Sep 17 23:32:31.439599 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:32:31.439575    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b803ce1_5ece_44cb_bb2b_271a0ff08c8d.slice/crio-de9e60d8f2403dbe26f3bf7a2dc7f29b045418179aa09159b5314f2e966f2340 WatchSource:0}: Error finding container de9e60d8f2403dbe26f3bf7a2dc7f29b045418179aa09159b5314f2e966f2340: Status 404 returned error can't find the container with id de9e60d8f2403dbe26f3bf7a2dc7f29b045418179aa09159b5314f2e966f2340
Sep 17 23:32:31.624375 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.624349    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"]
Sep 17 23:32:31.626065 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:32:31.626039    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb605c77_7ba9_404c_9107_78085c43e212.slice/crio-95570109dee8e329ccea221c3d6f2a0d0f14f08a05397a0e32852d8ebb7bac0a WatchSource:0}: Error finding container 95570109dee8e329ccea221c3d6f2a0d0f14f08a05397a0e32852d8ebb7bac0a: Status 404 returned error can't find the container with id 95570109dee8e329ccea221c3d6f2a0d0f14f08a05397a0e32852d8ebb7bac0a
Sep 17 23:32:31.892169 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.892078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87" event={"ID":"bb605c77-7ba9-404c-9107-78085c43e212","Type":"ContainerStarted","Data":"95570109dee8e329ccea221c3d6f2a0d0f14f08a05397a0e32852d8ebb7bac0a"}
Sep 17 23:32:31.893794 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.893769    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm" event={"ID":"8b803ce1-5ece-44cb-bb2b-271a0ff08c8d","Type":"ContainerStarted","Data":"2b1f453381a6f009f4376d8740a653e7d73e1b69eb5d2a3e263079bde78fa48c"}
Sep 17 23:32:31.893912 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.893812    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm" event={"ID":"8b803ce1-5ece-44cb-bb2b-271a0ff08c8d","Type":"ContainerStarted","Data":"de9e60d8f2403dbe26f3bf7a2dc7f29b045418179aa09159b5314f2e966f2340"}
Sep 17 23:32:31.911265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:31.911216    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm" podStartSLOduration=1.9112034690000002 podStartE2EDuration="1.911203469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:32:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:32:31.909992642 +0000 UTC m=+1563.517570324" watchObservedRunningTime="2026-09-17 23:32:31.911203469 +0000 UTC m=+1563.518781127"
Sep 17 23:32:32.901948 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:32.901914    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb605c77-7ba9-404c-9107-78085c43e212" containerID="d47a10efb699dca3e2b50fab95a1e627a35ed94b8037f799b6df27afe3bcac00" exitCode=0
Sep 17 23:32:32.902409 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:32.902005    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87" event={"ID":"bb605c77-7ba9-404c-9107-78085c43e212","Type":"ContainerDied","Data":"d47a10efb699dca3e2b50fab95a1e627a35ed94b8037f799b6df27afe3bcac00"}
Sep 17 23:32:32.903707 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:32.903673    2583 generic.go:356] "Generic (PLEG): container finished" podID="8b803ce1-5ece-44cb-bb2b-271a0ff08c8d" containerID="2b1f453381a6f009f4376d8740a653e7d73e1b69eb5d2a3e263079bde78fa48c" exitCode=0
Sep 17 23:32:32.903830 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:32.903731    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm" event={"ID":"8b803ce1-5ece-44cb-bb2b-271a0ff08c8d","Type":"ContainerDied","Data":"2b1f453381a6f009f4376d8740a653e7d73e1b69eb5d2a3e263079bde78fa48c"}
Sep 17 23:32:34.050393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.050369    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"
Sep 17 23:32:34.086338 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.086313    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"
Sep 17 23:32:34.112571 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.112539    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b803ce1-5ece-44cb-bb2b-271a0ff08c8d-maas-api-service-ca\") pod \"8b803ce1-5ece-44cb-bb2b-271a0ff08c8d\" (UID: \"8b803ce1-5ece-44cb-bb2b-271a0ff08c8d\") "
Sep 17 23:32:34.112744 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.112672    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb605c77-7ba9-404c-9107-78085c43e212-maas-api-service-ca\") pod \"bb605c77-7ba9-404c-9107-78085c43e212\" (UID: \"bb605c77-7ba9-404c-9107-78085c43e212\") "
Sep 17 23:32:34.112907 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.112883    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b803ce1-5ece-44cb-bb2b-271a0ff08c8d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b803ce1-5ece-44cb-bb2b-271a0ff08c8d" (UID: "8b803ce1-5ece-44cb-bb2b-271a0ff08c8d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:32:34.113028 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.113011    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b803ce1-5ece-44cb-bb2b-271a0ff08c8d-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:34.113092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.113068    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb605c77-7ba9-404c-9107-78085c43e212-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb605c77-7ba9-404c-9107-78085c43e212" (UID: "bb605c77-7ba9-404c-9107-78085c43e212"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:32:34.214166 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.214077    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb605c77-7ba9-404c-9107-78085c43e212-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:34.919020 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.918988    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"
Sep 17 23:32:34.919020 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.919006    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm" event={"ID":"8b803ce1-5ece-44cb-bb2b-271a0ff08c8d","Type":"ContainerDied","Data":"de9e60d8f2403dbe26f3bf7a2dc7f29b045418179aa09159b5314f2e966f2340"}
Sep 17 23:32:34.919263 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.919058    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de9e60d8f2403dbe26f3bf7a2dc7f29b045418179aa09159b5314f2e966f2340"
Sep 17 23:32:34.920658 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.920636    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87" event={"ID":"bb605c77-7ba9-404c-9107-78085c43e212","Type":"ContainerDied","Data":"95570109dee8e329ccea221c3d6f2a0d0f14f08a05397a0e32852d8ebb7bac0a"}
Sep 17 23:32:34.920773 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.920677    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95570109dee8e329ccea221c3d6f2a0d0f14f08a05397a0e32852d8ebb7bac0a"
Sep 17 23:32:34.920773 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:34.920685    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"
Sep 17 23:32:38.273515 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:38.273479    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"]
Sep 17 23:32:38.297808 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:38.297767    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"]
Sep 17 23:32:38.303780 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:38.303750    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"]
Sep 17 23:32:41.857002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:41.856941    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"]
Sep 17 23:32:41.857449 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:41.857171    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484" podUID="3b2ae823-a0f6-4ce6-9522-c81a7de2f25f" containerName="payload-processing" containerID="cri-o://a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524" gracePeriod=30
Sep 17 23:32:42.026078 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.026032    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"]
Sep 17 23:32:42.029010 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.028985    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-efffde-bhwlm"]
Sep 17 23:32:42.154333 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.154304    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:32:42.194900 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.194866    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-plugins-config-volume\") pod \"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f\" (UID: \"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f\") "
Sep 17 23:32:42.195091 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.195075    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rss2t\" (UniqueName: \"kubernetes.io/projected/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-kube-api-access-rss2t\") pod \"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f\" (UID: \"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f\") "
Sep 17 23:32:42.195220 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.195198    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3b2ae823-a0f6-4ce6-9522-c81a7de2f25f" (UID: "3b2ae823-a0f6-4ce6-9522-c81a7de2f25f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:32:42.195424 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.195407    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:42.197234 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.197199    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-kube-api-access-rss2t" (OuterVolumeSpecName: "kube-api-access-rss2t") pod "3b2ae823-a0f6-4ce6-9522-c81a7de2f25f" (UID: "3b2ae823-a0f6-4ce6-9522-c81a7de2f25f"). InnerVolumeSpecName "kube-api-access-rss2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:32:42.297034 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.296997    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rss2t\" (UniqueName: \"kubernetes.io/projected/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f-kube-api-access-rss2t\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:42.488408 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.488329    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b803ce1-5ece-44cb-bb2b-271a0ff08c8d" path="/var/lib/kubelet/pods/8b803ce1-5ece-44cb-bb2b-271a0ff08c8d/volumes"
Sep 17 23:32:42.976600 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.976568    2583 generic.go:356] "Generic (PLEG): container finished" podID="3b2ae823-a0f6-4ce6-9522-c81a7de2f25f" containerID="a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524" exitCode=0
Sep 17 23:32:42.977009 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.976616    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"
Sep 17 23:32:42.977009 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.976657    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484" event={"ID":"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f","Type":"ContainerDied","Data":"a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524"}
Sep 17 23:32:42.977009 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.976713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484" event={"ID":"3b2ae823-a0f6-4ce6-9522-c81a7de2f25f","Type":"ContainerDied","Data":"79d623b7c73c216ab0d32d618da1c542d706a72320cfd612e8f47a33661e6490"}
Sep 17 23:32:42.977009 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.976744    2583 scope.go:117] "RemoveContainer" containerID="a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524"
Sep 17 23:32:42.986125 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.986108    2583 scope.go:117] "RemoveContainer" containerID="a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524"
Sep 17 23:32:42.986404 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:32:42.986389    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524\": container with ID starting with a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524 not found: ID does not exist" containerID="a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524"
Sep 17 23:32:42.986476 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.986411    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524"} err="failed to get container status \"a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524\": rpc error: code = NotFound desc = could not find container \"a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524\": container with ID starting with a25a73f3d1786e315a231737196e007293e6e6bcbc351fbd4919d111bef7c524 not found: ID does not exist"
Sep 17 23:32:42.994360 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.994336    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"]
Sep 17 23:32:42.997299 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:42.997274    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484"]
Sep 17 23:32:44.479760 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:44.479726    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9"]
Sep 17 23:32:44.488936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:44.488863    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b2ae823-a0f6-4ce6-9522-c81a7de2f25f" path="/var/lib/kubelet/pods/3b2ae823-a0f6-4ce6-9522-c81a7de2f25f/volumes"
Sep 17 23:32:44.489284 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:44.489267    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-825f30-29828130-9vhd9"]
Sep 17 23:32:44.695339 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:44.695309    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"]
Sep 17 23:32:44.699709 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:44.699684    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-825f30-qcp87"]
Sep 17 23:32:46.487650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:46.487611    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="592b391d-6fbc-458c-a90f-922c6ef8b919" path="/var/lib/kubelet/pods/592b391d-6fbc-458c-a90f-922c6ef8b919/volumes"
Sep 17 23:32:46.488131 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:46.487946    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb605c77-7ba9-404c-9107-78085c43e212" path="/var/lib/kubelet/pods/bb605c77-7ba9-404c-9107-78085c43e212/volumes"
Sep 17 23:32:50.681682 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:50.681648    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"]
Sep 17 23:32:50.684776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:50.681859    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs" podUID="26220153-8a17-4578-9455-186d3653b6d6" containerName="payload-processing" containerID="cri-o://62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b" gracePeriod=30
Sep 17 23:32:50.688161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:50.688132    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"]
Sep 17 23:32:50.688438 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:50.688393    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc" podUID="c320de76-ed56-46a6-9e8c-42b145544a2b" containerName="payload-pre-processing" containerID="cri-o://949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864" gracePeriod=30
Sep 17 23:32:50.990315 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:50.990292    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:32:50.994232 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:50.994210    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:32:51.035889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.035853    2583 generic.go:356] "Generic (PLEG): container finished" podID="c320de76-ed56-46a6-9e8c-42b145544a2b" containerID="949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864" exitCode=0
Sep 17 23:32:51.036075 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.035905    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"
Sep 17 23:32:51.036075 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.035941    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc" event={"ID":"c320de76-ed56-46a6-9e8c-42b145544a2b","Type":"ContainerDied","Data":"949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864"}
Sep 17 23:32:51.036075 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.036009    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc" event={"ID":"c320de76-ed56-46a6-9e8c-42b145544a2b","Type":"ContainerDied","Data":"420e66ff2042a759399a2dab1e8f2aeefa2e3856b2d0a15757b269df9c98a66f"}
Sep 17 23:32:51.036420 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.036392    2583 scope.go:117] "RemoveContainer" containerID="949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864"
Sep 17 23:32:51.037871 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.037848    2583 generic.go:356] "Generic (PLEG): container finished" podID="26220153-8a17-4578-9455-186d3653b6d6" containerID="62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b" exitCode=0
Sep 17 23:32:51.037949 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.037879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs" event={"ID":"26220153-8a17-4578-9455-186d3653b6d6","Type":"ContainerDied","Data":"62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b"}
Sep 17 23:32:51.037949 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.037889    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"
Sep 17 23:32:51.037949 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.037938    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs" event={"ID":"26220153-8a17-4578-9455-186d3653b6d6","Type":"ContainerDied","Data":"8e9d7436ec896a1277970360f68b7b23d32243c5a5e0a49457c2eaf4cc3a0a1b"}
Sep 17 23:32:51.048260 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.048241    2583 scope.go:117] "RemoveContainer" containerID="949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864"
Sep 17 23:32:51.048605 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:32:51.048584    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864\": container with ID starting with 949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864 not found: ID does not exist" containerID="949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864"
Sep 17 23:32:51.048719 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.048613    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864"} err="failed to get container status \"949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864\": rpc error: code = NotFound desc = could not find container \"949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864\": container with ID starting with 949b70b7e7e26c1b3bbb2a2d6f56a81999f3e33ddb519773e8cb7813f6eaf864 not found: ID does not exist"
Sep 17 23:32:51.048719 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.048629    2583 scope.go:117] "RemoveContainer" containerID="62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b"
Sep 17 23:32:51.059575 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.059554    2583 scope.go:117] "RemoveContainer" containerID="62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b"
Sep 17 23:32:51.059900 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:32:51.059878    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b\": container with ID starting with 62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b not found: ID does not exist" containerID="62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b"
Sep 17 23:32:51.059976 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.059914    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b"} err="failed to get container status \"62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b\": rpc error: code = NotFound desc = could not find container \"62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b\": container with ID starting with 62decb929a582926d7e3abad7a71b7f30620a4f4b98327b1f2a1404fe7af361b not found: ID does not exist"
Sep 17 23:32:51.098583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.098557    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c320de76-ed56-46a6-9e8c-42b145544a2b-plugins-config-volume\") pod \"c320de76-ed56-46a6-9e8c-42b145544a2b\" (UID: \"c320de76-ed56-46a6-9e8c-42b145544a2b\") "
Sep 17 23:32:51.098758 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.098608    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mp4s\" (UniqueName: \"kubernetes.io/projected/c320de76-ed56-46a6-9e8c-42b145544a2b-kube-api-access-4mp4s\") pod \"c320de76-ed56-46a6-9e8c-42b145544a2b\" (UID: \"c320de76-ed56-46a6-9e8c-42b145544a2b\") "
Sep 17 23:32:51.098758 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.098667    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvrfc\" (UniqueName: \"kubernetes.io/projected/26220153-8a17-4578-9455-186d3653b6d6-kube-api-access-lvrfc\") pod \"26220153-8a17-4578-9455-186d3653b6d6\" (UID: \"26220153-8a17-4578-9455-186d3653b6d6\") "
Sep 17 23:32:51.098758 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.098690    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26220153-8a17-4578-9455-186d3653b6d6-plugins-config-volume\") pod \"26220153-8a17-4578-9455-186d3653b6d6\" (UID: \"26220153-8a17-4578-9455-186d3653b6d6\") "
Sep 17 23:32:51.098949 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.098910    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c320de76-ed56-46a6-9e8c-42b145544a2b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c320de76-ed56-46a6-9e8c-42b145544a2b" (UID: "c320de76-ed56-46a6-9e8c-42b145544a2b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:32:51.099074 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.099057    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c320de76-ed56-46a6-9e8c-42b145544a2b-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:51.099126 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.099085    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26220153-8a17-4578-9455-186d3653b6d6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "26220153-8a17-4578-9455-186d3653b6d6" (UID: "26220153-8a17-4578-9455-186d3653b6d6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:32:51.100733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.100714    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26220153-8a17-4578-9455-186d3653b6d6-kube-api-access-lvrfc" (OuterVolumeSpecName: "kube-api-access-lvrfc") pod "26220153-8a17-4578-9455-186d3653b6d6" (UID: "26220153-8a17-4578-9455-186d3653b6d6"). InnerVolumeSpecName "kube-api-access-lvrfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:32:51.100733 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.100724    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c320de76-ed56-46a6-9e8c-42b145544a2b-kube-api-access-4mp4s" (OuterVolumeSpecName: "kube-api-access-4mp4s") pod "c320de76-ed56-46a6-9e8c-42b145544a2b" (UID: "c320de76-ed56-46a6-9e8c-42b145544a2b"). InnerVolumeSpecName "kube-api-access-4mp4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:32:51.199691 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.199662    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mp4s\" (UniqueName: \"kubernetes.io/projected/c320de76-ed56-46a6-9e8c-42b145544a2b-kube-api-access-4mp4s\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:51.199691 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.199687    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvrfc\" (UniqueName: \"kubernetes.io/projected/26220153-8a17-4578-9455-186d3653b6d6-kube-api-access-lvrfc\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:51.199691 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.199696    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26220153-8a17-4578-9455-186d3653b6d6-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:51.369874 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.369840    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"]
Sep 17 23:32:51.370185 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.370136    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy" containerID="cri-o://5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb" gracePeriod=30
Sep 17 23:32:51.384634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.384609    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"]
Sep 17 23:32:51.390647 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.390621    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc"]
Sep 17 23:32:51.400832 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.400803    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"]
Sep 17 23:32:51.406618 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.406584    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs"]
Sep 17 23:32:51.675559 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.675456    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 23:32:51.675559 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:51.675543    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 23:32:52.488001 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:52.487967    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26220153-8a17-4578-9455-186d3653b6d6" path="/var/lib/kubelet/pods/26220153-8a17-4578-9455-186d3653b6d6/volumes"
Sep 17 23:32:52.488372 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:52.488346    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c320de76-ed56-46a6-9e8c-42b145544a2b" path="/var/lib/kubelet/pods/c320de76-ed56-46a6-9e8c-42b145544a2b/volumes"
Sep 17 23:32:53.293316 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.293276    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v" podUID="7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" containerName="main" containerID="cri-o://5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17" gracePeriod=45
Sep 17 23:32:53.317076 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.317033    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c" podUID="3366b1a3-96f0-480e-a818-16283b2e9558" containerName="main" containerID="cri-o://c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9" gracePeriod=45
Sep 17 23:32:53.323290 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.323252    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl" podUID="91b65372-f14b-4803-96be-fbed8e37ce9b" containerName="main" containerID="cri-o://3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259" gracePeriod=45
Sep 17 23:32:53.568699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.568669    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:32:53.620042 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.620018    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:32:53.623295 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.623270    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:32:53.725934 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.725901    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-tmp-dir\") pod \"3366b1a3-96f0-480e-a818-16283b2e9558\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") "
Sep 17 23:32:53.725934 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.725939    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vpw6\" (UniqueName: \"kubernetes.io/projected/3366b1a3-96f0-480e-a818-16283b2e9558-kube-api-access-6vpw6\") pod \"3366b1a3-96f0-480e-a818-16283b2e9558\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") "
Sep 17 23:32:53.726188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.725978    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-dshm\") pod \"91b65372-f14b-4803-96be-fbed8e37ce9b\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") "
Sep 17 23:32:53.726188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726016    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-home\") pod \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") "
Sep 17 23:32:53.726188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726038    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tls-certs\") pod \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") "
Sep 17 23:32:53.726188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726067    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-home\") pod \"91b65372-f14b-4803-96be-fbed8e37ce9b\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") "
Sep 17 23:32:53.726188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726092    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tmp-dir\") pod \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") "
Sep 17 23:32:53.726188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726128    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-dshm\") pod \"3366b1a3-96f0-480e-a818-16283b2e9558\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") "
Sep 17 23:32:53.726188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726171    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b65372-f14b-4803-96be-fbed8e37ce9b-tls-certs\") pod \"91b65372-f14b-4803-96be-fbed8e37ce9b\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") "
Sep 17 23:32:53.726587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726196    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-dshm\") pod \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") "
Sep 17 23:32:53.726587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726222    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-model-cache\") pod \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") "
Sep 17 23:32:53.726587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726224    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3366b1a3-96f0-480e-a818-16283b2e9558" (UID: "3366b1a3-96f0-480e-a818-16283b2e9558"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.726587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726269    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-model-cache\") pod \"3366b1a3-96f0-480e-a818-16283b2e9558\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") "
Sep 17 23:32:53.726587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726303    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-model-cache\") pod \"91b65372-f14b-4803-96be-fbed8e37ce9b\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") "
Sep 17 23:32:53.726587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726352    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-home\") pod \"3366b1a3-96f0-480e-a818-16283b2e9558\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") "
Sep 17 23:32:53.726587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726418    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-tmp-dir\") pod \"91b65372-f14b-4803-96be-fbed8e37ce9b\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") "
Sep 17 23:32:53.726587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726264    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-home" (OuterVolumeSpecName: "home") pod "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" (UID: "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.726587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726431    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" (UID: "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.726587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726542    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-home" (OuterVolumeSpecName: "home") pod "91b65372-f14b-4803-96be-fbed8e37ce9b" (UID: "91b65372-f14b-4803-96be-fbed8e37ce9b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.727095 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726785    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-model-cache" (OuterVolumeSpecName: "model-cache") pod "3366b1a3-96f0-480e-a818-16283b2e9558" (UID: "3366b1a3-96f0-480e-a818-16283b2e9558"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.727095 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726968    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-model-cache" (OuterVolumeSpecName: "model-cache") pod "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" (UID: "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.727095 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.726444    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm2ww\" (UniqueName: \"kubernetes.io/projected/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-kube-api-access-zm2ww\") pod \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\" (UID: \"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f\") "
Sep 17 23:32:53.727095 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.727031    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3366b1a3-96f0-480e-a818-16283b2e9558-tls-certs\") pod \"3366b1a3-96f0-480e-a818-16283b2e9558\" (UID: \"3366b1a3-96f0-480e-a818-16283b2e9558\") "
Sep 17 23:32:53.727095 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.727068    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvglq\" (UniqueName: \"kubernetes.io/projected/91b65372-f14b-4803-96be-fbed8e37ce9b-kube-api-access-dvglq\") pod \"91b65372-f14b-4803-96be-fbed8e37ce9b\" (UID: \"91b65372-f14b-4803-96be-fbed8e37ce9b\") "
Sep 17 23:32:53.727537 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.727517    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.727634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.727542    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.727634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.727555    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.727634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.727567    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.727634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.727578    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.727634 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.727589    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.728782 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.728755    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-kube-api-access-zm2ww" (OuterVolumeSpecName: "kube-api-access-zm2ww") pod "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" (UID: "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f"). InnerVolumeSpecName "kube-api-access-zm2ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:32:53.729265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.728968    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-model-cache" (OuterVolumeSpecName: "model-cache") pod "91b65372-f14b-4803-96be-fbed8e37ce9b" (UID: "91b65372-f14b-4803-96be-fbed8e37ce9b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.729265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.729052    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-dshm" (OuterVolumeSpecName: "dshm") pod "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" (UID: "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.729265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.729051    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" (UID: "7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:32:53.729265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.729112    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-dshm" (OuterVolumeSpecName: "dshm") pod "3366b1a3-96f0-480e-a818-16283b2e9558" (UID: "3366b1a3-96f0-480e-a818-16283b2e9558"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.729265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.729125    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3366b1a3-96f0-480e-a818-16283b2e9558-kube-api-access-6vpw6" (OuterVolumeSpecName: "kube-api-access-6vpw6") pod "3366b1a3-96f0-480e-a818-16283b2e9558" (UID: "3366b1a3-96f0-480e-a818-16283b2e9558"). InnerVolumeSpecName "kube-api-access-6vpw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:32:53.729265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.729225    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-home" (OuterVolumeSpecName: "home") pod "3366b1a3-96f0-480e-a818-16283b2e9558" (UID: "3366b1a3-96f0-480e-a818-16283b2e9558"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.729265 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.729250    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-dshm" (OuterVolumeSpecName: "dshm") pod "91b65372-f14b-4803-96be-fbed8e37ce9b" (UID: "91b65372-f14b-4803-96be-fbed8e37ce9b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.729650 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.729347    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91b65372-f14b-4803-96be-fbed8e37ce9b" (UID: "91b65372-f14b-4803-96be-fbed8e37ce9b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:53.729878 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.729859    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b65372-f14b-4803-96be-fbed8e37ce9b-kube-api-access-dvglq" (OuterVolumeSpecName: "kube-api-access-dvglq") pod "91b65372-f14b-4803-96be-fbed8e37ce9b" (UID: "91b65372-f14b-4803-96be-fbed8e37ce9b"). InnerVolumeSpecName "kube-api-access-dvglq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:32:53.730248 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.730232    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91b65372-f14b-4803-96be-fbed8e37ce9b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91b65372-f14b-4803-96be-fbed8e37ce9b" (UID: "91b65372-f14b-4803-96be-fbed8e37ce9b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:32:53.730788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.730771    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3366b1a3-96f0-480e-a818-16283b2e9558-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3366b1a3-96f0-480e-a818-16283b2e9558" (UID: "3366b1a3-96f0-480e-a818-16283b2e9558"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:32:53.828368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828274    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828303    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828315    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828325    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm2ww\" (UniqueName: \"kubernetes.io/projected/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-kube-api-access-zm2ww\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828339    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3366b1a3-96f0-480e-a818-16283b2e9558-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828350    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvglq\" (UniqueName: \"kubernetes.io/projected/91b65372-f14b-4803-96be-fbed8e37ce9b-kube-api-access-dvglq\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828361    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vpw6\" (UniqueName: \"kubernetes.io/projected/3366b1a3-96f0-480e-a818-16283b2e9558-kube-api-access-6vpw6\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828373    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b65372-f14b-4803-96be-fbed8e37ce9b-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828762 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828384    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828762 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828394    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3366b1a3-96f0-480e-a818-16283b2e9558-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828762 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828404    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b65372-f14b-4803-96be-fbed8e37ce9b-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:53.828762 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:53.828413    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:54.058489 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.058436    2583 generic.go:356] "Generic (PLEG): container finished" podID="3366b1a3-96f0-480e-a818-16283b2e9558" containerID="c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9" exitCode=0
Sep 17 23:32:54.058684 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.058508    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"
Sep 17 23:32:54.058684 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.058523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c" event={"ID":"3366b1a3-96f0-480e-a818-16283b2e9558","Type":"ContainerDied","Data":"c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9"}
Sep 17 23:32:54.058684 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.058568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c" event={"ID":"3366b1a3-96f0-480e-a818-16283b2e9558","Type":"ContainerDied","Data":"f8d490bd62be5aec0d571b54c72346eff9c240c7cc21e7eec1cd1dbd4ed4697b"}
Sep 17 23:32:54.058684 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.058591    2583 scope.go:117] "RemoveContainer" containerID="c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9"
Sep 17 23:32:54.060019 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.059991    2583 generic.go:356] "Generic (PLEG): container finished" podID="7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" containerID="5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17" exitCode=0
Sep 17 23:32:54.060130 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.060045    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"
Sep 17 23:32:54.060185 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.060127    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v" event={"ID":"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f","Type":"ContainerDied","Data":"5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17"}
Sep 17 23:32:54.060244 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.060227    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v" event={"ID":"7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f","Type":"ContainerDied","Data":"0a0dfb7878533a4645095801d79bf32afeb1e2c263fdedd3794c0d58fdd67a1d"}
Sep 17 23:32:54.061725 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.061702    2583 generic.go:356] "Generic (PLEG): container finished" podID="91b65372-f14b-4803-96be-fbed8e37ce9b" containerID="3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259" exitCode=0
Sep 17 23:32:54.061843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.061734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl" event={"ID":"91b65372-f14b-4803-96be-fbed8e37ce9b","Type":"ContainerDied","Data":"3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259"}
Sep 17 23:32:54.061843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.061772    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl" event={"ID":"91b65372-f14b-4803-96be-fbed8e37ce9b","Type":"ContainerDied","Data":"7116482995bf5b3a27968b1d086d959bba95310bf65fc64bde60a6f2cb977a08"}
Sep 17 23:32:54.061843 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.061743    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"
Sep 17 23:32:54.071498 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.069683    2583 scope.go:117] "RemoveContainer" containerID="c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9"
Sep 17 23:32:54.071498 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:32:54.070216    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9\": container with ID starting with c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9 not found: ID does not exist" containerID="c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9"
Sep 17 23:32:54.071498 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.070254    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9"} err="failed to get container status \"c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9\": rpc error: code = NotFound desc = could not find container \"c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9\": container with ID starting with c82f314296e5a4675bcdc9a88ea83ecb09f6dc5b8a3c8648db5305d74a82c0e9 not found: ID does not exist"
Sep 17 23:32:54.071498 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.070288    2583 scope.go:117] "RemoveContainer" containerID="5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17"
Sep 17 23:32:54.082089 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.082068    2583 scope.go:117] "RemoveContainer" containerID="5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17"
Sep 17 23:32:54.082349 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:32:54.082332    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17\": container with ID starting with 5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17 not found: ID does not exist" containerID="5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17"
Sep 17 23:32:54.082403 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.082355    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17"} err="failed to get container status \"5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17\": rpc error: code = NotFound desc = could not find container \"5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17\": container with ID starting with 5e24de8bc982e7b4956e8c500e6a88247eef3655605751114a64d0201a6c9d17 not found: ID does not exist"
Sep 17 23:32:54.082403 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.082369    2583 scope.go:117] "RemoveContainer" containerID="3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259"
Sep 17 23:32:54.087033 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.087007    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"]
Sep 17 23:32:54.090220 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.090195    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-736809/premium-w0-736809-kserve-589b7479b5-zpf7c"]
Sep 17 23:32:54.091095 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.091083    2583 scope.go:117] "RemoveContainer" containerID="3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259"
Sep 17 23:32:54.091351 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:32:54.091335    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259\": container with ID starting with 3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259 not found: ID does not exist" containerID="3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259"
Sep 17 23:32:54.091394 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.091357    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259"} err="failed to get container status \"3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259\": rpc error: code = NotFound desc = could not find container \"3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259\": container with ID starting with 3e6e24989d0c0e396dc6a5693a8699013680727914916e4a8725e0dcd95ea259 not found: ID does not exist"
Sep 17 23:32:54.100804 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.100784    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"]
Sep 17 23:32:54.104257 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.104238    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-736809/distinct-w0-736809-kserve-5c6fcd8d5b-kdc4v"]
Sep 17 23:32:54.114990 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.114966    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"]
Sep 17 23:32:54.118445 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.118424    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-736809/simulator-w0-736809-kserve-588ff48cd4-465dl"]
Sep 17 23:32:54.487395 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.487298    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3366b1a3-96f0-480e-a818-16283b2e9558" path="/var/lib/kubelet/pods/3366b1a3-96f0-480e-a818-16283b2e9558/volumes"
Sep 17 23:32:54.487857 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.487835    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" path="/var/lib/kubelet/pods/7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f/volumes"
Sep 17 23:32:54.488284 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:54.488264    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b65372-f14b-4803-96be-fbed8e37ce9b" path="/var/lib/kubelet/pods/91b65372-f14b-4803-96be-fbed8e37ce9b/volumes"
Sep 17 23:32:56.626625 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.626600    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:32:56.759691 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.759606    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-data\") pod \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") "
Sep 17 23:32:56.759859 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.759697    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-socket\") pod \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") "
Sep 17 23:32:56.759859 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.759719    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9xkh\" (UniqueName: \"kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-kube-api-access-h9xkh\") pod \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") "
Sep 17 23:32:56.759859 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.759744    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-podinfo\") pod \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") "
Sep 17 23:32:56.759859 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.759758    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-certs\") pod \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") "
Sep 17 23:32:56.759859 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.759785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-token\") pod \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") "
Sep 17 23:32:56.759859 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.759840    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-envoy\") pod \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") "
Sep 17 23:32:56.760156 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.759876    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istiod-ca-cert\") pod \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") "
Sep 17 23:32:56.760156 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.759903    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" (UID: "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:56.760156 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.759918    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-credential-socket\") pod \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\" (UID: \"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6\") "
Sep 17 23:32:56.760156 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.760021    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" (UID: "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:56.760156 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.760093    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" (UID: "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:56.760417 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.760173    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" (UID: "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:56.760417 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.760380    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:56.760417 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.760399    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-workload-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:56.760561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.760416    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-credential-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:56.760561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.760433    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-data\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:56.760561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.760381    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" (UID: "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:32:56.762179 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.762157    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-kube-api-access-h9xkh" (OuterVolumeSpecName: "kube-api-access-h9xkh") pod "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" (UID: "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6"). InnerVolumeSpecName "kube-api-access-h9xkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:32:56.762179 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.762165    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" (UID: "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:32:56.762424 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.762405    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" (UID: "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:32:56.762502 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.762408    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" (UID: "f3ef50e2-fc3f-4bd9-829b-e16db354ffb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:32:56.861286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.861255    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9xkh\" (UniqueName: \"kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-kube-api-access-h9xkh\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:56.861286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.861284    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-podinfo\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:56.861286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.861292    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:56.861543 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.861300    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istio-envoy\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:56.861543 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:56.861308    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6-istiod-ca-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:32:57.084717 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.084684    2583 generic.go:356] "Generic (PLEG): container finished" podID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerID="5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb" exitCode=0
Sep 17 23:32:57.084875 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.084735    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"
Sep 17 23:32:57.084875 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.084766    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" event={"ID":"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6","Type":"ContainerDied","Data":"5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb"}
Sep 17 23:32:57.084875 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.084823    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z" event={"ID":"f3ef50e2-fc3f-4bd9-829b-e16db354ffb6","Type":"ContainerDied","Data":"e236f74093f8944f5b90a5d3fdd7e6af600d5ebaa4b7b8600cf3a27c5b4772f2"}
Sep 17 23:32:57.084875 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.084847    2583 scope.go:117] "RemoveContainer" containerID="5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb"
Sep 17 23:32:57.098823 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.098794    2583 scope.go:117] "RemoveContainer" containerID="550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26"
Sep 17 23:32:57.109974 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.109949    2583 scope.go:117] "RemoveContainer" containerID="5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb"
Sep 17 23:32:57.110802 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:32:57.110367    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb\": container with ID starting with 5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb not found: ID does not exist" containerID="5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb"
Sep 17 23:32:57.110802 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.110417    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb"} err="failed to get container status \"5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb\": rpc error: code = NotFound desc = could not find container \"5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb\": container with ID starting with 5b106c5f724c71d92d4cc1d88d5cfd04ade286d1b961776f24727138954713fb not found: ID does not exist"
Sep 17 23:32:57.110802 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.110568    2583 scope.go:117] "RemoveContainer" containerID="550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26"
Sep 17 23:32:57.111165 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:32:57.111136    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26\": container with ID starting with 550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26 not found: ID does not exist" containerID="550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26"
Sep 17 23:32:57.111256 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.111172    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26"} err="failed to get container status \"550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26\": rpc error: code = NotFound desc = could not find container \"550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26\": container with ID starting with 550867acf470b0ce271c6c9815e4328882566989217cc35a32b770abe2c8bd26 not found: ID does not exist"
Sep 17 23:32:57.121269 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.121232    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"]
Sep 17 23:32:57.131872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.131814    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"]
Sep 17 23:32:57.132137 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.132110    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy" containerID="cri-o://95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7" gracePeriod=30
Sep 17 23:32:57.135343 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:57.135305    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z"]
Sep 17 23:32:58.493421 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:32:58.493389    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" path="/var/lib/kubelet/pods/f3ef50e2-fc3f-4bd9-829b-e16db354ffb6/volumes"
Sep 17 23:33:02.387149 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.387120    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:33:02.515725 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.515695    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-credential-socket\") pod \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") "
Sep 17 23:33:02.515874 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.515754    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istiod-ca-cert\") pod \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") "
Sep 17 23:33:02.515874 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.515789    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-socket\") pod \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") "
Sep 17 23:33:02.515874 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.515808    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-envoy\") pod \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") "
Sep 17 23:33:02.515874 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.515845    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-token\") pod \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") "
Sep 17 23:33:02.516100 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.515876    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn7n4\" (UniqueName: \"kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-kube-api-access-dn7n4\") pod \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") "
Sep 17 23:33:02.516100 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.515904    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-certs\") pod \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") "
Sep 17 23:33:02.516100 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.515966    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-podinfo\") pod \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") "
Sep 17 23:33:02.516100 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.515991    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-data\") pod \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\" (UID: \"df975f9c-c0af-4750-aba8-dc2d5bb2da66\") "
Sep 17 23:33:02.516100 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.516022    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df975f9c-c0af-4750-aba8-dc2d5bb2da66" (UID: "df975f9c-c0af-4750-aba8-dc2d5bb2da66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:33:02.516383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.516138    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df975f9c-c0af-4750-aba8-dc2d5bb2da66" (UID: "df975f9c-c0af-4750-aba8-dc2d5bb2da66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:33:02.516383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.516241    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df975f9c-c0af-4750-aba8-dc2d5bb2da66" (UID: "df975f9c-c0af-4750-aba8-dc2d5bb2da66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:33:02.516383 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.516280    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df975f9c-c0af-4750-aba8-dc2d5bb2da66" (UID: "df975f9c-c0af-4750-aba8-dc2d5bb2da66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:33:02.516525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.516381    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-data" (OuterVolumeSpecName: "istio-data") pod "df975f9c-c0af-4750-aba8-dc2d5bb2da66" (UID: "df975f9c-c0af-4750-aba8-dc2d5bb2da66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:33:02.516525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.516385    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-credential-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:02.516525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.516432    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istiod-ca-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:02.516525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.516447    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:02.516525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.516485    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-workload-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:02.518185 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.518152    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df975f9c-c0af-4750-aba8-dc2d5bb2da66" (UID: "df975f9c-c0af-4750-aba8-dc2d5bb2da66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:33:02.518309 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.518215    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df975f9c-c0af-4750-aba8-dc2d5bb2da66" (UID: "df975f9c-c0af-4750-aba8-dc2d5bb2da66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:33:02.518309 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.518235    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-token" (OuterVolumeSpecName: "istio-token") pod "df975f9c-c0af-4750-aba8-dc2d5bb2da66" (UID: "df975f9c-c0af-4750-aba8-dc2d5bb2da66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:33:02.518309 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.518290    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-kube-api-access-dn7n4" (OuterVolumeSpecName: "kube-api-access-dn7n4") pod "df975f9c-c0af-4750-aba8-dc2d5bb2da66" (UID: "df975f9c-c0af-4750-aba8-dc2d5bb2da66"). InnerVolumeSpecName "kube-api-access-dn7n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:33:02.618120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.617974    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:02.618120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.618004    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn7n4\" (UniqueName: \"kubernetes.io/projected/df975f9c-c0af-4750-aba8-dc2d5bb2da66-kube-api-access-dn7n4\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:02.618120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.618018    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-podinfo\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:02.618120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.618031    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-data\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:02.618120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:02.618063    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df975f9c-c0af-4750-aba8-dc2d5bb2da66-istio-envoy\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:03.124277 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.124243    2583 generic.go:356] "Generic (PLEG): container finished" podID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerID="95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7" exitCode=0
Sep 17 23:33:03.124458 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.124291    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"
Sep 17 23:33:03.124458 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.124335    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" event={"ID":"df975f9c-c0af-4750-aba8-dc2d5bb2da66","Type":"ContainerDied","Data":"95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7"}
Sep 17 23:33:03.124458 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.124389    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw" event={"ID":"df975f9c-c0af-4750-aba8-dc2d5bb2da66","Type":"ContainerDied","Data":"535180ae3e484f0cbe3a6450d4ee0d911654d39565fed02d08de1fe2e32bb75a"}
Sep 17 23:33:03.124458 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.124421    2583 scope.go:117] "RemoveContainer" containerID="95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7"
Sep 17 23:33:03.134541 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.134517    2583 scope.go:117] "RemoveContainer" containerID="064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435"
Sep 17 23:33:03.143283 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.143265    2583 scope.go:117] "RemoveContainer" containerID="95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7"
Sep 17 23:33:03.143618 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:33:03.143589    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7\": container with ID starting with 95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7 not found: ID does not exist" containerID="95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7"
Sep 17 23:33:03.143709 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.143629    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7"} err="failed to get container status \"95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7\": rpc error: code = NotFound desc = could not find container \"95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7\": container with ID starting with 95cfd08d5f5cd6a9c2cc419126faad7d625154376c2fa4d0a06717f74a7f0bb7 not found: ID does not exist"
Sep 17 23:33:03.143709 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.143651    2583 scope.go:117] "RemoveContainer" containerID="064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435"
Sep 17 23:33:03.144126 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:33:03.144012    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435\": container with ID starting with 064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435 not found: ID does not exist" containerID="064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435"
Sep 17 23:33:03.144126 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.144065    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435"} err="failed to get container status \"064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435\": rpc error: code = NotFound desc = could not find container \"064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435\": container with ID starting with 064aec0bff241e6fc83f50083feed8455870874dcde36515c3a303a1a7bd1435 not found: ID does not exist"
Sep 17 23:33:03.146711 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.146691    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"]
Sep 17 23:33:03.150779 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:03.150758    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw"]
Sep 17 23:33:04.487983 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:04.487949    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" path="/var/lib/kubelet/pods/df975f9c-c0af-4750-aba8-dc2d5bb2da66/volumes"
Sep 17 23:33:20.278629 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:20.278554    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"]
Sep 17 23:33:35.298143 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.298091    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47" podUID="a612bc81-8072-40f5-813d-36f136bff531" containerName="main" containerID="cri-o://c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89" gracePeriod=45
Sep 17 23:33:35.538925 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.538900    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:33:35.615819 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.615723    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-home\") pod \"a612bc81-8072-40f5-813d-36f136bff531\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") "
Sep 17 23:33:35.615819 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.615776    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-tmp-dir\") pod \"a612bc81-8072-40f5-813d-36f136bff531\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") "
Sep 17 23:33:35.615819 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.615802    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-model-cache\") pod \"a612bc81-8072-40f5-813d-36f136bff531\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") "
Sep 17 23:33:35.616115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.615832    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a612bc81-8072-40f5-813d-36f136bff531-tls-certs\") pod \"a612bc81-8072-40f5-813d-36f136bff531\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") "
Sep 17 23:33:35.616115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.615846    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-dshm\") pod \"a612bc81-8072-40f5-813d-36f136bff531\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") "
Sep 17 23:33:35.616115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.615956    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsph4\" (UniqueName: \"kubernetes.io/projected/a612bc81-8072-40f5-813d-36f136bff531-kube-api-access-gsph4\") pod \"a612bc81-8072-40f5-813d-36f136bff531\" (UID: \"a612bc81-8072-40f5-813d-36f136bff531\") "
Sep 17 23:33:35.616115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.616047    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-home" (OuterVolumeSpecName: "home") pod "a612bc81-8072-40f5-813d-36f136bff531" (UID: "a612bc81-8072-40f5-813d-36f136bff531"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:33:35.616115 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.616080    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-model-cache" (OuterVolumeSpecName: "model-cache") pod "a612bc81-8072-40f5-813d-36f136bff531" (UID: "a612bc81-8072-40f5-813d-36f136bff531"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:33:35.616380 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.616201    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a612bc81-8072-40f5-813d-36f136bff531" (UID: "a612bc81-8072-40f5-813d-36f136bff531"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:33:35.616380 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.616327    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:35.616380 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.616345    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:35.616380 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.616360    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:35.618184 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.618147    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-dshm" (OuterVolumeSpecName: "dshm") pod "a612bc81-8072-40f5-813d-36f136bff531" (UID: "a612bc81-8072-40f5-813d-36f136bff531"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:33:35.618307 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.618195    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a612bc81-8072-40f5-813d-36f136bff531-kube-api-access-gsph4" (OuterVolumeSpecName: "kube-api-access-gsph4") pod "a612bc81-8072-40f5-813d-36f136bff531" (UID: "a612bc81-8072-40f5-813d-36f136bff531"). InnerVolumeSpecName "kube-api-access-gsph4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:33:35.618307 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.618213    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a612bc81-8072-40f5-813d-36f136bff531-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a612bc81-8072-40f5-813d-36f136bff531" (UID: "a612bc81-8072-40f5-813d-36f136bff531"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:33:35.717739 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.717700    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a612bc81-8072-40f5-813d-36f136bff531-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:35.717739 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.717732    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a612bc81-8072-40f5-813d-36f136bff531-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:35.717739 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:35.717741    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsph4\" (UniqueName: \"kubernetes.io/projected/a612bc81-8072-40f5-813d-36f136bff531-kube-api-access-gsph4\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:33:36.323769 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:36.323734    2583 generic.go:356] "Generic (PLEG): container finished" podID="a612bc81-8072-40f5-813d-36f136bff531" containerID="c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89" exitCode=0
Sep 17 23:33:36.324194 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:36.323776    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"
Sep 17 23:33:36.324194 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:36.323822    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47" event={"ID":"a612bc81-8072-40f5-813d-36f136bff531","Type":"ContainerDied","Data":"c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89"}
Sep 17 23:33:36.324194 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:36.323868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47" event={"ID":"a612bc81-8072-40f5-813d-36f136bff531","Type":"ContainerDied","Data":"c11a43210078908902b4c43389b739461f9eee896750a78654c5bc5ab994310c"}
Sep 17 23:33:36.324194 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:36.323888    2583 scope.go:117] "RemoveContainer" containerID="c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89"
Sep 17 23:33:36.337438 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:36.337416    2583 scope.go:117] "RemoveContainer" containerID="c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89"
Sep 17 23:33:36.337747 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:33:36.337726    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89\": container with ID starting with c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89 not found: ID does not exist" containerID="c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89"
Sep 17 23:33:36.337793 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:36.337755    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89"} err="failed to get container status \"c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89\": rpc error: code = NotFound desc = could not find container \"c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89\": container with ID starting with c19b181ecf54e2475e8a9d46f4a6359f9914c2f319e6ee9cd9232960afd57b89 not found: ID does not exist"
Sep 17 23:33:36.348666 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:36.348644    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"]
Sep 17 23:33:36.352368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:36.352347    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/auth-test-model-f80c49-kserve-795bcf799f-nnv47"]
Sep 17 23:33:36.488416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:36.488384    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a612bc81-8072-40f5-813d-36f136bff531" path="/var/lib/kubelet/pods/a612bc81-8072-40f5-813d-36f136bff531/volumes"
Sep 17 23:33:43.099065 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099028    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"]
Sep 17 23:33:43.099446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099391    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy"
Sep 17 23:33:43.099446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099403    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy"
Sep 17 23:33:43.099446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099412    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a612bc81-8072-40f5-813d-36f136bff531" containerName="main"
Sep 17 23:33:43.099446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099418    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a612bc81-8072-40f5-813d-36f136bff531" containerName="main"
Sep 17 23:33:43.099446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099423    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b803ce1-5ece-44cb-bb2b-271a0ff08c8d" containerName="revoke-keys"
Sep 17 23:33:43.099446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099430    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b803ce1-5ece-44cb-bb2b-271a0ff08c8d" containerName="revoke-keys"
Sep 17 23:33:43.099446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099447    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3366b1a3-96f0-480e-a818-16283b2e9558" containerName="main"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099453    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3366b1a3-96f0-480e-a818-16283b2e9558" containerName="main"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099480    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c320de76-ed56-46a6-9e8c-42b145544a2b" containerName="payload-pre-processing"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099486    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c320de76-ed56-46a6-9e8c-42b145544a2b" containerName="payload-pre-processing"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099494    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b65372-f14b-4803-96be-fbed8e37ce9b" containerName="main"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099499    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b65372-f14b-4803-96be-fbed8e37ce9b" containerName="main"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099506    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26220153-8a17-4578-9455-186d3653b6d6" containerName="payload-processing"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099512    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="26220153-8a17-4578-9455-186d3653b6d6" containerName="payload-processing"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099518    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b2ae823-a0f6-4ce6-9522-c81a7de2f25f" containerName="payload-processing"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099523    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b2ae823-a0f6-4ce6-9522-c81a7de2f25f" containerName="payload-processing"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099530    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb605c77-7ba9-404c-9107-78085c43e212" containerName="revoke-keys"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099535    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb605c77-7ba9-404c-9107-78085c43e212" containerName="revoke-keys"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099543    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099548    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099554    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099559    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099567    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" containerName="main"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099572    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" containerName="main"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099627    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a612bc81-8072-40f5-813d-36f136bff531" containerName="main"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099634    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b803ce1-5ece-44cb-bb2b-271a0ff08c8d" containerName="revoke-keys"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099639    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c320de76-ed56-46a6-9e8c-42b145544a2b" containerName="payload-pre-processing"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099646    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099652    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb605c77-7ba9-404c-9107-78085c43e212" containerName="revoke-keys"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099659    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b65372-f14b-4803-96be-fbed8e37ce9b" containerName="main"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099666    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099672    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3366b1a3-96f0-480e-a818-16283b2e9558" containerName="main"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099677    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b2ae823-a0f6-4ce6-9522-c81a7de2f25f" containerName="payload-processing"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099682    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="26220153-8a17-4578-9455-186d3653b6d6" containerName="payload-processing"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099686    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ef50e2-fc3f-4bd9-829b-e16db354ffb6" containerName="istio-proxy"
Sep 17 23:33:43.099714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.099692    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba72a30-aa8f-4eb2-90a9-eb0d9a49481f" containerName="main"
Sep 17 23:33:43.104296 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.104278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.107127 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.107108    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-f80c49\"/\"kube-root-ca.crt\""
Sep 17 23:33:43.108246 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.108222    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-f80c49\"/\"openshift-service-ca.crt\""
Sep 17 23:33:43.108246 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.108232    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-f80c49\"/\"sub-test-model-f80c49-kserve-self-signed-certs\""
Sep 17 23:33:43.108400 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.108258    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-f80c49\"/\"default-dockercfg-hhpdp\""
Sep 17 23:33:43.113452 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.113430    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"]
Sep 17 23:33:43.284872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.284843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tmp-dir\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.284872 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.284877    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-home\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.285160 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.284910    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-model-cache\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.285160 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.284961    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tls-certs\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.285160 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.285027    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-dshm\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.285160 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.285077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc9rl\" (UniqueName: \"kubernetes.io/projected/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-kube-api-access-jc9rl\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.385995 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.385913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-home\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.385995 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.385961    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-model-cache\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.386203 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.386012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tls-certs\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.386203 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.386059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-dshm\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.386203 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.386095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9rl\" (UniqueName: \"kubernetes.io/projected/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-kube-api-access-jc9rl\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.386203 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.386120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tmp-dir\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.386421 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.386304    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-home\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.386421 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.386349    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-model-cache\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.386421 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.386394    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tmp-dir\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.388203 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.388182    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-dshm\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.388497 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.388481    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tls-certs\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.394321 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.394299    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc9rl\" (UniqueName: \"kubernetes.io/projected/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-kube-api-access-jc9rl\") pod \"sub-test-model-f80c49-kserve-694459646c-p982z\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") " pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.415517 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.415492    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:43.689150 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:43.689122    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"]
Sep 17 23:33:43.690282 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:33:43.690243    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f0b5f38_bb96_46d2_8c64_de0cf0d7299a.slice/crio-67b6128499ad1ae2b819a5b84b4996bc38914f0ea0590f5416030a8122c40941 WatchSource:0}: Error finding container 67b6128499ad1ae2b819a5b84b4996bc38914f0ea0590f5416030a8122c40941: Status 404 returned error can't find the container with id 67b6128499ad1ae2b819a5b84b4996bc38914f0ea0590f5416030a8122c40941
Sep 17 23:33:44.374682 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:44.374646    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z" event={"ID":"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a","Type":"ContainerStarted","Data":"cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb"}
Sep 17 23:33:44.374682 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:44.374690    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z" event={"ID":"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a","Type":"ContainerStarted","Data":"67b6128499ad1ae2b819a5b84b4996bc38914f0ea0590f5416030a8122c40941"}
Sep 17 23:33:44.392092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:44.392030    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z" podStartSLOduration=1.392007205 podStartE2EDuration="1.392007205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:33:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:33:44.391268759 +0000 UTC m=+1635.998846439" watchObservedRunningTime="2026-09-17 23:33:44.392007205 +0000 UTC m=+1635.999584867"
Sep 17 23:33:53.416611 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:53.416562    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:53.416611 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:53.416625    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:53.429637 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:53.429611    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:33:53.445804 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:33:53.445779    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:34:30.872020 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:34:30.871987    2583 scope.go:117] "RemoveContainer" containerID="0e1ca4d62598fc0194c9bbe924ce1c58b4ca74347ee622ea52ffae341129f050"
Sep 17 23:34:46.322199 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:34:46.322122    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"]
Sep 17 23:35:01.340826 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.340756    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z" podUID="2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" containerName="main" containerID="cri-o://cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb" gracePeriod=45
Sep 17 23:35:01.595942 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.595878    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:35:01.741480 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.741425    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-model-cache\") pod \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") "
Sep 17 23:35:01.741681 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.741525    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-home\") pod \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") "
Sep 17 23:35:01.741681 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.741549    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-dshm\") pod \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") "
Sep 17 23:35:01.741681 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.741584    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tls-certs\") pod \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") "
Sep 17 23:35:01.741681 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.741608    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tmp-dir\") pod \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") "
Sep 17 23:35:01.741681 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.741627    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc9rl\" (UniqueName: \"kubernetes.io/projected/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-kube-api-access-jc9rl\") pod \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\" (UID: \"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a\") "
Sep 17 23:35:01.741957 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.741746    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" (UID: "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:35:01.741957 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.741850    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-home" (OuterVolumeSpecName: "home") pod "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" (UID: "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:35:01.741957 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.741868    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" (UID: "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:35:01.742097 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.741998    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:35:01.742097 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.742011    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:35:01.742097 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.742019    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:35:01.743709 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.743677    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-dshm" (OuterVolumeSpecName: "dshm") pod "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" (UID: "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:35:01.743810 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.743712    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" (UID: "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:35:01.743810 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.743738    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-kube-api-access-jc9rl" (OuterVolumeSpecName: "kube-api-access-jc9rl") pod "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" (UID: "2f0b5f38-bb96-46d2-8c64-de0cf0d7299a"). InnerVolumeSpecName "kube-api-access-jc9rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:35:01.829517 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.829482    2583 generic.go:356] "Generic (PLEG): container finished" podID="2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" containerID="cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb" exitCode=0
Sep 17 23:35:01.829685 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.829515    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z" event={"ID":"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a","Type":"ContainerDied","Data":"cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb"}
Sep 17 23:35:01.829685 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.829534    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"
Sep 17 23:35:01.829685 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.829564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z" event={"ID":"2f0b5f38-bb96-46d2-8c64-de0cf0d7299a","Type":"ContainerDied","Data":"67b6128499ad1ae2b819a5b84b4996bc38914f0ea0590f5416030a8122c40941"}
Sep 17 23:35:01.829685 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.829582    2583 scope.go:117] "RemoveContainer" containerID="cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb"
Sep 17 23:35:01.839044 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.839028    2583 scope.go:117] "RemoveContainer" containerID="cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb"
Sep 17 23:35:01.839320 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:35:01.839302    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb\": container with ID starting with cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb not found: ID does not exist" containerID="cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb"
Sep 17 23:35:01.839367 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.839327    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb"} err="failed to get container status \"cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb\": rpc error: code = NotFound desc = could not find container \"cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb\": container with ID starting with cb28eed00ded00af08e8f3b33192e11ef22a0b24b66cf89fc73ac011ed8fcfdb not found: ID does not exist"
Sep 17 23:35:01.843118 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.843100    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:35:01.843194 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.843119    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:35:01.843194 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.843130    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc9rl\" (UniqueName: \"kubernetes.io/projected/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a-kube-api-access-jc9rl\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:35:01.851340 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.851283    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"]
Sep 17 23:35:01.857242 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:01.857217    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f80c49/sub-test-model-f80c49-kserve-694459646c-p982z"]
Sep 17 23:35:02.486819 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:02.486778    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" path="/var/lib/kubelet/pods/2f0b5f38-bb96-46d2-8c64-de0cf0d7299a/volumes"
Sep 17 23:35:30.710175 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.710142    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"]
Sep 17 23:35:30.710774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.710718    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy"
Sep 17 23:35:30.710774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.710739    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy"
Sep 17 23:35:30.710774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.710750    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" containerName="main"
Sep 17 23:35:30.710774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.710758    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" containerName="main"
Sep 17 23:35:30.710997 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.710869    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="df975f9c-c0af-4750-aba8-dc2d5bb2da66" containerName="istio-proxy"
Sep 17 23:35:30.710997 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.710881    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0b5f38-bb96-46d2-8c64-de0cf0d7299a" containerName="main"
Sep 17 23:35:30.713931 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.713911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.717082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.717058    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-f6ac6e\"/\"kube-root-ca.crt\""
Sep 17 23:35:30.718029 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.718013    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-f6ac6e\"/\"openshift-service-ca.crt\""
Sep 17 23:35:30.718218 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.718206    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-f6ac6e\"/\"rate-test-model-f6ac6e-kserve-self-signed-certs\""
Sep 17 23:35:30.718293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.718274    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-f6ac6e\"/\"default-dockercfg-5cvdt\""
Sep 17 23:35:30.724188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.724164    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"]
Sep 17 23:35:30.805232 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.805191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwgl7\" (UniqueName: \"kubernetes.io/projected/bf9d2d6f-e774-4199-a77a-303ea2944340-kube-api-access-xwgl7\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.805432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.805237    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-tmp-dir\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.805432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.805352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-home\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.805432 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.805389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf9d2d6f-e774-4199-a77a-303ea2944340-tls-certs\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.805661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.805511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-dshm\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.805661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.805574    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-model-cache\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.906805 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.906782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-dshm\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.906880 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.906828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-model-cache\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.906880 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.906870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwgl7\" (UniqueName: \"kubernetes.io/projected/bf9d2d6f-e774-4199-a77a-303ea2944340-kube-api-access-xwgl7\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.906983 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.906896    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-tmp-dir\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.907144 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.907117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-home\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.907240 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.907162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf9d2d6f-e774-4199-a77a-303ea2944340-tls-certs\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.907300 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.907248    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-tmp-dir\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.907429 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.907412    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-model-cache\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.907618 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.907597    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-home\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.909096 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.909068    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-dshm\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.909655 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.909639    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf9d2d6f-e774-4199-a77a-303ea2944340-tls-certs\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:30.915737 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:30.915720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwgl7\" (UniqueName: \"kubernetes.io/projected/bf9d2d6f-e774-4199-a77a-303ea2944340-kube-api-access-xwgl7\") pod \"rate-test-model-f6ac6e-kserve-5968cb877f-knblq\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") " pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:31.023711 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:31.023686    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:31.304555 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:31.304524    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"]
Sep 17 23:35:31.306001 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:35:31.305973    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf9d2d6f_e774_4199_a77a_303ea2944340.slice/crio-e0717c79b331ebca329ff815fdbb994e1bc9b369707ac323158ef1fbc5061a9a WatchSource:0}: Error finding container e0717c79b331ebca329ff815fdbb994e1bc9b369707ac323158ef1fbc5061a9a: Status 404 returned error can't find the container with id e0717c79b331ebca329ff815fdbb994e1bc9b369707ac323158ef1fbc5061a9a
Sep 17 23:35:32.002014 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:32.001976    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq" event={"ID":"bf9d2d6f-e774-4199-a77a-303ea2944340","Type":"ContainerStarted","Data":"be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a"}
Sep 17 23:35:32.002014 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:32.002023    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq" event={"ID":"bf9d2d6f-e774-4199-a77a-303ea2944340","Type":"ContainerStarted","Data":"e0717c79b331ebca329ff815fdbb994e1bc9b369707ac323158ef1fbc5061a9a"}
Sep 17 23:35:32.020819 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:32.020766    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq" podStartSLOduration=2.020749868 podStartE2EDuration="2.020749868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:35:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:35:32.019275167 +0000 UTC m=+1743.626852852" watchObservedRunningTime="2026-09-17 23:35:32.020749868 +0000 UTC m=+1743.628327555"
Sep 17 23:35:41.024232 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:41.024199    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:41.025095 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:41.024244    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:41.038326 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:41.038303    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:35:41.073006 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:35:41.072976    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:36:15.594325 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:15.594238    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"]
Sep 17 23:36:21.766423 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.766384    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"]
Sep 17 23:36:21.770133 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.770106    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:36:21.771126 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.771103    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"]
Sep 17 23:36:21.772718 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.772699    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-36fb5c\""
Sep 17 23:36:21.775003 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.774983    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:36:21.776043 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.776021    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-36fb5c-dockercfg-n4zgl\""
Sep 17 23:36:21.783991 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.783958    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"]
Sep 17 23:36:21.786896 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.786875    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"]
Sep 17 23:36:21.896772 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.896737    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sch59\" (UniqueName: \"kubernetes.io/projected/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-kube-api-access-sch59\") pod \"payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr\" (UID: \"34cc44cb-3286-4f04-8231-9cdcc09f6fd9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:36:21.896967 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.896791    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr\" (UID: \"34cc44cb-3286-4f04-8231-9cdcc09f6fd9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:36:21.896967 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.896853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgzrs\" (UniqueName: \"kubernetes.io/projected/fe67da96-f25a-4451-b409-d9f7c7d3974a-kube-api-access-dgzrs\") pod \"payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj\" (UID: \"fe67da96-f25a-4451-b409-d9f7c7d3974a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:36:21.897139 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.896988    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe67da96-f25a-4451-b409-d9f7c7d3974a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj\" (UID: \"fe67da96-f25a-4451-b409-d9f7c7d3974a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:36:21.998499 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.998426    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe67da96-f25a-4451-b409-d9f7c7d3974a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj\" (UID: \"fe67da96-f25a-4451-b409-d9f7c7d3974a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:36:21.998710 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.998533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sch59\" (UniqueName: \"kubernetes.io/projected/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-kube-api-access-sch59\") pod \"payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr\" (UID: \"34cc44cb-3286-4f04-8231-9cdcc09f6fd9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:36:21.998710 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.998563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr\" (UID: \"34cc44cb-3286-4f04-8231-9cdcc09f6fd9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:36:21.998710 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.998602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgzrs\" (UniqueName: \"kubernetes.io/projected/fe67da96-f25a-4451-b409-d9f7c7d3974a-kube-api-access-dgzrs\") pod \"payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj\" (UID: \"fe67da96-f25a-4451-b409-d9f7c7d3974a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:36:21.999911 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:21.999878    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr\" (UID: \"34cc44cb-3286-4f04-8231-9cdcc09f6fd9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:36:22.006670 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:22.006582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe67da96-f25a-4451-b409-d9f7c7d3974a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj\" (UID: \"fe67da96-f25a-4451-b409-d9f7c7d3974a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:36:22.008450 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:22.008424    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sch59\" (UniqueName: \"kubernetes.io/projected/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-kube-api-access-sch59\") pod \"payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr\" (UID: \"34cc44cb-3286-4f04-8231-9cdcc09f6fd9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:36:22.008584 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:22.008437    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgzrs\" (UniqueName: \"kubernetes.io/projected/fe67da96-f25a-4451-b409-d9f7c7d3974a-kube-api-access-dgzrs\") pod \"payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj\" (UID: \"fe67da96-f25a-4451-b409-d9f7c7d3974a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:36:22.085805 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:22.085777    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:36:22.091808 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:22.091769    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:36:22.368994 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:22.368967    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"]
Sep 17 23:36:22.370899 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:36:22.370865    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34cc44cb_3286_4f04_8231_9cdcc09f6fd9.slice/crio-d2ae1691b3f46d2b33c23e6dac70b54434caf6e2d767cc116e82c10d1c33ad70 WatchSource:0}: Error finding container d2ae1691b3f46d2b33c23e6dac70b54434caf6e2d767cc116e82c10d1c33ad70: Status 404 returned error can't find the container with id d2ae1691b3f46d2b33c23e6dac70b54434caf6e2d767cc116e82c10d1c33ad70
Sep 17 23:36:22.390094 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:22.390070    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"]
Sep 17 23:36:22.391938 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:36:22.391908    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe67da96_f25a_4451_b409_d9f7c7d3974a.slice/crio-38c9cabc139e86158fb925b21a421f6d6aad98a9ee6f23dca7aca7c54ecd92ee WatchSource:0}: Error finding container 38c9cabc139e86158fb925b21a421f6d6aad98a9ee6f23dca7aca7c54ecd92ee: Status 404 returned error can't find the container with id 38c9cabc139e86158fb925b21a421f6d6aad98a9ee6f23dca7aca7c54ecd92ee
Sep 17 23:36:23.312021 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:23.311977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj" event={"ID":"fe67da96-f25a-4451-b409-d9f7c7d3974a","Type":"ContainerStarted","Data":"2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195"}
Sep 17 23:36:23.312522 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:23.312122    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:36:23.312522 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:23.312143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj" event={"ID":"fe67da96-f25a-4451-b409-d9f7c7d3974a","Type":"ContainerStarted","Data":"38c9cabc139e86158fb925b21a421f6d6aad98a9ee6f23dca7aca7c54ecd92ee"}
Sep 17 23:36:23.313932 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:23.313911    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr" event={"ID":"34cc44cb-3286-4f04-8231-9cdcc09f6fd9","Type":"ContainerStarted","Data":"a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600"}
Sep 17 23:36:23.314012 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:23.313950    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr" event={"ID":"34cc44cb-3286-4f04-8231-9cdcc09f6fd9","Type":"ContainerStarted","Data":"d2ae1691b3f46d2b33c23e6dac70b54434caf6e2d767cc116e82c10d1c33ad70"}
Sep 17 23:36:23.314086 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:23.314023    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:36:23.332416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:23.332366    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj" podStartSLOduration=2.33235093 podStartE2EDuration="2.33235093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:36:23.329139671 +0000 UTC m=+1794.936717348" watchObservedRunningTime="2026-09-17 23:36:23.33235093 +0000 UTC m=+1794.939928590"
Sep 17 23:36:23.348033 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:23.347982    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr" podStartSLOduration=2.347967871 podStartE2EDuration="2.347967871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:36:23.345262399 +0000 UTC m=+1794.952840084" watchObservedRunningTime="2026-09-17 23:36:23.347967871 +0000 UTC m=+1794.955545531"
Sep 17 23:36:30.613560 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.613515    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq" podUID="bf9d2d6f-e774-4199-a77a-303ea2944340" containerName="main" containerID="cri-o://be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a" gracePeriod=45
Sep 17 23:36:30.860927 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.860902    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:36:30.886776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.886704    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-model-cache\") pod \"bf9d2d6f-e774-4199-a77a-303ea2944340\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") "
Sep 17 23:36:30.886776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.886738    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-tmp-dir\") pod \"bf9d2d6f-e774-4199-a77a-303ea2944340\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") "
Sep 17 23:36:30.886988 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.886798    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-home\") pod \"bf9d2d6f-e774-4199-a77a-303ea2944340\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") "
Sep 17 23:36:30.886988 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.886817    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwgl7\" (UniqueName: \"kubernetes.io/projected/bf9d2d6f-e774-4199-a77a-303ea2944340-kube-api-access-xwgl7\") pod \"bf9d2d6f-e774-4199-a77a-303ea2944340\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") "
Sep 17 23:36:30.886988 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.886838    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-dshm\") pod \"bf9d2d6f-e774-4199-a77a-303ea2944340\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") "
Sep 17 23:36:30.886988 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.886879    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf9d2d6f-e774-4199-a77a-303ea2944340-tls-certs\") pod \"bf9d2d6f-e774-4199-a77a-303ea2944340\" (UID: \"bf9d2d6f-e774-4199-a77a-303ea2944340\") "
Sep 17 23:36:30.887202 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.886985    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-model-cache" (OuterVolumeSpecName: "model-cache") pod "bf9d2d6f-e774-4199-a77a-303ea2944340" (UID: "bf9d2d6f-e774-4199-a77a-303ea2944340"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:36:30.887202 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.887047    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-home" (OuterVolumeSpecName: "home") pod "bf9d2d6f-e774-4199-a77a-303ea2944340" (UID: "bf9d2d6f-e774-4199-a77a-303ea2944340"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:36:30.887202 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.887076    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bf9d2d6f-e774-4199-a77a-303ea2944340" (UID: "bf9d2d6f-e774-4199-a77a-303ea2944340"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:36:30.887335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.887209    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:36:30.887335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.887228    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:36:30.887335 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.887243    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:36:30.889080 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.889056    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf9d2d6f-e774-4199-a77a-303ea2944340-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bf9d2d6f-e774-4199-a77a-303ea2944340" (UID: "bf9d2d6f-e774-4199-a77a-303ea2944340"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:36:30.889193 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.889059    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf9d2d6f-e774-4199-a77a-303ea2944340-kube-api-access-xwgl7" (OuterVolumeSpecName: "kube-api-access-xwgl7") pod "bf9d2d6f-e774-4199-a77a-303ea2944340" (UID: "bf9d2d6f-e774-4199-a77a-303ea2944340"). InnerVolumeSpecName "kube-api-access-xwgl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:36:30.889333 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.889318    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-dshm" (OuterVolumeSpecName: "dshm") pod "bf9d2d6f-e774-4199-a77a-303ea2944340" (UID: "bf9d2d6f-e774-4199-a77a-303ea2944340"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:36:30.913297 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.913271    2583 scope.go:117] "RemoveContainer" containerID="027374d0ca80713ecf32230233a03552783fc7d5784e50fddd23a2e4ef00ec43"
Sep 17 23:36:30.921883 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.921866    2583 scope.go:117] "RemoveContainer" containerID="6a159bf0cecd5968734521a249d72e2d57957c5f3e25b1895d5087f807c21ee0"
Sep 17 23:36:30.987830 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.987801    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwgl7\" (UniqueName: \"kubernetes.io/projected/bf9d2d6f-e774-4199-a77a-303ea2944340-kube-api-access-xwgl7\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:36:30.987830 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.987828    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf9d2d6f-e774-4199-a77a-303ea2944340-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:36:30.988009 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:30.987839    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf9d2d6f-e774-4199-a77a-303ea2944340-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:36:31.360975 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:31.360939    2583 generic.go:356] "Generic (PLEG): container finished" podID="bf9d2d6f-e774-4199-a77a-303ea2944340" containerID="be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a" exitCode=0
Sep 17 23:36:31.361161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:31.360984    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"
Sep 17 23:36:31.361161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:31.361025    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq" event={"ID":"bf9d2d6f-e774-4199-a77a-303ea2944340","Type":"ContainerDied","Data":"be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a"}
Sep 17 23:36:31.361161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:31.361069    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq" event={"ID":"bf9d2d6f-e774-4199-a77a-303ea2944340","Type":"ContainerDied","Data":"e0717c79b331ebca329ff815fdbb994e1bc9b369707ac323158ef1fbc5061a9a"}
Sep 17 23:36:31.361161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:31.361089    2583 scope.go:117] "RemoveContainer" containerID="be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a"
Sep 17 23:36:31.372568 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:31.372548    2583 scope.go:117] "RemoveContainer" containerID="be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a"
Sep 17 23:36:31.372858 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:36:31.372838    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a\": container with ID starting with be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a not found: ID does not exist" containerID="be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a"
Sep 17 23:36:31.372913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:31.372867    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a"} err="failed to get container status \"be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a\": rpc error: code = NotFound desc = could not find container \"be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a\": container with ID starting with be7c0847e5f317db7ce1b1f7c4e7ed9b648fce76810d22170702d134bda1320a not found: ID does not exist"
Sep 17 23:36:31.386571 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:31.386544    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"]
Sep 17 23:36:31.390046 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:31.390024    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-f6ac6e/rate-test-model-f6ac6e-kserve-5968cb877f-knblq"]
Sep 17 23:36:32.487448 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:32.487374    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf9d2d6f-e774-4199-a77a-303ea2944340" path="/var/lib/kubelet/pods/bf9d2d6f-e774-4199-a77a-303ea2944340/volumes"
Sep 17 23:36:34.321531 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:34.321497    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:36:34.321910 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:34.321564    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:36:45.064214 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.064175    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"]
Sep 17 23:36:45.064863 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.064840    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf9d2d6f-e774-4199-a77a-303ea2944340" containerName="main"
Sep 17 23:36:45.064914 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.064867    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf9d2d6f-e774-4199-a77a-303ea2944340" containerName="main"
Sep 17 23:36:45.065019 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.065007    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf9d2d6f-e774-4199-a77a-303ea2944340" containerName="main"
Sep 17 23:36:45.069896 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.069874    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.072595 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.072560    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-3c1ddb-openshift-default-dockercfg-5hvtq\""
Sep 17 23:36:45.082029 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.082004    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"]
Sep 17 23:36:45.116033 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.116009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-envoy\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.116190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.116048    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istiod-ca-cert\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.116190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.116082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwjcm\" (UniqueName: \"kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-kube-api-access-fwjcm\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.116190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.116148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-credential-socket\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.116333 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.116189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-certs\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.116333 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.116221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-token\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.116333 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.116265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-socket\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.116333 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.116312    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-data\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.116612 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.116351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-podinfo\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.217764 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.217735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-token\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.217968 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.217773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-socket\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.217968 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.217816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-data\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.217968 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.217842    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-podinfo\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.217968 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.217885    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-envoy\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.217968 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.217908    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istiod-ca-cert\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.218249 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.218041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwjcm\" (UniqueName: \"kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-kube-api-access-fwjcm\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.218249 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.218095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-credential-socket\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.218249 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.218123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-certs\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.218249 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.218219    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-socket\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.218477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.218249    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-data\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.218477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.218442    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-credential-socket\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.218477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.218448    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-certs\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.218826 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.218797    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istiod-ca-cert\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.220161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.220144    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-envoy\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.220738 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.220719    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-podinfo\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.225326 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.225300    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-token\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.225596 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.225575    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwjcm\" (UniqueName: \"kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-kube-api-access-fwjcm\") pod \"e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") " pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.382291 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.382197    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:45.662920 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.662875    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"]
Sep 17 23:36:45.663346 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:36:45.663319    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7399b6_511f_44a7_b2bf_0a8ad6cdb31f.slice/crio-40ec4981d97e326231e1d2b304b9a5d9605d84a8b1d45baa748414831614084a WatchSource:0}: Error finding container 40ec4981d97e326231e1d2b304b9a5d9605d84a8b1d45baa748414831614084a: Status 404 returned error can't find the container with id 40ec4981d97e326231e1d2b304b9a5d9605d84a8b1d45baa748414831614084a
Sep 17 23:36:45.665943 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.665910    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:36:45.666058 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.665977    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:36:45.666058 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:45.666005    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:36:46.455435 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:46.455390    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" event={"ID":"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f","Type":"ContainerStarted","Data":"b2c8eca87c74354a7bdac7d024e912e329163c141c35fbe550c52ba178726542"}
Sep 17 23:36:46.455879 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:46.455478    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" event={"ID":"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f","Type":"ContainerStarted","Data":"40ec4981d97e326231e1d2b304b9a5d9605d84a8b1d45baa748414831614084a"}
Sep 17 23:36:46.476087 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:46.476036    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" podStartSLOduration=1.476020383 podStartE2EDuration="1.476020383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:36:46.474156037 +0000 UTC m=+1818.081733724" watchObservedRunningTime="2026-09-17 23:36:46.476020383 +0000 UTC m=+1818.083598043"
Sep 17 23:36:47.382972 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:47.382937    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:47.389058 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:47.389032    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:47.461895 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:47.461864    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:36:47.462870 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:36:47.462843    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:37:03.503699 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:03.503654    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 23:37:03.504190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:03.503741    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 23:37:04.571425 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:04.571388    2583 generic.go:356] "Generic (PLEG): container finished" podID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerID="b2c8eca87c74354a7bdac7d024e912e329163c141c35fbe550c52ba178726542" exitCode=0
Sep 17 23:37:04.571962 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:04.571483    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" event={"ID":"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f","Type":"ContainerDied","Data":"b2c8eca87c74354a7bdac7d024e912e329163c141c35fbe550c52ba178726542"}
Sep 17 23:37:04.572049 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:04.572009    2583 scope.go:117] "RemoveContainer" containerID="b2c8eca87c74354a7bdac7d024e912e329163c141c35fbe550c52ba178726542"
Sep 17 23:37:04.573171 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:04.573144    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:37:04.573288 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:04.573236    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:37:04.573356 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:04.573284    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:37:05.579863 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:05.579830    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" event={"ID":"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f","Type":"ContainerStarted","Data":"1f18e665fe8ebecd191c2b0dda87f55c796111c8b0bce7a7ea06f3613f5eca29"}
Sep 17 23:37:06.382557 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:06.382515    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:37:06.382810 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:06.382786    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 17 23:37:06.382865 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:06.382848    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 17 23:37:07.383040 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:07.382983    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 17 23:37:07.383443 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:07.383047    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 17 23:37:08.383489 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:08.383428    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 17 23:37:08.383901 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:08.383522    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 17 23:37:09.383483 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:09.383420    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 17 23:37:09.383674 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:09.383506    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 17 23:37:10.382806 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:10.382764    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 17 23:37:10.383001 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:10.382823    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 17 23:37:11.387344 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:11.387312    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:37:11.387760 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:11.387597    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:37:11.388250 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:11.388234    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:37:30.945871 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:30.945836    2583 scope.go:117] "RemoveContainer" containerID="43f6c6fe97e7d92a55c99bfa39bd7861ca2d76df247057c2d415a6a19623eb6c"
Sep 17 23:37:54.695844 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:54.695762    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj_fe67da96-f25a-4451-b409-d9f7c7d3974a/payload-processing/0.log"
Sep 17 23:37:55.619627 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.619582    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"]
Sep 17 23:37:55.623162 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.623139    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.627172 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.627151    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-26b61a-openshift-default-dockercfg-v8qzn\""
Sep 17 23:37:55.635913 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.635881    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"]
Sep 17 23:37:55.713260 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.713219    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-token\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.713817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.713333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-socket\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.713817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.713358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-data\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.713817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.713387    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-credential-socket\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.713817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.713503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-envoy\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.713817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.713530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-podinfo\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.713817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.713561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istiod-ca-cert\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.713817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.713582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pl7z\" (UniqueName: \"kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-kube-api-access-4pl7z\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.713817 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.713604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-certs\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.814268 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814226    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-envoy\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.814268 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814278    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-podinfo\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.814583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814315    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istiod-ca-cert\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.814583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pl7z\" (UniqueName: \"kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-kube-api-access-4pl7z\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.814583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-certs\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.814583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814388    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-token\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.814583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-socket\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.814583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-data\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.814583 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-credential-socket\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.814945 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-certs\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.815005 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.814940    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-socket\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.815084 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.815054    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-credential-socket\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.815136 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.815076    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-data\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.815221 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.815202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istiod-ca-cert\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.816822 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.816799    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-envoy\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.816923 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.816840    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-podinfo\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.830955 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.830932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-token\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.831069 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.831036    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pl7z\" (UniqueName: \"kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-kube-api-access-4pl7z\") pod \"e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") " pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:55.934973 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:55.934871    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:56.218669 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:56.218637    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"]
Sep 17 23:37:56.218785 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:37:56.218665    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061b4c5b_f901_41a4_99f5_cd4aa4a2c220.slice/crio-7823f60b7eb5b33836b54c254c28c9b1acb7980b1efe9bf7ffc23c042696a529 WatchSource:0}: Error finding container 7823f60b7eb5b33836b54c254c28c9b1acb7980b1efe9bf7ffc23c042696a529: Status 404 returned error can't find the container with id 7823f60b7eb5b33836b54c254c28c9b1acb7980b1efe9bf7ffc23c042696a529
Sep 17 23:37:56.220937 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:56.220906    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:37:56.221002 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:56.220972    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:37:56.221039 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:56.221002    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:37:56.895962 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:56.895928    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" event={"ID":"061b4c5b-f901-41a4-99f5-cd4aa4a2c220","Type":"ContainerStarted","Data":"53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44"}
Sep 17 23:37:56.896363 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:56.895981    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" event={"ID":"061b4c5b-f901-41a4-99f5-cd4aa4a2c220","Type":"ContainerStarted","Data":"7823f60b7eb5b33836b54c254c28c9b1acb7980b1efe9bf7ffc23c042696a529"}
Sep 17 23:37:56.918259 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:56.918202    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" podStartSLOduration=1.9181854839999999 podStartE2EDuration="1.918185484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:37:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:37:56.916299272 +0000 UTC m=+1888.523876960" watchObservedRunningTime="2026-09-17 23:37:56.918185484 +0000 UTC m=+1888.525763143"
Sep 17 23:37:56.935568 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:56.935528    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:57.940637 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:57.940606    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:58.907947 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:58.907906    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:37:58.908934 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:37:58.908911    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:38:02.530918 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.530883    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"]
Sep 17 23:38:02.534705 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.534686    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:02.537459 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.537434    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-26b61a\""
Sep 17 23:38:02.537586 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.537476    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-26b61a-dockercfg-9bmph\""
Sep 17 23:38:02.543172 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.543145    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"]
Sep 17 23:38:02.586768 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.586730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3054692d-e1cf-4569-9c11-1be2584a1fa7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7\" (UID: \"3054692d-e1cf-4569-9c11-1be2584a1fa7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:02.587104 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.587059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t67m9\" (UniqueName: \"kubernetes.io/projected/3054692d-e1cf-4569-9c11-1be2584a1fa7-kube-api-access-t67m9\") pod \"payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7\" (UID: \"3054692d-e1cf-4569-9c11-1be2584a1fa7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:02.688595 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.688547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t67m9\" (UniqueName: \"kubernetes.io/projected/3054692d-e1cf-4569-9c11-1be2584a1fa7-kube-api-access-t67m9\") pod \"payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7\" (UID: \"3054692d-e1cf-4569-9c11-1be2584a1fa7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:02.688810 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.688657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3054692d-e1cf-4569-9c11-1be2584a1fa7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7\" (UID: \"3054692d-e1cf-4569-9c11-1be2584a1fa7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:02.689410 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.689386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3054692d-e1cf-4569-9c11-1be2584a1fa7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7\" (UID: \"3054692d-e1cf-4569-9c11-1be2584a1fa7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:02.696551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.696528    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t67m9\" (UniqueName: \"kubernetes.io/projected/3054692d-e1cf-4569-9c11-1be2584a1fa7-kube-api-access-t67m9\") pod \"payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7\" (UID: \"3054692d-e1cf-4569-9c11-1be2584a1fa7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:02.847122 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:02.847033    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:03.125871 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:38:03.124491    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3054692d_e1cf_4569_9c11_1be2584a1fa7.slice/crio-7c9653c99c57937c4c570d6998d2767f69916271b2192fdd7dc755016c8f542f WatchSource:0}: Error finding container 7c9653c99c57937c4c570d6998d2767f69916271b2192fdd7dc755016c8f542f: Status 404 returned error can't find the container with id 7c9653c99c57937c4c570d6998d2767f69916271b2192fdd7dc755016c8f542f
Sep 17 23:38:03.125871 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:03.125268    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"]
Sep 17 23:38:03.944073 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:03.944019    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7" event={"ID":"3054692d-e1cf-4569-9c11-1be2584a1fa7","Type":"ContainerStarted","Data":"f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23"}
Sep 17 23:38:03.944073 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:03.944096    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:03.944587 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:03.944121    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7" event={"ID":"3054692d-e1cf-4569-9c11-1be2584a1fa7","Type":"ContainerStarted","Data":"7c9653c99c57937c4c570d6998d2767f69916271b2192fdd7dc755016c8f542f"}
Sep 17 23:38:03.963190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:03.963134    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7" podStartSLOduration=1.963117411 podStartE2EDuration="1.963117411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:38:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:38:03.960970815 +0000 UTC m=+1895.568548496" watchObservedRunningTime="2026-09-17 23:38:03.963117411 +0000 UTC m=+1895.570695071"
Sep 17 23:38:14.953324 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:14.953289    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:18.034323 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:18.034288    2583 generic.go:356] "Generic (PLEG): container finished" podID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerID="53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44" exitCode=0
Sep 17 23:38:18.034323 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:18.034326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" event={"ID":"061b4c5b-f901-41a4-99f5-cd4aa4a2c220","Type":"ContainerDied","Data":"53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44"}
Sep 17 23:38:18.034815 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:18.034748    2583 scope.go:117] "RemoveContainer" containerID="53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44"
Sep 17 23:38:18.036054 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:18.036025    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:38:18.036128 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:18.036096    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:38:18.036175 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:18.036127    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 23:38:19.042193 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:19.042155    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" event={"ID":"061b4c5b-f901-41a4-99f5-cd4aa4a2c220","Type":"ContainerStarted","Data":"e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e"}
Sep 17 23:38:19.935719 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:19.935680    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:38:19.935925 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:19.935903    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 17 23:38:19.935973 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:19.935954    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 17 23:38:20.935322 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:20.935284    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 17 23:38:20.935746 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:20.935340    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 17 23:38:21.935876 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:21.935837    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 17 23:38:21.936255 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:21.935897    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 17 23:38:22.935496 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:22.935445    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 17 23:38:22.935695 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:22.935517    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 17 23:38:23.935804 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:23.935767    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 17 23:38:23.936198 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:23.935827    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 17 23:38:24.939896 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:24.939859    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:38:24.940345 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:24.940144    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:38:24.940786 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:24.940767    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:38:29.704590 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:29.704557    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"]
Sep 17 23:38:29.707227 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:29.707209    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"
Sep 17 23:38:29.709838 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:29.709820    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:38:29.709894 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:29.709852    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:38:29.716833 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:29.716807    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"]
Sep 17 23:38:29.761876 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:29.761832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86667a15-f743-453f-86bc-4a0a1d0a9612-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf\" (UID: \"86667a15-f743-453f-86bc-4a0a1d0a9612\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"
Sep 17 23:38:29.862774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:29.862737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86667a15-f743-453f-86bc-4a0a1d0a9612-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf\" (UID: \"86667a15-f743-453f-86bc-4a0a1d0a9612\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"
Sep 17 23:38:29.863352 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:29.863333    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86667a15-f743-453f-86bc-4a0a1d0a9612-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf\" (UID: \"86667a15-f743-453f-86bc-4a0a1d0a9612\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"
Sep 17 23:38:30.019610 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:30.019572    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"
Sep 17 23:38:30.294592 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:30.294565    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"]
Sep 17 23:38:30.296074 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:38:30.296045    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86667a15_f743_453f_86bc_4a0a1d0a9612.slice/crio-fb92bd4d034285ba8002414ce5c72326820b793e328bd63d4b8ddcb6c2c5906d WatchSource:0}: Error finding container fb92bd4d034285ba8002414ce5c72326820b793e328bd63d4b8ddcb6c2c5906d: Status 404 returned error can't find the container with id fb92bd4d034285ba8002414ce5c72326820b793e328bd63d4b8ddcb6c2c5906d
Sep 17 23:38:30.974027 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:30.973995    2583 scope.go:117] "RemoveContainer" containerID="27bdea94b26625b45109e95c63f0e053100be7bee1bf398c8ddb7fb5f5be732c"
Sep 17 23:38:31.008511 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:31.008488    2583 scope.go:117] "RemoveContainer" containerID="122dd6bcf8ceeae25ac6b3ae21f46b0418a3e0c1139bfb9c889496d574b16f1a"
Sep 17 23:38:31.135135 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:31.135100    2583 generic.go:356] "Generic (PLEG): container finished" podID="86667a15-f743-453f-86bc-4a0a1d0a9612" containerID="f7bf01c4283318bbd826ac48ffacd27567b284a1eba7d45dcbf9d14f20921be7" exitCode=0
Sep 17 23:38:31.135331 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:31.135184    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf" event={"ID":"86667a15-f743-453f-86bc-4a0a1d0a9612","Type":"ContainerDied","Data":"f7bf01c4283318bbd826ac48ffacd27567b284a1eba7d45dcbf9d14f20921be7"}
Sep 17 23:38:31.135331 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:31.135243    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf" event={"ID":"86667a15-f743-453f-86bc-4a0a1d0a9612","Type":"ContainerStarted","Data":"fb92bd4d034285ba8002414ce5c72326820b793e328bd63d4b8ddcb6c2c5906d"}
Sep 17 23:38:32.293671 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:32.293644    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"
Sep 17 23:38:32.385220 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:32.385178    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86667a15-f743-453f-86bc-4a0a1d0a9612-maas-api-service-ca\") pod \"86667a15-f743-453f-86bc-4a0a1d0a9612\" (UID: \"86667a15-f743-453f-86bc-4a0a1d0a9612\") "
Sep 17 23:38:32.385653 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:32.385624    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86667a15-f743-453f-86bc-4a0a1d0a9612-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "86667a15-f743-453f-86bc-4a0a1d0a9612" (UID: "86667a15-f743-453f-86bc-4a0a1d0a9612"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:38:32.486557 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:32.486478    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86667a15-f743-453f-86bc-4a0a1d0a9612-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:33.148731 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:33.148702    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"
Sep 17 23:38:33.148731 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:33.148718    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf" event={"ID":"86667a15-f743-453f-86bc-4a0a1d0a9612","Type":"ContainerDied","Data":"fb92bd4d034285ba8002414ce5c72326820b793e328bd63d4b8ddcb6c2c5906d"}
Sep 17 23:38:33.148975 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:33.148766    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb92bd4d034285ba8002414ce5c72326820b793e328bd63d4b8ddcb6c2c5906d"
Sep 17 23:38:40.714097 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:40.714052    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"]
Sep 17 23:38:40.714717 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:40.714312    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7" podUID="3054692d-e1cf-4569-9c11-1be2584a1fa7" containerName="payload-processing" containerID="cri-o://f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23" gracePeriod=30
Sep 17 23:38:40.888244 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:40.885915    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"]
Sep 17 23:38:40.891161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:40.891132    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-26b61a-kkbvf"]
Sep 17 23:38:40.976725 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:40.976663    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:41.071829 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.071797    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3054692d-e1cf-4569-9c11-1be2584a1fa7-plugins-config-volume\") pod \"3054692d-e1cf-4569-9c11-1be2584a1fa7\" (UID: \"3054692d-e1cf-4569-9c11-1be2584a1fa7\") "
Sep 17 23:38:41.072018 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.071885    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t67m9\" (UniqueName: \"kubernetes.io/projected/3054692d-e1cf-4569-9c11-1be2584a1fa7-kube-api-access-t67m9\") pod \"3054692d-e1cf-4569-9c11-1be2584a1fa7\" (UID: \"3054692d-e1cf-4569-9c11-1be2584a1fa7\") "
Sep 17 23:38:41.072250 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.072228    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3054692d-e1cf-4569-9c11-1be2584a1fa7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3054692d-e1cf-4569-9c11-1be2584a1fa7" (UID: "3054692d-e1cf-4569-9c11-1be2584a1fa7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:38:41.074242 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.074206    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3054692d-e1cf-4569-9c11-1be2584a1fa7-kube-api-access-t67m9" (OuterVolumeSpecName: "kube-api-access-t67m9") pod "3054692d-e1cf-4569-9c11-1be2584a1fa7" (UID: "3054692d-e1cf-4569-9c11-1be2584a1fa7"). InnerVolumeSpecName "kube-api-access-t67m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:38:41.172969 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.172915    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3054692d-e1cf-4569-9c11-1be2584a1fa7-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:41.172969 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.172964    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t67m9\" (UniqueName: \"kubernetes.io/projected/3054692d-e1cf-4569-9c11-1be2584a1fa7-kube-api-access-t67m9\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:41.197309 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.197271    2583 generic.go:356] "Generic (PLEG): container finished" podID="3054692d-e1cf-4569-9c11-1be2584a1fa7" containerID="f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23" exitCode=0
Sep 17 23:38:41.197504 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.197328    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"
Sep 17 23:38:41.197504 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.197362    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7" event={"ID":"3054692d-e1cf-4569-9c11-1be2584a1fa7","Type":"ContainerDied","Data":"f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23"}
Sep 17 23:38:41.197504 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.197453    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7" event={"ID":"3054692d-e1cf-4569-9c11-1be2584a1fa7","Type":"ContainerDied","Data":"7c9653c99c57937c4c570d6998d2767f69916271b2192fdd7dc755016c8f542f"}
Sep 17 23:38:41.197504 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.197497    2583 scope.go:117] "RemoveContainer" containerID="f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23"
Sep 17 23:38:41.206950 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.206935    2583 scope.go:117] "RemoveContainer" containerID="f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23"
Sep 17 23:38:41.207225 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:38:41.207202    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23\": container with ID starting with f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23 not found: ID does not exist" containerID="f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23"
Sep 17 23:38:41.207288 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.207231    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23"} err="failed to get container status \"f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23\": rpc error: code = NotFound desc = could not find container \"f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23\": container with ID starting with f938fa98cf2ec6234055c80aaae2abaf85b4cdf484f63bd263cd2b54b75cda23 not found: ID does not exist"
Sep 17 23:38:41.220092 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.220069    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"]
Sep 17 23:38:41.223911 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:41.223890    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7"]
Sep 17 23:38:42.488441 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:42.488407    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3054692d-e1cf-4569-9c11-1be2584a1fa7" path="/var/lib/kubelet/pods/3054692d-e1cf-4569-9c11-1be2584a1fa7/volumes"
Sep 17 23:38:42.488860 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:42.488797    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86667a15-f743-453f-86bc-4a0a1d0a9612" path="/var/lib/kubelet/pods/86667a15-f743-453f-86bc-4a0a1d0a9612/volumes"
Sep 17 23:38:47.540565 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:47.540525    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"]
Sep 17 23:38:47.540980 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:47.540863    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy" containerID="cri-o://e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e" gracePeriod=30
Sep 17 23:38:51.267423 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.267385    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"]
Sep 17 23:38:51.267835 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.267821    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3054692d-e1cf-4569-9c11-1be2584a1fa7" containerName="payload-processing"
Sep 17 23:38:51.267879 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.267836    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3054692d-e1cf-4569-9c11-1be2584a1fa7" containerName="payload-processing"
Sep 17 23:38:51.267879 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.267851    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86667a15-f743-453f-86bc-4a0a1d0a9612" containerName="revoke-keys"
Sep 17 23:38:51.267879 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.267856    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="86667a15-f743-453f-86bc-4a0a1d0a9612" containerName="revoke-keys"
Sep 17 23:38:51.267986 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.267918    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3054692d-e1cf-4569-9c11-1be2584a1fa7" containerName="payload-processing"
Sep 17 23:38:51.267986 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.267925    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="86667a15-f743-453f-86bc-4a0a1d0a9612" containerName="revoke-keys"
Sep 17 23:38:51.270723 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.270698    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"
Sep 17 23:38:51.273342 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.273319    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:38:51.273548 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.273384    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:38:51.279506 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.279051    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"]
Sep 17 23:38:51.379582 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.379548    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9550a96f-43bd-4bba-9394-9c800cf34477-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg\" (UID: \"9550a96f-43bd-4bba-9394-9c800cf34477\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"
Sep 17 23:38:51.480187 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.480159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9550a96f-43bd-4bba-9394-9c800cf34477-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg\" (UID: \"9550a96f-43bd-4bba-9394-9c800cf34477\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"
Sep 17 23:38:51.480803 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.480780    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9550a96f-43bd-4bba-9394-9c800cf34477-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg\" (UID: \"9550a96f-43bd-4bba-9394-9c800cf34477\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"
Sep 17 23:38:51.586680 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.586591    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"
Sep 17 23:38:51.859673 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:51.859639    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"]
Sep 17 23:38:51.860858 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:38:51.860825    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9550a96f_43bd_4bba_9394_9c800cf34477.slice/crio-88317e3b35b95eee2d4a48d1df99852e3a624babb9209a1ac8fe053b1d1f41c0 WatchSource:0}: Error finding container 88317e3b35b95eee2d4a48d1df99852e3a624babb9209a1ac8fe053b1d1f41c0: Status 404 returned error can't find the container with id 88317e3b35b95eee2d4a48d1df99852e3a624babb9209a1ac8fe053b1d1f41c0
Sep 17 23:38:52.275690 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.275651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg" event={"ID":"9550a96f-43bd-4bba-9394-9c800cf34477","Type":"ContainerStarted","Data":"1a637253879bfc29e96eb4fed709f82e24b846b5f99bdc4c2782a9d9559e386d"}
Sep 17 23:38:52.276078 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.275713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg" event={"ID":"9550a96f-43bd-4bba-9394-9c800cf34477","Type":"ContainerStarted","Data":"88317e3b35b95eee2d4a48d1df99852e3a624babb9209a1ac8fe053b1d1f41c0"}
Sep 17 23:38:52.291920 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.291852    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg" podStartSLOduration=1.2918335459999999 podStartE2EDuration="1.291833546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:38:52.2906922 +0000 UTC m=+1943.898269866" watchObservedRunningTime="2026-09-17 23:38:52.291833546 +0000 UTC m=+1943.899411206"
Sep 17 23:38:52.796911 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.796882    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:38:52.893771 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.893743    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-data\") pod \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") "
Sep 17 23:38:52.893956 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.893797    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-certs\") pod \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") "
Sep 17 23:38:52.893956 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.893827    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-credential-socket\") pod \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") "
Sep 17 23:38:52.893956 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.893864    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-token\") pod \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") "
Sep 17 23:38:52.893956 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.893905    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pl7z\" (UniqueName: \"kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-kube-api-access-4pl7z\") pod \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") "
Sep 17 23:38:52.894161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.893982    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-socket\") pod \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") "
Sep 17 23:38:52.894161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894009    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-podinfo\") pod \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") "
Sep 17 23:38:52.894161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894056    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istiod-ca-cert\") pod \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") "
Sep 17 23:38:52.894161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894068    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-data" (OuterVolumeSpecName: "istio-data") pod "061b4c5b-f901-41a4-99f5-cd4aa4a2c220" (UID: "061b4c5b-f901-41a4-99f5-cd4aa4a2c220"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:38:52.894161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894080    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-envoy\") pod \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\" (UID: \"061b4c5b-f901-41a4-99f5-cd4aa4a2c220\") "
Sep 17 23:38:52.894434 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894081    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "061b4c5b-f901-41a4-99f5-cd4aa4a2c220" (UID: "061b4c5b-f901-41a4-99f5-cd4aa4a2c220"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:38:52.894434 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894356    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "061b4c5b-f901-41a4-99f5-cd4aa4a2c220" (UID: "061b4c5b-f901-41a4-99f5-cd4aa4a2c220"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:38:52.894869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894487    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-data\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:52.894869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894512    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:52.894869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894526    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-credential-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:52.894869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894586    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "061b4c5b-f901-41a4-99f5-cd4aa4a2c220" (UID: "061b4c5b-f901-41a4-99f5-cd4aa4a2c220"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:38:52.894869 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.894677    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "061b4c5b-f901-41a4-99f5-cd4aa4a2c220" (UID: "061b4c5b-f901-41a4-99f5-cd4aa4a2c220"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:38:52.896293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.896265    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "061b4c5b-f901-41a4-99f5-cd4aa4a2c220" (UID: "061b4c5b-f901-41a4-99f5-cd4aa4a2c220"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:38:52.896401 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.896316    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "061b4c5b-f901-41a4-99f5-cd4aa4a2c220" (UID: "061b4c5b-f901-41a4-99f5-cd4aa4a2c220"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:38:52.896551 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.896532    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-token" (OuterVolumeSpecName: "istio-token") pod "061b4c5b-f901-41a4-99f5-cd4aa4a2c220" (UID: "061b4c5b-f901-41a4-99f5-cd4aa4a2c220"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:38:52.896630 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.896609    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-kube-api-access-4pl7z" (OuterVolumeSpecName: "kube-api-access-4pl7z") pod "061b4c5b-f901-41a4-99f5-cd4aa4a2c220" (UID: "061b4c5b-f901-41a4-99f5-cd4aa4a2c220"). InnerVolumeSpecName "kube-api-access-4pl7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:38:52.996088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.996000    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:52.996088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.996028    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pl7z\" (UniqueName: \"kubernetes.io/projected/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-kube-api-access-4pl7z\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:52.996088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.996044    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-workload-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:52.996088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.996064    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-podinfo\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:52.996088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.996076    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istiod-ca-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:52.996088 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:52.996087    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/061b4c5b-f901-41a4-99f5-cd4aa4a2c220-istio-envoy\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:53.284197 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.284163    2583 generic.go:356] "Generic (PLEG): container finished" podID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerID="e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e" exitCode=0
Sep 17 23:38:53.284753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.284228    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"
Sep 17 23:38:53.284753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.284245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" event={"ID":"061b4c5b-f901-41a4-99f5-cd4aa4a2c220","Type":"ContainerDied","Data":"e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e"}
Sep 17 23:38:53.284753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.284294    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv" event={"ID":"061b4c5b-f901-41a4-99f5-cd4aa4a2c220","Type":"ContainerDied","Data":"7823f60b7eb5b33836b54c254c28c9b1acb7980b1efe9bf7ffc23c042696a529"}
Sep 17 23:38:53.284753 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.284316    2583 scope.go:117] "RemoveContainer" containerID="e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e"
Sep 17 23:38:53.286196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.286169    2583 generic.go:356] "Generic (PLEG): container finished" podID="9550a96f-43bd-4bba-9394-9c800cf34477" containerID="1a637253879bfc29e96eb4fed709f82e24b846b5f99bdc4c2782a9d9559e386d" exitCode=0
Sep 17 23:38:53.286322 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.286268    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg" event={"ID":"9550a96f-43bd-4bba-9394-9c800cf34477","Type":"ContainerDied","Data":"1a637253879bfc29e96eb4fed709f82e24b846b5f99bdc4c2782a9d9559e386d"}
Sep 17 23:38:53.294437 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.294419    2583 scope.go:117] "RemoveContainer" containerID="53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44"
Sep 17 23:38:53.303736 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.303695    2583 scope.go:117] "RemoveContainer" containerID="e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e"
Sep 17 23:38:53.306120 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:38:53.305913    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e\": container with ID starting with e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e not found: ID does not exist" containerID="e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e"
Sep 17 23:38:53.306120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.305948    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e"} err="failed to get container status \"e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e\": rpc error: code = NotFound desc = could not find container \"e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e\": container with ID starting with e29ea67171e2950392d993b7156eca50ed5485203b2507a4094e8abe16ecbd1e not found: ID does not exist"
Sep 17 23:38:53.306120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.305972    2583 scope.go:117] "RemoveContainer" containerID="53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44"
Sep 17 23:38:53.306743 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:38:53.306271    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44\": container with ID starting with 53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44 not found: ID does not exist" containerID="53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44"
Sep 17 23:38:53.306743 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.306301    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44"} err="failed to get container status \"53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44\": rpc error: code = NotFound desc = could not find container \"53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44\": container with ID starting with 53f94c2228bb3d10f25b524b3ec524203abbc22a0080206d820acda0001f8f44 not found: ID does not exist"
Sep 17 23:38:53.319519 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.319487    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"]
Sep 17 23:38:53.321937 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:53.321915    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv"]
Sep 17 23:38:54.429720 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:54.429694    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"
Sep 17 23:38:54.487893 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:54.487863    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" path="/var/lib/kubelet/pods/061b4c5b-f901-41a4-99f5-cd4aa4a2c220/volumes"
Sep 17 23:38:54.511999 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:54.511972    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9550a96f-43bd-4bba-9394-9c800cf34477-maas-api-service-ca\") pod \"9550a96f-43bd-4bba-9394-9c800cf34477\" (UID: \"9550a96f-43bd-4bba-9394-9c800cf34477\") "
Sep 17 23:38:54.512285 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:54.512267    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9550a96f-43bd-4bba-9394-9c800cf34477-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9550a96f-43bd-4bba-9394-9c800cf34477" (UID: "9550a96f-43bd-4bba-9394-9c800cf34477"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:38:54.614207 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:54.614110    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9550a96f-43bd-4bba-9394-9c800cf34477-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:38:55.300297 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:55.300261    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg" event={"ID":"9550a96f-43bd-4bba-9394-9c800cf34477","Type":"ContainerDied","Data":"88317e3b35b95eee2d4a48d1df99852e3a624babb9209a1ac8fe053b1d1f41c0"}
Sep 17 23:38:55.300297 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:55.300281    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"
Sep 17 23:38:55.300586 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:38:55.300310    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88317e3b35b95eee2d4a48d1df99852e3a624babb9209a1ac8fe053b1d1f41c0"
Sep 17 23:39:06.809314 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:06.809281    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"]
Sep 17 23:39:06.809878 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:06.809845    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj" podUID="fe67da96-f25a-4451-b409-d9f7c7d3974a" containerName="payload-processing" containerID="cri-o://2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195" gracePeriod=30
Sep 17 23:39:06.814776 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:06.814748    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"]
Sep 17 23:39:06.815030 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:06.814999    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr" podUID="34cc44cb-3286-4f04-8231-9cdcc09f6fd9" containerName="payload-pre-processing" containerID="cri-o://a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600" gracePeriod=30
Sep 17 23:39:06.971309 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:06.971266    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"]
Sep 17 23:39:06.974067 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:06.974035    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-36fb5c-84dhg"]
Sep 17 23:39:07.105957 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.105933    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:39:07.109157 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.109136    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:39:07.135533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.133559    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sch59\" (UniqueName: \"kubernetes.io/projected/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-kube-api-access-sch59\") pod \"34cc44cb-3286-4f04-8231-9cdcc09f6fd9\" (UID: \"34cc44cb-3286-4f04-8231-9cdcc09f6fd9\") "
Sep 17 23:39:07.135533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.133645    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgzrs\" (UniqueName: \"kubernetes.io/projected/fe67da96-f25a-4451-b409-d9f7c7d3974a-kube-api-access-dgzrs\") pod \"fe67da96-f25a-4451-b409-d9f7c7d3974a\" (UID: \"fe67da96-f25a-4451-b409-d9f7c7d3974a\") "
Sep 17 23:39:07.135533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.133700    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-plugins-config-volume\") pod \"34cc44cb-3286-4f04-8231-9cdcc09f6fd9\" (UID: \"34cc44cb-3286-4f04-8231-9cdcc09f6fd9\") "
Sep 17 23:39:07.135533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.133802    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe67da96-f25a-4451-b409-d9f7c7d3974a-plugins-config-volume\") pod \"fe67da96-f25a-4451-b409-d9f7c7d3974a\" (UID: \"fe67da96-f25a-4451-b409-d9f7c7d3974a\") "
Sep 17 23:39:07.138612 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.136088    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "34cc44cb-3286-4f04-8231-9cdcc09f6fd9" (UID: "34cc44cb-3286-4f04-8231-9cdcc09f6fd9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:39:07.151906 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.150727    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe67da96-f25a-4451-b409-d9f7c7d3974a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe67da96-f25a-4451-b409-d9f7c7d3974a" (UID: "fe67da96-f25a-4451-b409-d9f7c7d3974a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:39:07.161159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.161112    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe67da96-f25a-4451-b409-d9f7c7d3974a-kube-api-access-dgzrs" (OuterVolumeSpecName: "kube-api-access-dgzrs") pod "fe67da96-f25a-4451-b409-d9f7c7d3974a" (UID: "fe67da96-f25a-4451-b409-d9f7c7d3974a"). InnerVolumeSpecName "kube-api-access-dgzrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:39:07.167502 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.166700    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-kube-api-access-sch59" (OuterVolumeSpecName: "kube-api-access-sch59") pod "34cc44cb-3286-4f04-8231-9cdcc09f6fd9" (UID: "34cc44cb-3286-4f04-8231-9cdcc09f6fd9"). InnerVolumeSpecName "kube-api-access-sch59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:39:07.236510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.236442    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:39:07.236510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.236504    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe67da96-f25a-4451-b409-d9f7c7d3974a-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:39:07.236510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.236515    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sch59\" (UniqueName: \"kubernetes.io/projected/34cc44cb-3286-4f04-8231-9cdcc09f6fd9-kube-api-access-sch59\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:39:07.236756 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.236524    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgzrs\" (UniqueName: \"kubernetes.io/projected/fe67da96-f25a-4451-b409-d9f7c7d3974a-kube-api-access-dgzrs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:39:07.373917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.373826    2583 generic.go:356] "Generic (PLEG): container finished" podID="34cc44cb-3286-4f04-8231-9cdcc09f6fd9" containerID="a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600" exitCode=0
Sep 17 23:39:07.373917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.373886    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"
Sep 17 23:39:07.374143 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.373925    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr" event={"ID":"34cc44cb-3286-4f04-8231-9cdcc09f6fd9","Type":"ContainerDied","Data":"a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600"}
Sep 17 23:39:07.374143 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.374019    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr" event={"ID":"34cc44cb-3286-4f04-8231-9cdcc09f6fd9","Type":"ContainerDied","Data":"d2ae1691b3f46d2b33c23e6dac70b54434caf6e2d767cc116e82c10d1c33ad70"}
Sep 17 23:39:07.374143 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.374053    2583 scope.go:117] "RemoveContainer" containerID="a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600"
Sep 17 23:39:07.375431 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.375404    2583 generic.go:356] "Generic (PLEG): container finished" podID="fe67da96-f25a-4451-b409-d9f7c7d3974a" containerID="2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195" exitCode=0
Sep 17 23:39:07.375569 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.375459    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj" event={"ID":"fe67da96-f25a-4451-b409-d9f7c7d3974a","Type":"ContainerDied","Data":"2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195"}
Sep 17 23:39:07.375569 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.375492    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"
Sep 17 23:39:07.375569 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.375516    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj" event={"ID":"fe67da96-f25a-4451-b409-d9f7c7d3974a","Type":"ContainerDied","Data":"38c9cabc139e86158fb925b21a421f6d6aad98a9ee6f23dca7aca7c54ecd92ee"}
Sep 17 23:39:07.384946 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.384931    2583 scope.go:117] "RemoveContainer" containerID="a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600"
Sep 17 23:39:07.385241 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:39:07.385219    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600\": container with ID starting with a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600 not found: ID does not exist" containerID="a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600"
Sep 17 23:39:07.385332 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.385252    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600"} err="failed to get container status \"a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600\": rpc error: code = NotFound desc = could not find container \"a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600\": container with ID starting with a1ed5f7469d2980012f01b6a65e1be6a66194513c48080e9b4a88ecfb5b8b600 not found: ID does not exist"
Sep 17 23:39:07.385332 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.385275    2583 scope.go:117] "RemoveContainer" containerID="2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195"
Sep 17 23:39:07.394702 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.394680    2583 scope.go:117] "RemoveContainer" containerID="2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195"
Sep 17 23:39:07.395058 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:39:07.395030    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195\": container with ID starting with 2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195 not found: ID does not exist" containerID="2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195"
Sep 17 23:39:07.395127 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.395061    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195"} err="failed to get container status \"2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195\": rpc error: code = NotFound desc = could not find container \"2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195\": container with ID starting with 2b8ecca67cd5e0d710922de64767b98b479f6d78be2733d689d1be62ca6b5195 not found: ID does not exist"
Sep 17 23:39:07.397690 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.397672    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"]
Sep 17 23:39:07.401675 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.401657    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr"]
Sep 17 23:39:07.412502 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.412481    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"]
Sep 17 23:39:07.417929 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:07.417910    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj"]
Sep 17 23:39:08.487080 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:08.487040    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34cc44cb-3286-4f04-8231-9cdcc09f6fd9" path="/var/lib/kubelet/pods/34cc44cb-3286-4f04-8231-9cdcc09f6fd9/volumes"
Sep 17 23:39:08.487488 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:08.487423    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9550a96f-43bd-4bba-9394-9c800cf34477" path="/var/lib/kubelet/pods/9550a96f-43bd-4bba-9394-9c800cf34477/volumes"
Sep 17 23:39:08.487833 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:08.487817    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe67da96-f25a-4451-b409-d9f7c7d3974a" path="/var/lib/kubelet/pods/fe67da96-f25a-4451-b409-d9f7c7d3974a/volumes"
Sep 17 23:39:31.036771 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:31.036689    2583 scope.go:117] "RemoveContainer" containerID="2b1f453381a6f009f4376d8740a653e7d73e1b69eb5d2a3e263079bde78fa48c"
Sep 17 23:39:31.045297 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:39:31.045277    2583 scope.go:117] "RemoveContainer" containerID="d47a10efb699dca3e2b50fab95a1e627a35ed94b8037f799b6df27afe3bcac00"
Sep 17 23:40:01.218037 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218004    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"]
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218380    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe67da96-f25a-4451-b409-d9f7c7d3974a" containerName="payload-processing"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218391    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe67da96-f25a-4451-b409-d9f7c7d3974a" containerName="payload-processing"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218403    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34cc44cb-3286-4f04-8231-9cdcc09f6fd9" containerName="payload-pre-processing"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218410    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="34cc44cb-3286-4f04-8231-9cdcc09f6fd9" containerName="payload-pre-processing"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218417    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218423    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218429    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218434    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218455    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9550a96f-43bd-4bba-9394-9c800cf34477" containerName="revoke-keys"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218475    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9550a96f-43bd-4bba-9394-9c800cf34477" containerName="revoke-keys"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218556    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="34cc44cb-3286-4f04-8231-9cdcc09f6fd9" containerName="payload-pre-processing"
Sep 17 23:40:01.218561 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218567    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe67da96-f25a-4451-b409-d9f7c7d3974a" containerName="payload-processing"
Sep 17 23:40:01.218973 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218573    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9550a96f-43bd-4bba-9394-9c800cf34477" containerName="revoke-keys"
Sep 17 23:40:01.218973 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218580    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy"
Sep 17 23:40:01.218973 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.218586    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="061b4c5b-f901-41a4-99f5-cd4aa4a2c220" containerName="istio-proxy"
Sep 17 23:40:01.221569 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.221550    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"
Sep 17 23:40:01.224205 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.224182    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:40:01.224317 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.224186    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:40:01.230345 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.230321    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"]
Sep 17 23:40:01.263082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.263052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94ff3b1c-35ef-4f94-9979-c962656405b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr\" (UID: \"94ff3b1c-35ef-4f94-9979-c962656405b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"
Sep 17 23:40:01.364528 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.364488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94ff3b1c-35ef-4f94-9979-c962656405b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr\" (UID: \"94ff3b1c-35ef-4f94-9979-c962656405b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"
Sep 17 23:40:01.365184 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.365160    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94ff3b1c-35ef-4f94-9979-c962656405b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr\" (UID: \"94ff3b1c-35ef-4f94-9979-c962656405b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"
Sep 17 23:40:01.533334 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.533299    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"
Sep 17 23:40:01.807006 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:01.806976    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"]
Sep 17 23:40:01.808406 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:40:01.808381    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ff3b1c_35ef_4f94_9979_c962656405b1.slice/crio-4144dc0cec696a04b13004bcd69584629e5523e2c2e2d01c3878d6670ee6fb9e WatchSource:0}: Error finding container 4144dc0cec696a04b13004bcd69584629e5523e2c2e2d01c3878d6670ee6fb9e: Status 404 returned error can't find the container with id 4144dc0cec696a04b13004bcd69584629e5523e2c2e2d01c3878d6670ee6fb9e
Sep 17 23:40:02.697781 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:02.697685    2583 generic.go:356] "Generic (PLEG): container finished" podID="94ff3b1c-35ef-4f94-9979-c962656405b1" containerID="e9fceaeb01d9051277388866c95d3e0798adbb929ae67bd72213d10a5e7bf00e" exitCode=0
Sep 17 23:40:02.697781 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:02.697768    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr" event={"ID":"94ff3b1c-35ef-4f94-9979-c962656405b1","Type":"ContainerDied","Data":"e9fceaeb01d9051277388866c95d3e0798adbb929ae67bd72213d10a5e7bf00e"}
Sep 17 23:40:02.698177 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:02.697817    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr" event={"ID":"94ff3b1c-35ef-4f94-9979-c962656405b1","Type":"ContainerStarted","Data":"4144dc0cec696a04b13004bcd69584629e5523e2c2e2d01c3878d6670ee6fb9e"}
Sep 17 23:40:03.843531 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:03.843504    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"
Sep 17 23:40:03.891081 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:03.891049    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94ff3b1c-35ef-4f94-9979-c962656405b1-maas-api-service-ca\") pod \"94ff3b1c-35ef-4f94-9979-c962656405b1\" (UID: \"94ff3b1c-35ef-4f94-9979-c962656405b1\") "
Sep 17 23:40:03.891479 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:03.891436    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ff3b1c-35ef-4f94-9979-c962656405b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "94ff3b1c-35ef-4f94-9979-c962656405b1" (UID: "94ff3b1c-35ef-4f94-9979-c962656405b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:40:03.992153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:03.992064    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94ff3b1c-35ef-4f94-9979-c962656405b1-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:04.711619 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:04.711592    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"
Sep 17 23:40:04.711816 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:04.711627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr" event={"ID":"94ff3b1c-35ef-4f94-9979-c962656405b1","Type":"ContainerDied","Data":"4144dc0cec696a04b13004bcd69584629e5523e2c2e2d01c3878d6670ee6fb9e"}
Sep 17 23:40:04.711816 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:04.711711    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4144dc0cec696a04b13004bcd69584629e5523e2c2e2d01c3878d6670ee6fb9e"
Sep 17 23:40:12.160420 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:12.160380    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"]
Sep 17 23:40:12.163018 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:12.162979    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3c1ddb-njfpr"]
Sep 17 23:40:12.487714 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:12.487634    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ff3b1c-35ef-4f94-9979-c962656405b1" path="/var/lib/kubelet/pods/94ff3b1c-35ef-4f94-9979-c962656405b1/volumes"
Sep 17 23:40:18.622828 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:18.622791    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"]
Sep 17 23:40:18.623302 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:18.623044    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy" containerID="cri-o://1f18e665fe8ebecd191c2b0dda87f55c796111c8b0bce7a7ea06f3613f5eca29" gracePeriod=30
Sep 17 23:40:19.022209 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.022177    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"]
Sep 17 23:40:19.022585 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.022572    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ff3b1c-35ef-4f94-9979-c962656405b1" containerName="revoke-keys"
Sep 17 23:40:19.022585 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.022586    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ff3b1c-35ef-4f94-9979-c962656405b1" containerName="revoke-keys"
Sep 17 23:40:19.022684 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.022656    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ff3b1c-35ef-4f94-9979-c962656405b1" containerName="revoke-keys"
Sep 17 23:40:19.025906 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.025889    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"
Sep 17 23:40:19.028189 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.028164    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:40:19.028322 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.028164    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:40:19.033044 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.033018    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"]
Sep 17 23:40:19.131891 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.131851    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/028770ff-c04a-4154-b4a0-739abacda664-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25\" (UID: \"028770ff-c04a-4154-b4a0-739abacda664\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"
Sep 17 23:40:19.233198 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.233157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/028770ff-c04a-4154-b4a0-739abacda664-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25\" (UID: \"028770ff-c04a-4154-b4a0-739abacda664\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"
Sep 17 23:40:19.233788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.233769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/028770ff-c04a-4154-b4a0-739abacda664-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25\" (UID: \"028770ff-c04a-4154-b4a0-739abacda664\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"
Sep 17 23:40:19.338208 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.338115    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"
Sep 17 23:40:19.613665 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.613633    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"]
Sep 17 23:40:19.615995 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:40:19.615970    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028770ff_c04a_4154_b4a0_739abacda664.slice/crio-a6940bcb925a679346d931a8f5463e7e94ae7310de749c792f7a059d8c080c6e WatchSource:0}: Error finding container a6940bcb925a679346d931a8f5463e7e94ae7310de749c792f7a059d8c080c6e: Status 404 returned error can't find the container with id a6940bcb925a679346d931a8f5463e7e94ae7310de749c792f7a059d8c080c6e
Sep 17 23:40:19.802912 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:19.802878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25" event={"ID":"028770ff-c04a-4154-b4a0-739abacda664","Type":"ContainerStarted","Data":"a6940bcb925a679346d931a8f5463e7e94ae7310de749c792f7a059d8c080c6e"}
Sep 17 23:40:20.811818 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:20.811781    2583 generic.go:356] "Generic (PLEG): container finished" podID="028770ff-c04a-4154-b4a0-739abacda664" containerID="f9a04744b728cfdecdf3d8060903eb6f8eec96699b3371f95cb4864e879f7fb5" exitCode=0
Sep 17 23:40:20.812277 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:20.811859    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25" event={"ID":"028770ff-c04a-4154-b4a0-739abacda664","Type":"ContainerDied","Data":"f9a04744b728cfdecdf3d8060903eb6f8eec96699b3371f95cb4864e879f7fb5"}
Sep 17 23:40:21.947161 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:21.947134    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"
Sep 17 23:40:22.066973 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:22.066937    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/028770ff-c04a-4154-b4a0-739abacda664-maas-api-service-ca\") pod \"028770ff-c04a-4154-b4a0-739abacda664\" (UID: \"028770ff-c04a-4154-b4a0-739abacda664\") "
Sep 17 23:40:22.067391 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:22.067370    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/028770ff-c04a-4154-b4a0-739abacda664-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "028770ff-c04a-4154-b4a0-739abacda664" (UID: "028770ff-c04a-4154-b4a0-739abacda664"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:40:22.168632 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:22.168541    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/028770ff-c04a-4154-b4a0-739abacda664-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:22.825395 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:22.825360    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25" event={"ID":"028770ff-c04a-4154-b4a0-739abacda664","Type":"ContainerDied","Data":"a6940bcb925a679346d931a8f5463e7e94ae7310de749c792f7a059d8c080c6e"}
Sep 17 23:40:22.825606 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:22.825412    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6940bcb925a679346d931a8f5463e7e94ae7310de749c792f7a059d8c080c6e"
Sep 17 23:40:22.825606 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:22.825370    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"
Sep 17 23:40:23.834261 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.834225    2583 generic.go:356] "Generic (PLEG): container finished" podID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerID="1f18e665fe8ebecd191c2b0dda87f55c796111c8b0bce7a7ea06f3613f5eca29" exitCode=0
Sep 17 23:40:23.834730 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.834297    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" event={"ID":"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f","Type":"ContainerDied","Data":"1f18e665fe8ebecd191c2b0dda87f55c796111c8b0bce7a7ea06f3613f5eca29"}
Sep 17 23:40:23.834730 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.834381    2583 scope.go:117] "RemoveContainer" containerID="b2c8eca87c74354a7bdac7d024e912e329163c141c35fbe550c52ba178726542"
Sep 17 23:40:23.870965 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.870942    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:40:23.987870 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.987776    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-podinfo\") pod \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") "
Sep 17 23:40:23.987870 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.987833    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-socket\") pod \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") "
Sep 17 23:40:23.987870 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.987861    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwjcm\" (UniqueName: \"kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-kube-api-access-fwjcm\") pod \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") "
Sep 17 23:40:23.988159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.987877    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-certs\") pod \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") "
Sep 17 23:40:23.988159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.987900    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-envoy\") pod \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") "
Sep 17 23:40:23.988159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.987915    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-token\") pod \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") "
Sep 17 23:40:23.988159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.987946    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-credential-socket\") pod \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") "
Sep 17 23:40:23.988159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.987977    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-data\") pod \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") "
Sep 17 23:40:23.988159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.988112    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istiod-ca-cert\") pod \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\" (UID: \"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f\") "
Sep 17 23:40:23.988501 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.988237    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" (UID: "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:40:23.988501 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.988248    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" (UID: "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:40:23.988501 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.988428    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:23.988501 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.988446    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-workload-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:23.988501 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.988486    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" (UID: "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:40:23.988774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.988508    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" (UID: "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:40:23.988774 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.988613    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" (UID: "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:40:23.990227 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.990195    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" (UID: "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:40:23.990342 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.990223    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-kube-api-access-fwjcm" (OuterVolumeSpecName: "kube-api-access-fwjcm") pod "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" (UID: "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f"). InnerVolumeSpecName "kube-api-access-fwjcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:40:23.990342 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.990258    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" (UID: "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:40:23.990342 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:23.990291    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" (UID: "8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:40:24.088928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.088877    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istiod-ca-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:24.088928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.088920    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-podinfo\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:24.088928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.088932    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwjcm\" (UniqueName: \"kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-kube-api-access-fwjcm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:24.088928 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.088943    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-envoy\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:24.089220 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.088951    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:24.089220 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.088959    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-credential-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:24.089220 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.088967    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f-istio-data\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:24.841025 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.840987    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2" event={"ID":"8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f","Type":"ContainerDied","Data":"40ec4981d97e326231e1d2b304b9a5d9605d84a8b1d45baa748414831614084a"}
Sep 17 23:40:24.841025 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.841015    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"
Sep 17 23:40:24.841572 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.841062    2583 scope.go:117] "RemoveContainer" containerID="1f18e665fe8ebecd191c2b0dda87f55c796111c8b0bce7a7ea06f3613f5eca29"
Sep 17 23:40:24.859622 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.859587    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"]
Sep 17 23:40:24.863640 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:24.863614    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2"]
Sep 17 23:40:26.487111 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:26.487078    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" path="/var/lib/kubelet/pods/8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f/volumes"
Sep 17 23:40:29.576062 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.576022    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc"]
Sep 17 23:40:29.580629 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.580599    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f80c49-29828130-9jrqc"]
Sep 17 23:40:29.607664 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.607623    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"]
Sep 17 23:40:29.608819 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.608778    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6" podUID="61d692d2-aecc-4e80-8141-a726775eb63f" containerName="payload-processing" containerID="cri-o://db40621cfaed212174c35ea26f85760302d4c8535bb6b59ca38afe8fe8d02c7a" gracePeriod=30
Sep 17 23:40:29.612576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.612551    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"]
Sep 17 23:40:29.613015 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.612965    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq" podUID="49dbab4a-e50c-4b60-b81d-88dc64524ee2" containerName="payload-pre-processing" containerID="cri-o://f00ac8a060dc1afabfd90fd5bb2e69b62fb2efc72c7da163b648956729bea8fa" gracePeriod=30
Sep 17 23:40:29.775655 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.775590    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"]
Sep 17 23:40:29.779703 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.779381    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f80c49-hhg25"]
Sep 17 23:40:29.878429 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.878402    2583 generic.go:356] "Generic (PLEG): container finished" podID="61d692d2-aecc-4e80-8141-a726775eb63f" containerID="db40621cfaed212174c35ea26f85760302d4c8535bb6b59ca38afe8fe8d02c7a" exitCode=0
Sep 17 23:40:29.878573 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.878490    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6" event={"ID":"61d692d2-aecc-4e80-8141-a726775eb63f","Type":"ContainerDied","Data":"db40621cfaed212174c35ea26f85760302d4c8535bb6b59ca38afe8fe8d02c7a"}
Sep 17 23:40:29.878573 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.878555    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6" event={"ID":"61d692d2-aecc-4e80-8141-a726775eb63f","Type":"ContainerDied","Data":"20249e8690c264d6de03c136dbd4092dade404f5bc68cc1464412ef59977ac29"}
Sep 17 23:40:29.878697 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.878579    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20249e8690c264d6de03c136dbd4092dade404f5bc68cc1464412ef59977ac29"
Sep 17 23:40:29.880199 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.880177    2583 generic.go:356] "Generic (PLEG): container finished" podID="49dbab4a-e50c-4b60-b81d-88dc64524ee2" containerID="f00ac8a060dc1afabfd90fd5bb2e69b62fb2efc72c7da163b648956729bea8fa" exitCode=0
Sep 17 23:40:29.880299 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.880211    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq" event={"ID":"49dbab4a-e50c-4b60-b81d-88dc64524ee2","Type":"ContainerDied","Data":"f00ac8a060dc1afabfd90fd5bb2e69b62fb2efc72c7da163b648956729bea8fa"}
Sep 17 23:40:29.889055 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.889029    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:40:29.892546 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.892526    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:40:29.944459 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.944429    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61d692d2-aecc-4e80-8141-a726775eb63f-plugins-config-volume\") pod \"61d692d2-aecc-4e80-8141-a726775eb63f\" (UID: \"61d692d2-aecc-4e80-8141-a726775eb63f\") "
Sep 17 23:40:29.944672 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.944524    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6knfs\" (UniqueName: \"kubernetes.io/projected/49dbab4a-e50c-4b60-b81d-88dc64524ee2-kube-api-access-6knfs\") pod \"49dbab4a-e50c-4b60-b81d-88dc64524ee2\" (UID: \"49dbab4a-e50c-4b60-b81d-88dc64524ee2\") "
Sep 17 23:40:29.945215 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.945032    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61d692d2-aecc-4e80-8141-a726775eb63f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "61d692d2-aecc-4e80-8141-a726775eb63f" (UID: "61d692d2-aecc-4e80-8141-a726775eb63f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:40:29.947211 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:29.947187    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49dbab4a-e50c-4b60-b81d-88dc64524ee2-kube-api-access-6knfs" (OuterVolumeSpecName: "kube-api-access-6knfs") pod "49dbab4a-e50c-4b60-b81d-88dc64524ee2" (UID: "49dbab4a-e50c-4b60-b81d-88dc64524ee2"). InnerVolumeSpecName "kube-api-access-6knfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:40:30.046081 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.046041    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csj7z\" (UniqueName: \"kubernetes.io/projected/61d692d2-aecc-4e80-8141-a726775eb63f-kube-api-access-csj7z\") pod \"61d692d2-aecc-4e80-8141-a726775eb63f\" (UID: \"61d692d2-aecc-4e80-8141-a726775eb63f\") "
Sep 17 23:40:30.046258 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.046103    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49dbab4a-e50c-4b60-b81d-88dc64524ee2-plugins-config-volume\") pod \"49dbab4a-e50c-4b60-b81d-88dc64524ee2\" (UID: \"49dbab4a-e50c-4b60-b81d-88dc64524ee2\") "
Sep 17 23:40:30.046385 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.046366    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61d692d2-aecc-4e80-8141-a726775eb63f-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:30.046452 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.046389    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6knfs\" (UniqueName: \"kubernetes.io/projected/49dbab4a-e50c-4b60-b81d-88dc64524ee2-kube-api-access-6knfs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:30.046598 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.046571    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49dbab4a-e50c-4b60-b81d-88dc64524ee2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49dbab4a-e50c-4b60-b81d-88dc64524ee2" (UID: "49dbab4a-e50c-4b60-b81d-88dc64524ee2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:40:30.048144 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.048120    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61d692d2-aecc-4e80-8141-a726775eb63f-kube-api-access-csj7z" (OuterVolumeSpecName: "kube-api-access-csj7z") pod "61d692d2-aecc-4e80-8141-a726775eb63f" (UID: "61d692d2-aecc-4e80-8141-a726775eb63f"). InnerVolumeSpecName "kube-api-access-csj7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:40:30.147290 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.147202    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csj7z\" (UniqueName: \"kubernetes.io/projected/61d692d2-aecc-4e80-8141-a726775eb63f-kube-api-access-csj7z\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:30.147290 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.147239    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49dbab4a-e50c-4b60-b81d-88dc64524ee2-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:30.487160 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.487061    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="028770ff-c04a-4154-b4a0-739abacda664" path="/var/lib/kubelet/pods/028770ff-c04a-4154-b4a0-739abacda664/volumes"
Sep 17 23:40:30.487476 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.487440    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14934634-42eb-4160-a699-bdfcb5bbd39e" path="/var/lib/kubelet/pods/14934634-42eb-4160-a699-bdfcb5bbd39e/volumes"
Sep 17 23:40:30.887055 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.887023    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"
Sep 17 23:40:30.887055 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.887047    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq" event={"ID":"49dbab4a-e50c-4b60-b81d-88dc64524ee2","Type":"ContainerDied","Data":"875f145b55b0d4b70bb24d440bd6bbfd7fa572e9dee206900248c222ee13c550"}
Sep 17 23:40:30.887606 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.887102    2583 scope.go:117] "RemoveContainer" containerID="f00ac8a060dc1afabfd90fd5bb2e69b62fb2efc72c7da163b648956729bea8fa"
Sep 17 23:40:30.887606 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.887032    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"
Sep 17 23:40:30.908821 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.908789    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"]
Sep 17 23:40:30.920642 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.920616    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq"]
Sep 17 23:40:30.930952 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.930929    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"]
Sep 17 23:40:30.937160 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:30.937141    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6"]
Sep 17 23:40:31.085404 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:31.085370    2583 scope.go:117] "RemoveContainer" containerID="8f812c9fe57943d6461452446f915885b6e40f4aaa8a8e5d896b4f67195b2567"
Sep 17 23:40:31.093939 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:31.093911    2583 scope.go:117] "RemoveContainer" containerID="db40621cfaed212174c35ea26f85760302d4c8535bb6b59ca38afe8fe8d02c7a"
Sep 17 23:40:32.488352 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:32.488318    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49dbab4a-e50c-4b60-b81d-88dc64524ee2" path="/var/lib/kubelet/pods/49dbab4a-e50c-4b60-b81d-88dc64524ee2/volumes"
Sep 17 23:40:32.488801 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:32.488723    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61d692d2-aecc-4e80-8141-a726775eb63f" path="/var/lib/kubelet/pods/61d692d2-aecc-4e80-8141-a726775eb63f/volumes"
Sep 17 23:40:36.738079 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738045    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"]
Sep 17 23:40:36.738477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738392    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="028770ff-c04a-4154-b4a0-739abacda664" containerName="revoke-keys"
Sep 17 23:40:36.738477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738402    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="028770ff-c04a-4154-b4a0-739abacda664" containerName="revoke-keys"
Sep 17 23:40:36.738477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738418    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49dbab4a-e50c-4b60-b81d-88dc64524ee2" containerName="payload-pre-processing"
Sep 17 23:40:36.738477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738423    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="49dbab4a-e50c-4b60-b81d-88dc64524ee2" containerName="payload-pre-processing"
Sep 17 23:40:36.738477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738431    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy"
Sep 17 23:40:36.738477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738437    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy"
Sep 17 23:40:36.738477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738454    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d692d2-aecc-4e80-8141-a726775eb63f" containerName="payload-processing"
Sep 17 23:40:36.738477 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738459    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d692d2-aecc-4e80-8141-a726775eb63f" containerName="payload-processing"
Sep 17 23:40:36.738746 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738523    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d692d2-aecc-4e80-8141-a726775eb63f" containerName="payload-processing"
Sep 17 23:40:36.738746 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738530    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy"
Sep 17 23:40:36.738746 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738537    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="49dbab4a-e50c-4b60-b81d-88dc64524ee2" containerName="payload-pre-processing"
Sep 17 23:40:36.738746 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738543    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="028770ff-c04a-4154-b4a0-739abacda664" containerName="revoke-keys"
Sep 17 23:40:36.738746 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.738550    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy"
Sep 17 23:40:36.743441 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.743422    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"
Sep 17 23:40:36.746008 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.745978    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:40:36.746008 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.745988    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d9szq\""
Sep 17 23:40:36.750970 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.750920    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"]
Sep 17 23:40:36.806600 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.806559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa52a13-0c7a-4837-a794-f2a325c4ebc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n\" (UID: \"2fa52a13-0c7a-4837-a794-f2a325c4ebc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"
Sep 17 23:40:36.907414 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.907371    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa52a13-0c7a-4837-a794-f2a325c4ebc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n\" (UID: \"2fa52a13-0c7a-4837-a794-f2a325c4ebc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"
Sep 17 23:40:36.908100 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:36.908074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa52a13-0c7a-4837-a794-f2a325c4ebc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n\" (UID: \"2fa52a13-0c7a-4837-a794-f2a325c4ebc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"
Sep 17 23:40:37.056604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:37.056570    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"
Sep 17 23:40:37.329773 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:37.329748    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"]
Sep 17 23:40:37.331346 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:40:37.331320    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa52a13_0c7a_4837_a794_f2a325c4ebc1.slice/crio-0b59a98c0345508930c93e595cd77809986061e0763098bd5a9bc02e0033668a WatchSource:0}: Error finding container 0b59a98c0345508930c93e595cd77809986061e0763098bd5a9bc02e0033668a: Status 404 returned error can't find the container with id 0b59a98c0345508930c93e595cd77809986061e0763098bd5a9bc02e0033668a
Sep 17 23:40:37.929500 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:37.929441    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n" event={"ID":"2fa52a13-0c7a-4837-a794-f2a325c4ebc1","Type":"ContainerStarted","Data":"24810e7fbe21a4c8ad525981a52e6cd85fae429c2d38c5b4677a2567bfdea25d"}
Sep 17 23:40:37.929921 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:37.929517    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n" event={"ID":"2fa52a13-0c7a-4837-a794-f2a325c4ebc1","Type":"ContainerStarted","Data":"0b59a98c0345508930c93e595cd77809986061e0763098bd5a9bc02e0033668a"}
Sep 17 23:40:37.945496 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:37.945432    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n" podStartSLOduration=1.945417195 podStartE2EDuration="1.945417195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:40:37.943832134 +0000 UTC m=+2049.551409816" watchObservedRunningTime="2026-09-17 23:40:37.945417195 +0000 UTC m=+2049.552994899"
Sep 17 23:40:38.936317 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:38.936279    2583 generic.go:356] "Generic (PLEG): container finished" podID="2fa52a13-0c7a-4837-a794-f2a325c4ebc1" containerID="24810e7fbe21a4c8ad525981a52e6cd85fae429c2d38c5b4677a2567bfdea25d" exitCode=0
Sep 17 23:40:38.936739 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:38.936349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n" event={"ID":"2fa52a13-0c7a-4837-a794-f2a325c4ebc1","Type":"ContainerDied","Data":"24810e7fbe21a4c8ad525981a52e6cd85fae429c2d38c5b4677a2567bfdea25d"}
Sep 17 23:40:40.067740 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:40.067715    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"
Sep 17 23:40:40.139071 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:40.139036    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa52a13-0c7a-4837-a794-f2a325c4ebc1-maas-api-service-ca\") pod \"2fa52a13-0c7a-4837-a794-f2a325c4ebc1\" (UID: \"2fa52a13-0c7a-4837-a794-f2a325c4ebc1\") "
Sep 17 23:40:40.139376 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:40.139354    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa52a13-0c7a-4837-a794-f2a325c4ebc1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2fa52a13-0c7a-4837-a794-f2a325c4ebc1" (UID: "2fa52a13-0c7a-4837-a794-f2a325c4ebc1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:40:40.240504 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:40.240397    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa52a13-0c7a-4837-a794-f2a325c4ebc1-maas-api-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:40.948085 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:40.948057    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"
Sep 17 23:40:40.948085 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:40.948069    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n" event={"ID":"2fa52a13-0c7a-4837-a794-f2a325c4ebc1","Type":"ContainerDied","Data":"0b59a98c0345508930c93e595cd77809986061e0763098bd5a9bc02e0033668a"}
Sep 17 23:40:40.948294 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:40.948115    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b59a98c0345508930c93e595cd77809986061e0763098bd5a9bc02e0033668a"
Sep 17 23:40:47.579566 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.579474    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"]
Sep 17 23:40:47.580000 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.579732    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc" podUID="b042c251-7c75-4ed5-9ee6-bdee0893e429" containerName="payload-processing" containerID="cri-o://347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b" gracePeriod=30
Sep 17 23:40:47.731087 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.731048    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"]
Sep 17 23:40:47.740596 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.740563    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f6ac6e-h9k5n"]
Sep 17 23:40:47.843697 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.843634    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:40:47.908900 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.908869    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b042c251-7c75-4ed5-9ee6-bdee0893e429-plugins-config-volume\") pod \"b042c251-7c75-4ed5-9ee6-bdee0893e429\" (UID: \"b042c251-7c75-4ed5-9ee6-bdee0893e429\") "
Sep 17 23:40:47.909049 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.908933    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjz5c\" (UniqueName: \"kubernetes.io/projected/b042c251-7c75-4ed5-9ee6-bdee0893e429-kube-api-access-pjz5c\") pod \"b042c251-7c75-4ed5-9ee6-bdee0893e429\" (UID: \"b042c251-7c75-4ed5-9ee6-bdee0893e429\") "
Sep 17 23:40:47.909240 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.909219    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b042c251-7c75-4ed5-9ee6-bdee0893e429-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b042c251-7c75-4ed5-9ee6-bdee0893e429" (UID: "b042c251-7c75-4ed5-9ee6-bdee0893e429"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:40:47.911147 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.911114    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b042c251-7c75-4ed5-9ee6-bdee0893e429-kube-api-access-pjz5c" (OuterVolumeSpecName: "kube-api-access-pjz5c") pod "b042c251-7c75-4ed5-9ee6-bdee0893e429" (UID: "b042c251-7c75-4ed5-9ee6-bdee0893e429"). InnerVolumeSpecName "kube-api-access-pjz5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:40:47.986936 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.986900    2583 generic.go:356] "Generic (PLEG): container finished" podID="b042c251-7c75-4ed5-9ee6-bdee0893e429" containerID="347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b" exitCode=0
Sep 17 23:40:47.987140 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.986945    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"
Sep 17 23:40:47.987140 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.986991    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc" event={"ID":"b042c251-7c75-4ed5-9ee6-bdee0893e429","Type":"ContainerDied","Data":"347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b"}
Sep 17 23:40:47.987140 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.987048    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc" event={"ID":"b042c251-7c75-4ed5-9ee6-bdee0893e429","Type":"ContainerDied","Data":"71e3a03eaf6565c47d5556042d72740c24d09ee49a3c104ae0c68ae6722f3b04"}
Sep 17 23:40:47.987140 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.987078    2583 scope.go:117] "RemoveContainer" containerID="347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b"
Sep 17 23:40:47.997510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.997489    2583 scope.go:117] "RemoveContainer" containerID="347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b"
Sep 17 23:40:47.997806 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:40:47.997787    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b\": container with ID starting with 347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b not found: ID does not exist" containerID="347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b"
Sep 17 23:40:47.997884 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:47.997812    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b"} err="failed to get container status \"347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b\": rpc error: code = NotFound desc = could not find container \"347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b\": container with ID starting with 347b2c42f425802cb4afceea93796c7e779eb0c680a50ceb3d00181552f2436b not found: ID does not exist"
Sep 17 23:40:48.010446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:48.010424    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b042c251-7c75-4ed5-9ee6-bdee0893e429-plugins-config-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:48.010446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:48.010447    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjz5c\" (UniqueName: \"kubernetes.io/projected/b042c251-7c75-4ed5-9ee6-bdee0893e429-kube-api-access-pjz5c\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:48.010595 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:48.010547    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"]
Sep 17 23:40:48.013604 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:48.013585    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc"]
Sep 17 23:40:48.487042 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:48.487010    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fa52a13-0c7a-4837-a794-f2a325c4ebc1" path="/var/lib/kubelet/pods/2fa52a13-0c7a-4837-a794-f2a325c4ebc1/volumes"
Sep 17 23:40:48.487376 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:48.487363    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b042c251-7c75-4ed5-9ee6-bdee0893e429" path="/var/lib/kubelet/pods/b042c251-7c75-4ed5-9ee6-bdee0893e429/volumes"
Sep 17 23:40:54.163439 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:54.163405    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"]
Sep 17 23:40:54.164036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:54.163643    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy" containerID="cri-o://83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0" gracePeriod=30
Sep 17 23:40:55.702935 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:55.702893    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 23:40:55.703316 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:55.702949    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 23:40:56.729475 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:56.729426    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-947db468d-2qdk6"]
Sep 17 23:40:56.730025 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:56.729675    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-947db468d-2qdk6" podUID="5636cfaf-f7c1-42f1-a56e-730cefa419e7" containerName="manager" containerID="cri-o://70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc" gracePeriod=30
Sep 17 23:40:56.979024 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:56.978996    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:40:57.040951 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.040913    2583 generic.go:356] "Generic (PLEG): container finished" podID="5636cfaf-f7c1-42f1-a56e-730cefa419e7" containerID="70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc" exitCode=0
Sep 17 23:40:57.041148 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.040963    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-947db468d-2qdk6"
Sep 17 23:40:57.041148 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.041000    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-947db468d-2qdk6" event={"ID":"5636cfaf-f7c1-42f1-a56e-730cefa419e7","Type":"ContainerDied","Data":"70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc"}
Sep 17 23:40:57.041148 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.041054    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-947db468d-2qdk6" event={"ID":"5636cfaf-f7c1-42f1-a56e-730cefa419e7","Type":"ContainerDied","Data":"484b36a8f6995fa79dea951622669a95febeb37429b55727e0c25f931c62a516"}
Sep 17 23:40:57.041148 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.041077    2583 scope.go:117] "RemoveContainer" containerID="70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc"
Sep 17 23:40:57.050539 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.050521    2583 scope.go:117] "RemoveContainer" containerID="70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc"
Sep 17 23:40:57.050860 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:40:57.050839    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc\": container with ID starting with 70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc not found: ID does not exist" containerID="70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc"
Sep 17 23:40:57.050952 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.050871    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc"} err="failed to get container status \"70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc\": rpc error: code = NotFound desc = could not find container \"70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc\": container with ID starting with 70603f80f39647af466c8f67b4a2f3f43d0e0f07b0755e9eae191a8361a7f8dc not found: ID does not exist"
Sep 17 23:40:57.106242 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.106203    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-webhook-cert\") pod \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") "
Sep 17 23:40:57.106418 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.106317    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7srwg\" (UniqueName: \"kubernetes.io/projected/5636cfaf-f7c1-42f1-a56e-730cefa419e7-kube-api-access-7srwg\") pod \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") "
Sep 17 23:40:57.106418 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.106340    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-metrics-certs\") pod \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\" (UID: \"5636cfaf-f7c1-42f1-a56e-730cefa419e7\") "
Sep 17 23:40:57.108411 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.108375    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5636cfaf-f7c1-42f1-a56e-730cefa419e7" (UID: "5636cfaf-f7c1-42f1-a56e-730cefa419e7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:40:57.108576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.108405    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5636cfaf-f7c1-42f1-a56e-730cefa419e7" (UID: "5636cfaf-f7c1-42f1-a56e-730cefa419e7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:40:57.108576 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.108555    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5636cfaf-f7c1-42f1-a56e-730cefa419e7-kube-api-access-7srwg" (OuterVolumeSpecName: "kube-api-access-7srwg") pod "5636cfaf-f7c1-42f1-a56e-730cefa419e7" (UID: "5636cfaf-f7c1-42f1-a56e-730cefa419e7"). InnerVolumeSpecName "kube-api-access-7srwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:40:57.208280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.208229    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-webhook-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:57.208280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.208274    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7srwg\" (UniqueName: \"kubernetes.io/projected/5636cfaf-f7c1-42f1-a56e-730cefa419e7-kube-api-access-7srwg\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:57.208280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.208285    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5636cfaf-f7c1-42f1-a56e-730cefa419e7-metrics-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:57.363873 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.363844    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-947db468d-2qdk6"]
Sep 17 23:40:57.367505 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:57.367483    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-947db468d-2qdk6"]
Sep 17 23:40:58.487598 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:58.487568    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5636cfaf-f7c1-42f1-a56e-730cefa419e7" path="/var/lib/kubelet/pods/5636cfaf-f7c1-42f1-a56e-730cefa419e7/volumes"
Sep 17 23:40:59.424381 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.424354    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:40:59.531889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.531862    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e808fb8-abb3-4d7f-a760-f11aa279af15-istiod-ca-cert\") pod \"8e808fb8-abb3-4d7f-a760-f11aa279af15\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") "
Sep 17 23:40:59.531889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.531895    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-token\") pod \"8e808fb8-abb3-4d7f-a760-f11aa279af15\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") "
Sep 17 23:40:59.532416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.531911    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-socket\") pod \"8e808fb8-abb3-4d7f-a760-f11aa279af15\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") "
Sep 17 23:40:59.532416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.531945    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-credential-socket\") pod \"8e808fb8-abb3-4d7f-a760-f11aa279af15\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") "
Sep 17 23:40:59.532416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.531966    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-envoy\") pod \"8e808fb8-abb3-4d7f-a760-f11aa279af15\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") "
Sep 17 23:40:59.532416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532001    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-podinfo\") pod \"8e808fb8-abb3-4d7f-a760-f11aa279af15\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") "
Sep 17 23:40:59.532416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532041    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzbng\" (UniqueName: \"kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-kube-api-access-lzbng\") pod \"8e808fb8-abb3-4d7f-a760-f11aa279af15\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") "
Sep 17 23:40:59.532416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532066    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-certs\") pod \"8e808fb8-abb3-4d7f-a760-f11aa279af15\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") "
Sep 17 23:40:59.532416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532139    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-data\") pod \"8e808fb8-abb3-4d7f-a760-f11aa279af15\" (UID: \"8e808fb8-abb3-4d7f-a760-f11aa279af15\") "
Sep 17 23:40:59.532416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532309    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e808fb8-abb3-4d7f-a760-f11aa279af15" (UID: "8e808fb8-abb3-4d7f-a760-f11aa279af15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:40:59.532416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532328    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e808fb8-abb3-4d7f-a760-f11aa279af15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e808fb8-abb3-4d7f-a760-f11aa279af15" (UID: "8e808fb8-abb3-4d7f-a760-f11aa279af15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:40:59.533196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532515    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e808fb8-abb3-4d7f-a760-f11aa279af15" (UID: "8e808fb8-abb3-4d7f-a760-f11aa279af15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:40:59.533196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532538    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e808fb8-abb3-4d7f-a760-f11aa279af15" (UID: "8e808fb8-abb3-4d7f-a760-f11aa279af15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:40:59.533196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532541    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e808fb8-abb3-4d7f-a760-f11aa279af15-istiod-ca-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:59.533196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532597    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-credential-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:59.533196 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.532727    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e808fb8-abb3-4d7f-a760-f11aa279af15" (UID: "8e808fb8-abb3-4d7f-a760-f11aa279af15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:40:59.534348 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.534323    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e808fb8-abb3-4d7f-a760-f11aa279af15" (UID: "8e808fb8-abb3-4d7f-a760-f11aa279af15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:40:59.534711 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.534689    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e808fb8-abb3-4d7f-a760-f11aa279af15" (UID: "8e808fb8-abb3-4d7f-a760-f11aa279af15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:40:59.534827 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.534779    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-kube-api-access-lzbng" (OuterVolumeSpecName: "kube-api-access-lzbng") pod "8e808fb8-abb3-4d7f-a760-f11aa279af15" (UID: "8e808fb8-abb3-4d7f-a760-f11aa279af15"). InnerVolumeSpecName "kube-api-access-lzbng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:40:59.534827 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.534776    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e808fb8-abb3-4d7f-a760-f11aa279af15" (UID: "8e808fb8-abb3-4d7f-a760-f11aa279af15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:40:59.633850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.633819    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-podinfo\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:59.633850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.633844    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzbng\" (UniqueName: \"kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-kube-api-access-lzbng\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:59.633850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.633854    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:59.633850 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.633863    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-data\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:59.634123 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.633871    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:59.634123 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.633879    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-workload-socket\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:40:59.634123 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:40:59.633889    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e808fb8-abb3-4d7f-a760-f11aa279af15-istio-envoy\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:41:00.063792 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.063755    2583 generic.go:356] "Generic (PLEG): container finished" podID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerID="83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0" exitCode=0
Sep 17 23:41:00.063958 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.063795    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" event={"ID":"8e808fb8-abb3-4d7f-a760-f11aa279af15","Type":"ContainerDied","Data":"83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0"}
Sep 17 23:41:00.063958 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.063827    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"
Sep 17 23:41:00.063958 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.063869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5" event={"ID":"8e808fb8-abb3-4d7f-a760-f11aa279af15","Type":"ContainerDied","Data":"0ecd12bffe27595a2a81cbff64ebaee629932fdc9110fb89e776fe0561c7dcb3"}
Sep 17 23:41:00.063958 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.063904    2583 scope.go:117] "RemoveContainer" containerID="83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0"
Sep 17 23:41:00.075736 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.075714    2583 scope.go:117] "RemoveContainer" containerID="9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46"
Sep 17 23:41:00.085089 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.085072    2583 scope.go:117] "RemoveContainer" containerID="83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0"
Sep 17 23:41:00.085406 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:41:00.085385    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0\": container with ID starting with 83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0 not found: ID does not exist" containerID="83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0"
Sep 17 23:41:00.085510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.085418    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0"} err="failed to get container status \"83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0\": rpc error: code = NotFound desc = could not find container \"83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0\": container with ID starting with 83167fdef951743070862d8cb5ac44418b91f3fea742dbb68f0a405c5f77ace0 not found: ID does not exist"
Sep 17 23:41:00.085510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.085442    2583 scope.go:117] "RemoveContainer" containerID="9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46"
Sep 17 23:41:00.085781 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:41:00.085766    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46\": container with ID starting with 9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46 not found: ID does not exist" containerID="9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46"
Sep 17 23:41:00.085836 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.085788    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46"} err="failed to get container status \"9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46\": rpc error: code = NotFound desc = could not find container \"9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46\": container with ID starting with 9779bf9a2f98301087ea0fcee5324ee667184839c724c7d8572d7f7db17a9a46 not found: ID does not exist"
Sep 17 23:41:00.091317 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.091292    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"]
Sep 17 23:41:00.095310 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.095284    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5"]
Sep 17 23:41:00.486718 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:00.486640    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" path="/var/lib/kubelet/pods/8e808fb8-abb3-4d7f-a760-f11aa279af15/volumes"
Sep 17 23:41:58.156357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156319    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-947db468d-hqknz"]
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156705    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy"
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156719    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy"
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156729    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy"
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156734    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f7399b6-511f-44a7-b2bf-0a8ad6cdb31f" containerName="istio-proxy"
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156756    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa52a13-0c7a-4837-a794-f2a325c4ebc1" containerName="revoke-keys"
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156763    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa52a13-0c7a-4837-a794-f2a325c4ebc1" containerName="revoke-keys"
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156775    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5636cfaf-f7c1-42f1-a56e-730cefa419e7" containerName="manager"
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156781    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5636cfaf-f7c1-42f1-a56e-730cefa419e7" containerName="manager"
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156788    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b042c251-7c75-4ed5-9ee6-bdee0893e429" containerName="payload-processing"
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156793    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b042c251-7c75-4ed5-9ee6-bdee0893e429" containerName="payload-processing"
Sep 17 23:41:58.156845 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156851    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy"
Sep 17 23:41:58.157206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156861    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy"
Sep 17 23:41:58.157206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156870    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa52a13-0c7a-4837-a794-f2a325c4ebc1" containerName="revoke-keys"
Sep 17 23:41:58.157206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156876    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b042c251-7c75-4ed5-9ee6-bdee0893e429" containerName="payload-processing"
Sep 17 23:41:58.157206 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.156882    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5636cfaf-f7c1-42f1-a56e-730cefa419e7" containerName="manager"
Sep 17 23:41:58.159882 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.159851    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.163384 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.163348    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 23:41:58.163570 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.163417    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 23:41:58.163570 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.163429    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 23:41:58.163570 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.163426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xv8zb\""
Sep 17 23:41:58.169782 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.169741    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-947db468d-hqknz"]
Sep 17 23:41:58.256121 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.256069    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-metrics-certs\") pod \"maas-controller-947db468d-hqknz\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") " pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.256121 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.256137    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-webhook-cert\") pod \"maas-controller-947db468d-hqknz\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") " pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.256368 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.256229    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87s2z\" (UniqueName: \"kubernetes.io/projected/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-kube-api-access-87s2z\") pod \"maas-controller-947db468d-hqknz\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") " pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.357392 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.357333    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-metrics-certs\") pod \"maas-controller-947db468d-hqknz\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") " pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.357392 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.357407    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-webhook-cert\") pod \"maas-controller-947db468d-hqknz\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") " pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.357664 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.357431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87s2z\" (UniqueName: \"kubernetes.io/projected/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-kube-api-access-87s2z\") pod \"maas-controller-947db468d-hqknz\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") " pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.359981 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.359935    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-webhook-cert\") pod \"maas-controller-947db468d-hqknz\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") " pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.360116 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.360071    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-metrics-certs\") pod \"maas-controller-947db468d-hqknz\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") " pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.366043 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.366003    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87s2z\" (UniqueName: \"kubernetes.io/projected/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-kube-api-access-87s2z\") pod \"maas-controller-947db468d-hqknz\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") " pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.471275 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.471182    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:58.748135 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.748102    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-947db468d-hqknz"]
Sep 17 23:41:58.749849 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:41:58.749820    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f79952_c1b6_4eae_9665_c9f8e96a0efd.slice/crio-183f7a99d10cfbb6479ad424c9f7360de2e0349cb03af5f10678d5a388a80925 WatchSource:0}: Error finding container 183f7a99d10cfbb6479ad424c9f7360de2e0349cb03af5f10678d5a388a80925: Status 404 returned error can't find the container with id 183f7a99d10cfbb6479ad424c9f7360de2e0349cb03af5f10678d5a388a80925
Sep 17 23:41:58.751654 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:58.751630    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:41:59.395197 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:59.395161    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-947db468d-hqknz" event={"ID":"e2f79952-c1b6-4eae-9665-c9f8e96a0efd","Type":"ContainerStarted","Data":"d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e"}
Sep 17 23:41:59.395617 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:59.395217    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-947db468d-hqknz" event={"ID":"e2f79952-c1b6-4eae-9665-c9f8e96a0efd","Type":"ContainerStarted","Data":"183f7a99d10cfbb6479ad424c9f7360de2e0349cb03af5f10678d5a388a80925"}
Sep 17 23:41:59.395617 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:59.395261    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:41:59.415320 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:41:59.415262    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-947db468d-hqknz" podStartSLOduration=0.960168208 podStartE2EDuration="1.415241589s" totalImagesPullingTime="455.073381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:41:59.413099456 +0000 UTC m=+2131.020677137" watchObservedRunningTime="2026-09-17 23:41:59.415241589 +0000 UTC m=+2131.022819249"
Sep 17 23:42:10.403865 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:10.403833    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:42:19.728359 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:19.728265    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-947db468d-hqknz"]
Sep 17 23:42:19.728788 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:19.728505    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-947db468d-hqknz" podUID="e2f79952-c1b6-4eae-9665-c9f8e96a0efd" containerName="manager" containerID="cri-o://d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e" gracePeriod=30
Sep 17 23:42:19.973058 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:19.973030    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:42:20.047917 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.047884    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87s2z\" (UniqueName: \"kubernetes.io/projected/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-kube-api-access-87s2z\") pod \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") "
Sep 17 23:42:20.048121 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.047925    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-metrics-certs\") pod \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") "
Sep 17 23:42:20.048121 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.047986    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-webhook-cert\") pod \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\" (UID: \"e2f79952-c1b6-4eae-9665-c9f8e96a0efd\") "
Sep 17 23:42:20.050098 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.050065    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e2f79952-c1b6-4eae-9665-c9f8e96a0efd" (UID: "e2f79952-c1b6-4eae-9665-c9f8e96a0efd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:42:20.050224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.050072    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-kube-api-access-87s2z" (OuterVolumeSpecName: "kube-api-access-87s2z") pod "e2f79952-c1b6-4eae-9665-c9f8e96a0efd" (UID: "e2f79952-c1b6-4eae-9665-c9f8e96a0efd"). InnerVolumeSpecName "kube-api-access-87s2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:42:20.050224 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.050119    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e2f79952-c1b6-4eae-9665-c9f8e96a0efd" (UID: "e2f79952-c1b6-4eae-9665-c9f8e96a0efd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:42:20.149252 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.149203    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-webhook-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:42:20.149252 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.149242    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87s2z\" (UniqueName: \"kubernetes.io/projected/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-kube-api-access-87s2z\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:42:20.149252 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.149252    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2f79952-c1b6-4eae-9665-c9f8e96a0efd-metrics-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:42:20.514725 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.514689    2583 generic.go:356] "Generic (PLEG): container finished" podID="e2f79952-c1b6-4eae-9665-c9f8e96a0efd" containerID="d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e" exitCode=0
Sep 17 23:42:20.514898 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.514744    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-947db468d-hqknz"
Sep 17 23:42:20.514898 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.514765    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-947db468d-hqknz" event={"ID":"e2f79952-c1b6-4eae-9665-c9f8e96a0efd","Type":"ContainerDied","Data":"d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e"}
Sep 17 23:42:20.514898 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.514820    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-947db468d-hqknz" event={"ID":"e2f79952-c1b6-4eae-9665-c9f8e96a0efd","Type":"ContainerDied","Data":"183f7a99d10cfbb6479ad424c9f7360de2e0349cb03af5f10678d5a388a80925"}
Sep 17 23:42:20.514898 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.514842    2583 scope.go:117] "RemoveContainer" containerID="d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e"
Sep 17 23:42:20.524082 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.524062    2583 scope.go:117] "RemoveContainer" containerID="d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e"
Sep 17 23:42:20.524399 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:42:20.524379    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e\": container with ID starting with d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e not found: ID does not exist" containerID="d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e"
Sep 17 23:42:20.524454 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.524409    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e"} err="failed to get container status \"d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e\": rpc error: code = NotFound desc = could not find container \"d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e\": container with ID starting with d2c51fbfa958d8eaf467ae69ba638f4c4a647f893cbabf742b3157ecbb558d6e not found: ID does not exist"
Sep 17 23:42:20.532908 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.532874    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-947db468d-hqknz"]
Sep 17 23:42:20.541641 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:20.541609    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-947db468d-hqknz"]
Sep 17 23:42:21.320895 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.320856    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-947db468d-2z9k2"]
Sep 17 23:42:21.321293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.321231    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy"
Sep 17 23:42:21.321293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.321244    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e808fb8-abb3-4d7f-a760-f11aa279af15" containerName="istio-proxy"
Sep 17 23:42:21.321293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.321253    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f79952-c1b6-4eae-9665-c9f8e96a0efd" containerName="manager"
Sep 17 23:42:21.321293 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.321259    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f79952-c1b6-4eae-9665-c9f8e96a0efd" containerName="manager"
Sep 17 23:42:21.321431 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.321323    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f79952-c1b6-4eae-9665-c9f8e96a0efd" containerName="manager"
Sep 17 23:42:21.325599 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.325574    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.329138 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.329106    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 23:42:21.329286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.329147    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 23:42:21.329286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.329172    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xv8zb\""
Sep 17 23:42:21.329286 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.329156    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 23:42:21.340617 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.340587    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-947db468d-2z9k2"]
Sep 17 23:42:21.461275 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.461230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d-metrics-certs\") pod \"maas-controller-947db468d-2z9k2\" (UID: \"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d\") " pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.461496 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.461332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m5hw\" (UniqueName: \"kubernetes.io/projected/a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d-kube-api-access-6m5hw\") pod \"maas-controller-947db468d-2z9k2\" (UID: \"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d\") " pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.461496 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.461369    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d-webhook-cert\") pod \"maas-controller-947db468d-2z9k2\" (UID: \"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d\") " pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.562197 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.562151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m5hw\" (UniqueName: \"kubernetes.io/projected/a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d-kube-api-access-6m5hw\") pod \"maas-controller-947db468d-2z9k2\" (UID: \"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d\") " pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.562197 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.562208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d-webhook-cert\") pod \"maas-controller-947db468d-2z9k2\" (UID: \"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d\") " pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.562518 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.562248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d-metrics-certs\") pod \"maas-controller-947db468d-2z9k2\" (UID: \"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d\") " pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.564786 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.564756    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d-webhook-cert\") pod \"maas-controller-947db468d-2z9k2\" (UID: \"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d\") " pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.564896 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.564876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d-metrics-certs\") pod \"maas-controller-947db468d-2z9k2\" (UID: \"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d\") " pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.570363 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.570335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m5hw\" (UniqueName: \"kubernetes.io/projected/a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d-kube-api-access-6m5hw\") pod \"maas-controller-947db468d-2z9k2\" (UID: \"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d\") " pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.636231 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.636131    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:21.911021 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:21.910993    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-947db468d-2z9k2"]
Sep 17 23:42:21.912674 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:42:21.912643    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65f5c34_1fcd_47bb_ab78_04a2e37ebf2d.slice/crio-e1a2eacc3836a783e86b485c4712fb03ecce82d4f9c99aa42c9cb3593f1b7f65 WatchSource:0}: Error finding container e1a2eacc3836a783e86b485c4712fb03ecce82d4f9c99aa42c9cb3593f1b7f65: Status 404 returned error can't find the container with id e1a2eacc3836a783e86b485c4712fb03ecce82d4f9c99aa42c9cb3593f1b7f65
Sep 17 23:42:22.490120 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:22.490074    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2f79952-c1b6-4eae-9665-c9f8e96a0efd" path="/var/lib/kubelet/pods/e2f79952-c1b6-4eae-9665-c9f8e96a0efd/volumes"
Sep 17 23:42:22.528871 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:22.528826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-947db468d-2z9k2" event={"ID":"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d","Type":"ContainerStarted","Data":"bdbec74cd0a2e1618ad6944077cdec7e952e88119100f5b0cea7f12197679d50"}
Sep 17 23:42:22.529057 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:22.528892    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-947db468d-2z9k2" event={"ID":"a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d","Type":"ContainerStarted","Data":"e1a2eacc3836a783e86b485c4712fb03ecce82d4f9c99aa42c9cb3593f1b7f65"}
Sep 17 23:42:22.529057 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:22.529035    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:42:22.550784 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:22.550669    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-947db468d-2z9k2" podStartSLOduration=1.179982979 podStartE2EDuration="1.550645802s" totalImagesPullingTime="370.662823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:42:22.548680858 +0000 UTC m=+2154.156258543" watchObservedRunningTime="2026-09-17 23:42:22.550645802 +0000 UTC m=+2154.158223462"
Sep 17 23:42:33.537532 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:42:33.537496    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-947db468d-2z9k2"
Sep 17 23:44:31.170995 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:44:31.170963    2583 scope.go:117] "RemoveContainer" containerID="f7bf01c4283318bbd826ac48ffacd27567b284a1eba7d45dcbf9d14f20921be7"
Sep 17 23:45:31.192414 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:31.192330    2583 scope.go:117] "RemoveContainer" containerID="1a637253879bfc29e96eb4fed709f82e24b846b5f99bdc4c2782a9d9559e386d"
Sep 17 23:45:49.602482 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.602431    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"]
Sep 17 23:45:49.607190 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.607164    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.609508 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.609473    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-11e42420-kserve-self-signed-certs\""
Sep 17 23:45:49.615744 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.615716    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"]
Sep 17 23:45:49.679398 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.679362    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tmp-dir\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.679622 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.679426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-model-cache\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.679622 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.679494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-home\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.679778 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.679717    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tls-certs\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.679778 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.679763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbkrs\" (UniqueName: \"kubernetes.io/projected/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-kube-api-access-cbkrs\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.679893 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.679788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-dshm\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.780639 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.780593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbkrs\" (UniqueName: \"kubernetes.io/projected/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-kube-api-access-cbkrs\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.780639 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.780644    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-dshm\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.780893 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.780693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tmp-dir\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.780893 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.780736    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-model-cache\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.780893 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.780762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-home\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.780893 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.780856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tls-certs\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.781214 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.781187    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tmp-dir\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.781301 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.781245    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-model-cache\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.781396 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.781372    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-home\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.784501 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.784415    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tls-certs\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.785266 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.785216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-dshm\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.789247 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.789220    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbkrs\" (UniqueName: \"kubernetes.io/projected/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-kube-api-access-cbkrs\") pod \"e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") " pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:49.918047 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:49.917943    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:50.191667 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:50.191642    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"]
Sep 17 23:45:50.194135 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:45:50.194107    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode70b6ae1_cd2d_4bf5_90f4_68f25b443964.slice/crio-5cc807f955373de38bb61a5bb4208640dc80e0adb007a4ab5d434f8ae33cab3d WatchSource:0}: Error finding container 5cc807f955373de38bb61a5bb4208640dc80e0adb007a4ab5d434f8ae33cab3d: Status 404 returned error can't find the container with id 5cc807f955373de38bb61a5bb4208640dc80e0adb007a4ab5d434f8ae33cab3d
Sep 17 23:45:50.672379 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:50.672340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h" event={"ID":"e70b6ae1-cd2d-4bf5-90f4-68f25b443964","Type":"ContainerStarted","Data":"4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec"}
Sep 17 23:45:50.672379 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:50.672388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h" event={"ID":"e70b6ae1-cd2d-4bf5-90f4-68f25b443964","Type":"ContainerStarted","Data":"5cc807f955373de38bb61a5bb4208640dc80e0adb007a4ab5d434f8ae33cab3d"}
Sep 17 23:45:50.691876 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:50.691818    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h" podStartSLOduration=1.691799617 podStartE2EDuration="1.691799617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:45:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:45:50.689371929 +0000 UTC m=+2362.296949616" watchObservedRunningTime="2026-09-17 23:45:50.691799617 +0000 UTC m=+2362.299377277"
Sep 17 23:45:59.918267 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:59.918228    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:59.918267 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:59.918280    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:59.931417 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:59.931388    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:45:59.992036 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:59.992006    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"]
Sep 17 23:45:59.995493 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:59.995458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:45:59.997990 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:45:59.997967    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-11e42420-kserve-self-signed-certs\""
Sep 17 23:46:00.005510 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.005486    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"]
Sep 17 23:46:00.183933 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.183832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-model-cache\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.183933 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.183915    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tmp-dir\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.184135 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.183947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-dshm\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.184135 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.183975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tls-certs\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.184135 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.184099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2xgv\" (UniqueName: \"kubernetes.io/projected/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-kube-api-access-m2xgv\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.184240 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.184165    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-home\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.285017 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.284980    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tmp-dir\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.285017 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.285023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-dshm\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.285309 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.285049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tls-certs\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.285309 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.285110    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xgv\" (UniqueName: \"kubernetes.io/projected/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-kube-api-access-m2xgv\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.285309 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.285155    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-home\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.285309 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.285219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-model-cache\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.285685 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.285665    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-model-cache\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.285755 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.285719    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-home\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.285803 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.285755    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tmp-dir\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.287395 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.287375    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-dshm\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.287690 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.287672    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tls-certs\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.293007 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.292988    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2xgv\" (UniqueName: \"kubernetes.io/projected/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-kube-api-access-m2xgv\") pod \"e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") " pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.307046 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.307019    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:00.586091 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.586058    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"]
Sep 17 23:46:00.586923 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:46:00.586898    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfcabe8e_c038_4e60_afe4_d71d8fc171e9.slice/crio-3940acc9639585069de7a3a0905c1069fc85ad17fb35403db81daf6090d47ceb WatchSource:0}: Error finding container 3940acc9639585069de7a3a0905c1069fc85ad17fb35403db81daf6090d47ceb: Status 404 returned error can't find the container with id 3940acc9639585069de7a3a0905c1069fc85ad17fb35403db81daf6090d47ceb
Sep 17 23:46:00.728543 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.728506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl" event={"ID":"bfcabe8e-c038-4e60-afe4-d71d8fc171e9","Type":"ContainerStarted","Data":"a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98"}
Sep 17 23:46:00.728543 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.728553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl" event={"ID":"bfcabe8e-c038-4e60-afe4-d71d8fc171e9","Type":"ContainerStarted","Data":"3940acc9639585069de7a3a0905c1069fc85ad17fb35403db81daf6090d47ceb"}
Sep 17 23:46:00.740647 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.740609    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:46:00.747443 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:00.747392    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl" podStartSLOduration=1.747375173 podStartE2EDuration="1.747375173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:46:00.744997385 +0000 UTC m=+2372.352575060" watchObservedRunningTime="2026-09-17 23:46:00.747375173 +0000 UTC m=+2372.354952834"
Sep 17 23:46:10.307331 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:10.307288    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:10.307802 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:10.307351    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:10.320060 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:10.320030    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:10.792376 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:10.792343    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:19.107148 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:19.107111    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"]
Sep 17 23:46:20.808168 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:20.808125    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"]
Sep 17 23:46:31.213490 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:31.213438    2583 scope.go:117] "RemoveContainer" containerID="f9a04744b728cfdecdf3d8060903eb6f8eec96699b3371f95cb4864e879f7fb5"
Sep 17 23:46:31.222060 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:31.222036    2583 scope.go:117] "RemoveContainer" containerID="e9fceaeb01d9051277388866c95d3e0798adbb929ae67bd72213d10a5e7bf00e"
Sep 17 23:46:34.126882 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.126815    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h" podUID="e70b6ae1-cd2d-4bf5-90f4-68f25b443964" containerName="main" containerID="cri-o://4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec" gracePeriod=45
Sep 17 23:46:34.385668 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.385603    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:46:34.509941 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.509898    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbkrs\" (UniqueName: \"kubernetes.io/projected/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-kube-api-access-cbkrs\") pod \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") "
Sep 17 23:46:34.510152 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.509952    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-model-cache\") pod \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") "
Sep 17 23:46:34.510152 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.510048    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tmp-dir\") pod \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") "
Sep 17 23:46:34.510152 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.510076    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-dshm\") pod \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") "
Sep 17 23:46:34.510152 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.510112    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-home\") pod \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") "
Sep 17 23:46:34.510152 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.510144    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tls-certs\") pod \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\" (UID: \"e70b6ae1-cd2d-4bf5-90f4-68f25b443964\") "
Sep 17 23:46:34.510412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.510272    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-model-cache" (OuterVolumeSpecName: "model-cache") pod "e70b6ae1-cd2d-4bf5-90f4-68f25b443964" (UID: "e70b6ae1-cd2d-4bf5-90f4-68f25b443964"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:46:34.510412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.510281    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e70b6ae1-cd2d-4bf5-90f4-68f25b443964" (UID: "e70b6ae1-cd2d-4bf5-90f4-68f25b443964"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:46:34.510412 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.510358    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-home" (OuterVolumeSpecName: "home") pod "e70b6ae1-cd2d-4bf5-90f4-68f25b443964" (UID: "e70b6ae1-cd2d-4bf5-90f4-68f25b443964"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:46:34.510566 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.510517    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:34.510566 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.510532    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:34.510566 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.510542    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:34.518761 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.518714    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-kube-api-access-cbkrs" (OuterVolumeSpecName: "kube-api-access-cbkrs") pod "e70b6ae1-cd2d-4bf5-90f4-68f25b443964" (UID: "e70b6ae1-cd2d-4bf5-90f4-68f25b443964"). InnerVolumeSpecName "kube-api-access-cbkrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:46:34.519695 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.519446    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-dshm" (OuterVolumeSpecName: "dshm") pod "e70b6ae1-cd2d-4bf5-90f4-68f25b443964" (UID: "e70b6ae1-cd2d-4bf5-90f4-68f25b443964"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:46:34.519695 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.519539    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e70b6ae1-cd2d-4bf5-90f4-68f25b443964" (UID: "e70b6ae1-cd2d-4bf5-90f4-68f25b443964"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:46:34.611855 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.611818    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbkrs\" (UniqueName: \"kubernetes.io/projected/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-kube-api-access-cbkrs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:34.611855 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.611852    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:34.611855 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.611865    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e70b6ae1-cd2d-4bf5-90f4-68f25b443964-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:34.934221 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.934180    2583 generic.go:356] "Generic (PLEG): container finished" podID="e70b6ae1-cd2d-4bf5-90f4-68f25b443964" containerID="4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec" exitCode=0
Sep 17 23:46:34.934401 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.934246    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h" event={"ID":"e70b6ae1-cd2d-4bf5-90f4-68f25b443964","Type":"ContainerDied","Data":"4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec"}
Sep 17 23:46:34.934401 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.934255    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"
Sep 17 23:46:34.934401 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.934284    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h" event={"ID":"e70b6ae1-cd2d-4bf5-90f4-68f25b443964","Type":"ContainerDied","Data":"5cc807f955373de38bb61a5bb4208640dc80e0adb007a4ab5d434f8ae33cab3d"}
Sep 17 23:46:34.934401 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.934302    2583 scope.go:117] "RemoveContainer" containerID="4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec"
Sep 17 23:46:34.944610 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.944485    2583 scope.go:117] "RemoveContainer" containerID="4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec"
Sep 17 23:46:34.944930 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:46:34.944905    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec\": container with ID starting with 4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec not found: ID does not exist" containerID="4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec"
Sep 17 23:46:34.945018 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.944944    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec"} err="failed to get container status \"4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec\": rpc error: code = NotFound desc = could not find container \"4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec\": container with ID starting with 4f37179e2abdae7a5e8cffbd897d03fd8301156526b7f0eaab6b42c3679a57ec not found: ID does not exist"
Sep 17 23:46:34.958436 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.958398    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"]
Sep 17 23:46:34.960684 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:34.960661    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-11e42420-kserve-6f48dffc9-8w96h"]
Sep 17 23:46:35.828822 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:35.828781    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl" podUID="bfcabe8e-c038-4e60-afe4-d71d8fc171e9" containerName="main" containerID="cri-o://a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98" gracePeriod=45
Sep 17 23:46:36.088591 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.088529    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:36.226630 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.226596    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-home\") pod \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") "
Sep 17 23:46:36.226839 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.226646    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-model-cache\") pod \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") "
Sep 17 23:46:36.226839 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.226689    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-dshm\") pod \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") "
Sep 17 23:46:36.226839 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.226709    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2xgv\" (UniqueName: \"kubernetes.io/projected/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-kube-api-access-m2xgv\") pod \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") "
Sep 17 23:46:36.226839 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.226725    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tmp-dir\") pod \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") "
Sep 17 23:46:36.226839 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.226753    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tls-certs\") pod \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\" (UID: \"bfcabe8e-c038-4e60-afe4-d71d8fc171e9\") "
Sep 17 23:46:36.227122 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.226899    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-home" (OuterVolumeSpecName: "home") pod "bfcabe8e-c038-4e60-afe4-d71d8fc171e9" (UID: "bfcabe8e-c038-4e60-afe4-d71d8fc171e9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:46:36.227122 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.227012    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bfcabe8e-c038-4e60-afe4-d71d8fc171e9" (UID: "bfcabe8e-c038-4e60-afe4-d71d8fc171e9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:46:36.227122 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.227026    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-model-cache" (OuterVolumeSpecName: "model-cache") pod "bfcabe8e-c038-4e60-afe4-d71d8fc171e9" (UID: "bfcabe8e-c038-4e60-afe4-d71d8fc171e9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:46:36.227122 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.227106    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:36.227264 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.227127    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:36.227264 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.227143    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:36.228952 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.228917    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bfcabe8e-c038-4e60-afe4-d71d8fc171e9" (UID: "bfcabe8e-c038-4e60-afe4-d71d8fc171e9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:46:36.229051 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.228987    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-dshm" (OuterVolumeSpecName: "dshm") pod "bfcabe8e-c038-4e60-afe4-d71d8fc171e9" (UID: "bfcabe8e-c038-4e60-afe4-d71d8fc171e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:46:36.229051 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.229041    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-kube-api-access-m2xgv" (OuterVolumeSpecName: "kube-api-access-m2xgv") pod "bfcabe8e-c038-4e60-afe4-d71d8fc171e9" (UID: "bfcabe8e-c038-4e60-afe4-d71d8fc171e9"). InnerVolumeSpecName "kube-api-access-m2xgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:46:36.328418 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.328374    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:36.328418 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.328412    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2xgv\" (UniqueName: \"kubernetes.io/projected/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-kube-api-access-m2xgv\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:36.328418 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.328422    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcabe8e-c038-4e60-afe4-d71d8fc171e9-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Sep 17 23:46:36.488903 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.488822    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e70b6ae1-cd2d-4bf5-90f4-68f25b443964" path="/var/lib/kubelet/pods/e70b6ae1-cd2d-4bf5-90f4-68f25b443964/volumes"
Sep 17 23:46:36.947162 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.947125    2583 generic.go:356] "Generic (PLEG): container finished" podID="bfcabe8e-c038-4e60-afe4-d71d8fc171e9" containerID="a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98" exitCode=0
Sep 17 23:46:36.947686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.947181    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"
Sep 17 23:46:36.947686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.947217    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl" event={"ID":"bfcabe8e-c038-4e60-afe4-d71d8fc171e9","Type":"ContainerDied","Data":"a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98"}
Sep 17 23:46:36.947686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.947273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl" event={"ID":"bfcabe8e-c038-4e60-afe4-d71d8fc171e9","Type":"ContainerDied","Data":"3940acc9639585069de7a3a0905c1069fc85ad17fb35403db81daf6090d47ceb"}
Sep 17 23:46:36.947686 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.947300    2583 scope.go:117] "RemoveContainer" containerID="a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98"
Sep 17 23:46:36.959314 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.959282    2583 scope.go:117] "RemoveContainer" containerID="a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98"
Sep 17 23:46:36.959794 ip-10-0-141-215 kubenswrapper[2583]: E0917 23:46:36.959763    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98\": container with ID starting with a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98 not found: ID does not exist" containerID="a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98"
Sep 17 23:46:36.959889 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.959808    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98"} err="failed to get container status \"a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98\": rpc error: code = NotFound desc = could not find container \"a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98\": container with ID starting with a802de9e072e9e5b201cdf33d7a26d0ccecc4df1c49cc3adc3ab221504375c98 not found: ID does not exist"
Sep 17 23:46:36.963953 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.963928    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"]
Sep 17 23:46:36.966448 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:36.966420    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-11e42420-kserve-6b476cd67-vkhdl"]
Sep 17 23:46:38.487294 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:46:38.487260    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfcabe8e-c038-4e60-afe4-d71d8fc171e9" path="/var/lib/kubelet/pods/bfcabe8e-c038-4e60-afe4-d71d8fc171e9/volumes"
Sep 17 23:47:06.341557 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:06.341445    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69c94896d7-d4tm6_284cf396-1b72-42c5-bef1-464759f6c03e/authorino/0.log"
Sep 17 23:47:11.832153 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:11.832117    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-947db468d-2z9k2_a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d/manager/0.log"
Sep 17 23:47:11.939595 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:11.939565    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-b8k4c_0f521c7c-052d-4fcc-9c4f-1df22dec4c1f/server/0.log"
Sep 17 23:47:12.052343 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:12.052315    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ck4x6_7373726b-f018-450f-a0b7-71872699add1/manager/0.log"
Sep 17 23:47:12.276660 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:12.276633    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697bb5576d-qg2sc_4d2a578b-75a8-4d85-9f3d-ab426aa0f042/copy-manifests/0.log"
Sep 17 23:47:12.282868 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:12.282832    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697bb5576d-qg2sc_4d2a578b-75a8-4d85-9f3d-ab426aa0f042/manager/0.log"
Sep 17 23:47:12.963515 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:12.963459    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29828130-mpbx8_38dc6de1-28d4-456b-88f6-92dc49848dd2/cleanup/0.log"
Sep 17 23:47:13.930790 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:13.930726    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69c94896d7-d4tm6_284cf396-1b72-42c5-bef1-464759f6c03e/authorino/0.log"
Sep 17 23:47:14.965124 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:14.965085    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cfh66k_16f1c993-a5a4-47d3-9a7c-565cf167728b/istio-proxy/0.log"
Sep 17 23:47:15.075808 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:15.075759    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lvldr_911ce07f-395f-477b-ac20-7f2f4bd9071d/discovery/0.log"
Sep 17 23:47:15.401493 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:15.401446    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dxbq6_fba4e5c7-faa0-488c-9a1f-b5389723627f/istio-proxy/1.log"
Sep 17 23:47:15.516171 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:15.516121    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4gbbx_2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9/payload-pre-processing/0.log"
Sep 17 23:47:16.073717 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:16.073691    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vndh4_620ac619-b4d7-4804-8c59-941e27bb7c42/main/0.log"
Sep 17 23:47:22.436121 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.436083    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7zwb4/must-gather-fzqtl"]
Sep 17 23:47:22.436525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.436440    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e70b6ae1-cd2d-4bf5-90f4-68f25b443964" containerName="main"
Sep 17 23:47:22.436525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.436451    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e70b6ae1-cd2d-4bf5-90f4-68f25b443964" containerName="main"
Sep 17 23:47:22.436525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.436496    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfcabe8e-c038-4e60-afe4-d71d8fc171e9" containerName="main"
Sep 17 23:47:22.436525 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.436502    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfcabe8e-c038-4e60-afe4-d71d8fc171e9" containerName="main"
Sep 17 23:47:22.436661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.436556    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfcabe8e-c038-4e60-afe4-d71d8fc171e9" containerName="main"
Sep 17 23:47:22.436661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.436565    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e70b6ae1-cd2d-4bf5-90f4-68f25b443964" containerName="main"
Sep 17 23:47:22.439882 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.439862    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7zwb4/must-gather-fzqtl"
Sep 17 23:47:22.442326 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.442306    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7zwb4\"/\"kube-root-ca.crt\""
Sep 17 23:47:22.443227 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.443208    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7zwb4\"/\"default-dockercfg-xtqbw\""
Sep 17 23:47:22.443227 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.443215    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7zwb4\"/\"openshift-service-ca.crt\""
Sep 17 23:47:22.448661 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.448634    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7zwb4/must-gather-fzqtl"]
Sep 17 23:47:22.546626 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.546581    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ss8t\" (UniqueName: \"kubernetes.io/projected/9d9167e8-908f-4b0c-b156-dab5b9cde5be-kube-api-access-5ss8t\") pod \"must-gather-fzqtl\" (UID: \"9d9167e8-908f-4b0c-b156-dab5b9cde5be\") " pod="openshift-must-gather-7zwb4/must-gather-fzqtl"
Sep 17 23:47:22.546831 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.546693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d9167e8-908f-4b0c-b156-dab5b9cde5be-must-gather-output\") pod \"must-gather-fzqtl\" (UID: \"9d9167e8-908f-4b0c-b156-dab5b9cde5be\") " pod="openshift-must-gather-7zwb4/must-gather-fzqtl"
Sep 17 23:47:22.647779 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.647738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d9167e8-908f-4b0c-b156-dab5b9cde5be-must-gather-output\") pod \"must-gather-fzqtl\" (UID: \"9d9167e8-908f-4b0c-b156-dab5b9cde5be\") " pod="openshift-must-gather-7zwb4/must-gather-fzqtl"
Sep 17 23:47:22.647991 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.647878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ss8t\" (UniqueName: \"kubernetes.io/projected/9d9167e8-908f-4b0c-b156-dab5b9cde5be-kube-api-access-5ss8t\") pod \"must-gather-fzqtl\" (UID: \"9d9167e8-908f-4b0c-b156-dab5b9cde5be\") " pod="openshift-must-gather-7zwb4/must-gather-fzqtl"
Sep 17 23:47:22.648201 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.648177    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d9167e8-908f-4b0c-b156-dab5b9cde5be-must-gather-output\") pod \"must-gather-fzqtl\" (UID: \"9d9167e8-908f-4b0c-b156-dab5b9cde5be\") " pod="openshift-must-gather-7zwb4/must-gather-fzqtl"
Sep 17 23:47:22.655655 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.655629    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ss8t\" (UniqueName: \"kubernetes.io/projected/9d9167e8-908f-4b0c-b156-dab5b9cde5be-kube-api-access-5ss8t\") pod \"must-gather-fzqtl\" (UID: \"9d9167e8-908f-4b0c-b156-dab5b9cde5be\") " pod="openshift-must-gather-7zwb4/must-gather-fzqtl"
Sep 17 23:47:22.750612 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:22.750525    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7zwb4/must-gather-fzqtl"
Sep 17 23:47:23.028642 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:23.028609    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7zwb4/must-gather-fzqtl"]
Sep 17 23:47:23.030272 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:47:23.030242    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d9167e8_908f_4b0c_b156_dab5b9cde5be.slice/crio-05427483b68989fdbf6b6671c1e7f163cb4b8a63f6bcc345e91a3abdfe575982 WatchSource:0}: Error finding container 05427483b68989fdbf6b6671c1e7f163cb4b8a63f6bcc345e91a3abdfe575982: Status 404 returned error can't find the container with id 05427483b68989fdbf6b6671c1e7f163cb4b8a63f6bcc345e91a3abdfe575982
Sep 17 23:47:23.032188 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:23.032168    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:47:23.203280 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:23.203244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zwb4/must-gather-fzqtl" event={"ID":"9d9167e8-908f-4b0c-b156-dab5b9cde5be","Type":"ContainerStarted","Data":"05427483b68989fdbf6b6671c1e7f163cb4b8a63f6bcc345e91a3abdfe575982"}
Sep 17 23:47:24.211801 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:24.211763    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zwb4/must-gather-fzqtl" event={"ID":"9d9167e8-908f-4b0c-b156-dab5b9cde5be","Type":"ContainerStarted","Data":"d709971ad1ccdc87b4c55e9f64edf248e0550d17260d25894185ab565752d9e0"}
Sep 17 23:47:24.212298 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:24.211810    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zwb4/must-gather-fzqtl" event={"ID":"9d9167e8-908f-4b0c-b156-dab5b9cde5be","Type":"ContainerStarted","Data":"2a256c2f08666fa1866562565f8a7d0366b72c5971c47537aa77d853619298c7"}
Sep 17 23:47:24.229393 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:24.229341    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7zwb4/must-gather-fzqtl" podStartSLOduration=1.529481302 podStartE2EDuration="2.229323363s" totalImagesPullingTime="699.842061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:47:24.227748436 +0000 UTC m=+2455.835326096" watchObservedRunningTime="2026-09-17 23:47:24.229323363 +0000 UTC m=+2455.836901023"
Sep 17 23:47:25.327701 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:25.327660    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fvjmj_1fdc998a-15cc-4e00-97ee-00c1b11db4cc/global-pull-secret-syncer/0.log"
Sep 17 23:47:25.487039 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:25.487006    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qw68s_5c0da294-f659-4e57-9cb2-268d978041c7/konnectivity-agent/0.log"
Sep 17 23:47:25.554998 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:25.554970    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-215.ec2.internal_e2a8d187de3034f51c9752cc1f41717d/haproxy/0.log"
Sep 17 23:47:30.331515 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:30.330752    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69c94896d7-d4tm6_284cf396-1b72-42c5-bef1-464759f6c03e/authorino/0.log"
Sep 17 23:47:31.247898 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:31.247855    2583 scope.go:117] "RemoveContainer" containerID="24810e7fbe21a4c8ad525981a52e6cd85fae429c2d38c5b4677a2567bfdea25d"
Sep 17 23:47:32.086533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.086497    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d5dd618-059b-48fc-a7eb-1a6a395e6c66/alertmanager/0.log"
Sep 17 23:47:32.106514 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.106426    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d5dd618-059b-48fc-a7eb-1a6a395e6c66/config-reloader/0.log"
Sep 17 23:47:32.127533 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.127504    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d5dd618-059b-48fc-a7eb-1a6a395e6c66/kube-rbac-proxy-web/0.log"
Sep 17 23:47:32.151093 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.151042    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d5dd618-059b-48fc-a7eb-1a6a395e6c66/kube-rbac-proxy/0.log"
Sep 17 23:47:32.170947 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.170900    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d5dd618-059b-48fc-a7eb-1a6a395e6c66/kube-rbac-proxy-metric/0.log"
Sep 17 23:47:32.191107 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.191075    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d5dd618-059b-48fc-a7eb-1a6a395e6c66/prom-label-proxy/0.log"
Sep 17 23:47:32.218482 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.218434    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d5dd618-059b-48fc-a7eb-1a6a395e6c66/init-config-reloader/0.log"
Sep 17 23:47:32.373396 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.373299    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f799df98b-zs8dn_0d4ae492-1746-4b88-967a-00a962f8e882/metrics-server/0.log"
Sep 17 23:47:32.398791 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.398756    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-trd7x_3053540d-c330-41b6-b57a-a08764748750/monitoring-plugin/0.log"
Sep 17 23:47:32.591281 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.591243    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrvdw_540fd8e7-7f54-45ad-9aa3-22086030929c/node-exporter/0.log"
Sep 17 23:47:32.617942 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.617585    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrvdw_540fd8e7-7f54-45ad-9aa3-22086030929c/kube-rbac-proxy/0.log"
Sep 17 23:47:32.645329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:32.644381    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrvdw_540fd8e7-7f54-45ad-9aa3-22086030929c/init-textfile/0.log"
Sep 17 23:47:33.004077 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:33.003994    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f785bf9cb-nf4rh_f8304a79-061a-454f-8aa6-f25217cf8ca1/telemeter-client/0.log"
Sep 17 23:47:33.028012 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:33.027979    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f785bf9cb-nf4rh_f8304a79-061a-454f-8aa6-f25217cf8ca1/reload/0.log"
Sep 17 23:47:33.047876 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:33.047843    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f785bf9cb-nf4rh_f8304a79-061a-454f-8aa6-f25217cf8ca1/kube-rbac-proxy/0.log"
Sep 17 23:47:35.923329 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:35.923271    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"]
Sep 17 23:47:35.928975 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:35.928937    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:35.937541 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:35.937507    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"]
Sep 17 23:47:35.996221 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:35.996183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-sys\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:35.996421 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:35.996306    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-podres\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:35.996421 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:35.996348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-proc\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:35.996421 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:35.996373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q88sd\" (UniqueName: \"kubernetes.io/projected/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-kube-api-access-q88sd\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:35.996421 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:35.996401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-lib-modules\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.097548 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.097509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-sys\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.097814 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.097605    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-sys\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.097905 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.097787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-podres\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.097905 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.097862    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-proc\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.097905 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.097889    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88sd\" (UniqueName: \"kubernetes.io/projected/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-kube-api-access-q88sd\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.098052 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.097904    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-podres\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.098052 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.097909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-lib-modules\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.098052 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.097984    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-proc\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.098052 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.098005    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-lib-modules\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.108554 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.108519    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q88sd\" (UniqueName: \"kubernetes.io/projected/ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c-kube-api-access-q88sd\") pod \"perf-node-gather-daemonset-wwqv8\" (UID: \"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c\") " pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.244585 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.244484    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:36.553328 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:36.553295    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"]
Sep 17 23:47:36.560321 ip-10-0-141-215 kubenswrapper[2583]: W0917 23:47:36.557614    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podccc9fa2f_4b42_459b_bfd0_3e0fa8b8df7c.slice/crio-b2561bd8627e76c4da9a6ede04c3f29a88ce6af0d3288c549d8d8ff58861d837 WatchSource:0}: Error finding container b2561bd8627e76c4da9a6ede04c3f29a88ce6af0d3288c549d8d8ff58861d837: Status 404 returned error can't find the container with id b2561bd8627e76c4da9a6ede04c3f29a88ce6af0d3288c549d8d8ff58861d837
Sep 17 23:47:37.332864 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:37.332454    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8" event={"ID":"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c","Type":"ContainerStarted","Data":"937d35d16ff93e4e6702872cdd837a87f2ba9c879acc8c06c7206b37d64d328c"}
Sep 17 23:47:37.332864 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:37.332545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8" event={"ID":"ccc9fa2f-4b42-459b-bfd0-3e0fa8b8df7c","Type":"ContainerStarted","Data":"b2561bd8627e76c4da9a6ede04c3f29a88ce6af0d3288c549d8d8ff58861d837"}
Sep 17 23:47:37.332864 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:37.332590    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:37.350554 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:37.350482    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8" podStartSLOduration=2.35044195 podStartE2EDuration="2.35044195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:47:37.349237522 +0000 UTC m=+2468.956815184" watchObservedRunningTime="2026-09-17 23:47:37.35044195 +0000 UTC m=+2468.958019610"
Sep 17 23:47:37.946028 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:37.945999    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kc4rm_c65c0f93-4f14-4f0b-ae04-1d98e2b19218/dns/0.log"
Sep 17 23:47:37.964357 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:37.964330    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kc4rm_c65c0f93-4f14-4f0b-ae04-1d98e2b19218/kube-rbac-proxy/0.log"
Sep 17 23:47:38.030603 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:38.030578    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wzlbb_814e2509-d1b2-4c9b-81b7-b17e1af94e4a/dns-node-resolver/0.log"
Sep 17 23:47:38.566256 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:38.566222    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68999896c6-2gpfj_3e209bab-865b-4e8b-bc43-c7b459f5c153/registry/0.log"
Sep 17 23:47:38.629080 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:38.629050    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-skqrh_b01c722e-6626-4a46-a68d-b516de659640/node-ca/0.log"
Sep 17 23:47:39.508344 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:39.508313    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cfh66k_16f1c993-a5a4-47d3-9a7c-565cf167728b/istio-proxy/0.log"
Sep 17 23:47:40.072808 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:40.072772    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lvldr_911ce07f-395f-477b-ac20-7f2f4bd9071d/discovery/0.log"
Sep 17 23:47:40.144418 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:40.144382    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dxbq6_fba4e5c7-faa0-488c-9a1f-b5389723627f/istio-proxy/0.log"
Sep 17 23:47:40.148200 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:40.148170    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dxbq6_fba4e5c7-faa0-488c-9a1f-b5389723627f/istio-proxy/1.log"
Sep 17 23:47:40.183024 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:40.182989    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4gbbx_2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9/payload-pre-processing/0.log"
Sep 17 23:47:41.143646 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:41.143617    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n6wf4_b36fa738-3ce2-456b-8438-ec19a3437076/serve-healthcheck-canary/0.log"
Sep 17 23:47:41.666624 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:41.666589    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2knf6_9164ecbe-d161-4e2c-b635-3d9e762b9bb3/kube-rbac-proxy/0.log"
Sep 17 23:47:41.686340 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:41.686299    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2knf6_9164ecbe-d161-4e2c-b635-3d9e762b9bb3/exporter/0.log"
Sep 17 23:47:41.707413 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:41.707380    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2knf6_9164ecbe-d161-4e2c-b635-3d9e762b9bb3/extractor/0.log"
Sep 17 23:47:43.356692 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:43.356660    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7zwb4/perf-node-gather-daemonset-wwqv8"
Sep 17 23:47:44.417243 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:44.417206    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-947db468d-2z9k2_a65f5c34-1fcd-47bb-ab78-04a2e37ebf2d/manager/0.log"
Sep 17 23:47:44.441447 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:44.441415    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-b8k4c_0f521c7c-052d-4fcc-9c4f-1df22dec4c1f/server/0.log"
Sep 17 23:47:44.560182 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:44.560149    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ck4x6_7373726b-f018-450f-a0b7-71872699add1/manager/0.log"
Sep 17 23:47:44.635738 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:44.635706    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697bb5576d-qg2sc_4d2a578b-75a8-4d85-9f3d-ab426aa0f042/manager/0.log"
Sep 17 23:47:44.656446 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:44.656415    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697bb5576d-qg2sc_4d2a578b-75a8-4d85-9f3d-ab426aa0f042/copy-manifests/0.log"
Sep 17 23:47:46.243072 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:46.243040    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-858688bfcc-fznkh_21c8cb0d-e28f-4cc4-9d4c-4b4b66fe9b07/manager/0.log"
Sep 17 23:47:46.634403 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:46.634349    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cfh66k_16f1c993-a5a4-47d3-9a7c-565cf167728b/istio-proxy/0.log"
Sep 17 23:47:47.201492 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:47.200899    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lvldr_911ce07f-395f-477b-ac20-7f2f4bd9071d/discovery/0.log"
Sep 17 23:47:47.251003 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:47.250973    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dxbq6_fba4e5c7-faa0-488c-9a1f-b5389723627f/istio-proxy/0.log"
Sep 17 23:47:47.255609 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:47.255586    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dxbq6_fba4e5c7-faa0-488c-9a1f-b5389723627f/istio-proxy/1.log"
Sep 17 23:47:47.288312 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:47.288278    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4gbbx_2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9/payload-pre-processing/0.log"
Sep 17 23:47:48.868713 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:48.868683    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cfh66k_16f1c993-a5a4-47d3-9a7c-565cf167728b/istio-proxy/0.log"
Sep 17 23:47:49.469874 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:49.469843    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lvldr_911ce07f-395f-477b-ac20-7f2f4bd9071d/discovery/0.log"
Sep 17 23:47:49.529226 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:49.529198    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dxbq6_fba4e5c7-faa0-488c-9a1f-b5389723627f/istio-proxy/0.log"
Sep 17 23:47:49.533416 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:49.533388    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dxbq6_fba4e5c7-faa0-488c-9a1f-b5389723627f/istio-proxy/1.log"
Sep 17 23:47:49.567278 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:49.567233    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4gbbx_2a90f0ba-f4e4-4e3e-85ab-526ce3daa4e9/payload-pre-processing/0.log"
Sep 17 23:47:53.069375 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:53.069346    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h42tf_ad763c95-3505-4748-93ff-ab0a41ee8763/kube-multus-additional-cni-plugins/0.log"
Sep 17 23:47:53.090145 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:53.090115    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h42tf_ad763c95-3505-4748-93ff-ab0a41ee8763/egress-router-binary-copy/0.log"
Sep 17 23:47:53.110099 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:53.110071    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h42tf_ad763c95-3505-4748-93ff-ab0a41ee8763/cni-plugins/0.log"
Sep 17 23:47:53.130189 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:53.130165    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h42tf_ad763c95-3505-4748-93ff-ab0a41ee8763/bond-cni-plugin/0.log"
Sep 17 23:47:53.150558 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:53.150529    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h42tf_ad763c95-3505-4748-93ff-ab0a41ee8763/routeoverride-cni/0.log"
Sep 17 23:47:53.170945 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:53.170910    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h42tf_ad763c95-3505-4748-93ff-ab0a41ee8763/whereabouts-cni-bincopy/0.log"
Sep 17 23:47:53.191159 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:53.191135    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h42tf_ad763c95-3505-4748-93ff-ab0a41ee8763/whereabouts-cni/0.log"
Sep 17 23:47:53.416932 ip-10-0-141-215 kubenswrapper[2583]: I0917 23:47:53.416900    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkdzw_225dc1ab-4b0f-4e5d-be4c-06637e77be24/kube-multus/0.log"