Sep 11 19:16:12.969897 ip-10-0-138-5 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 19:16:12.969909 ip-10-0-138-5 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 19:16:12.969916 ip-10-0-138-5 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 19:16:12.970090 ip-10-0-138-5 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 19:16:23.192962 ip-10-0-138-5 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 19:16:23.192984 ip-10-0-138-5 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ee46d265bd8942179dab6a179a93e618 --
Sep 11 19:18:18.177743 ip-10-0-138-5 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 19:18:18.545408 ip-10-0-138-5 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:18:18.545408 ip-10-0-138-5 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 19:18:18.545408 ip-10-0-138-5 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:18:18.545408 ip-10-0-138-5 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 19:18:18.545408 ip-10-0-138-5 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:18:18.546785 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.546698    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 19:18:18.549398 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549382    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:18:18.549398 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549398    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549402    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549405    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549408    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549416    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549419    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549435    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549438    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549441    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549444    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549447    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549449    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549452    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549455    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549457    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549460    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549463    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549465    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549468    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:18:18.549483 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549471    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549473    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549476    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549478    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549481    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549483    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549486    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549489    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549491    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549494    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549497    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549500    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549502    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549505    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549509    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549513    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549517    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549520    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549524    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549526    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:18:18.549946 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549529    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549532    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549534    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549537    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549540    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549542    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549545    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549548    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549552    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549555    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549557    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549560    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549563    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549565    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549569    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549572    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549574    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549577    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549580    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549582    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:18:18.550450 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549585    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549587    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549590    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549593    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549595    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549598    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549600    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549603    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549605    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549607    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549610    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549613    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549615    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549618    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549620    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549624    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549626    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549629    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549631    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549633    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:18:18.550940 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549636    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549638    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549641    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549643    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549646    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549648    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549652    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549655    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549657    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549660    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549662    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549665    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549667    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549670    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549672    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549675    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549677    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549680    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.549683    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:18:18.551451 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550347    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550355    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550358    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550361    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550364    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550367    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550370    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550372    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550376    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550380    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550384    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550386    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550390    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550393    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550396    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550399    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550401    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550404    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550406    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550410    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:18:18.551970 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550413    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550416    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550419    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550436    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550439    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550442    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550445    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550447    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550450    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550453    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550456    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550458    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550461    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550465    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550468    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550470    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550474    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550477    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550481    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:18:18.552479 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550484    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550487    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550489    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550492    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550494    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550497    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550499    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550502    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550504    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550507    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550509    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550512    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550515    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550518    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550521    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550524    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550526    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550529    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550532    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550534    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:18:18.552958 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550537    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550540    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550544    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550547    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550550    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550554    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550557    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550560    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550562    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550565    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550567    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550570    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550573    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550575    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550578    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550580    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550582    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550585    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550587    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:18:18.553473 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550590    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550593    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550595    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550598    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550600    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550604    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550606    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550609    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550612    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550614    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550617    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550620    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550622    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550624    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550627    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550629    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550632    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550634    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550637    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550639    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:18:18.553944 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.550642    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551010    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551015    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551018    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551020    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551028    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551031    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551034    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551037    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551039    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551042    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551044    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551047    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551049    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551052    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551055    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551058    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551061    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551064    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:18:18.554457 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551067    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551069    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551072    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551075    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551077    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551080    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551082    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551085    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551087    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551090    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551092    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551095    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551097    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551100    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551102    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551105    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551107    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551110    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551112    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551120    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:18:18.554913 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551123    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551127    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551129    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551132    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551134    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551137    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551139    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551141    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551144    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551146    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551149    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551153    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551156    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551160    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551163    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551165    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551168    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551170    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551172    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551175    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:18:18.555400 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551177    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551180    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551182    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551184    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551187    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551189    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551192    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551194    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551196    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551199    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551201    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551204    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551212    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551215    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551217    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551222    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551226    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551228    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551231    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551234    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:18:18.555903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551237    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551239    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551242    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551245    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551247    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551250    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551252    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551255    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551257    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551261    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551265    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551267    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551270    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551273    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551276    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551279    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551281    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551284    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551287    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:18:18.556449 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551289    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.551292    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551368    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551410    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551437    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551442    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551456    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551460    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551464    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551468    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551471    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551474    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551477    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551481    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551484    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551487    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551489    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551492    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551495    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551498    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551511    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551513    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551517    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551520    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 19:18:18.556923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551523    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551527    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551530    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551533    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551536    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551539    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551542    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551545    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551548    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551551    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551554    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551557    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551560    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551563    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551567    2580 flags.go:64] FLAG: --enable-server="true"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551576    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551583    2580 flags.go:64] FLAG: --event-burst="100"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551586    2580 flags.go:64] FLAG: --event-qps="50"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551589    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551592    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551595    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551599    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551602    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551605    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551608    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 11 19:18:18.557649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551610    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551620    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551623    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551626    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551630    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551632    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551635    2580 flags.go:64] FLAG: --feature-gates=""
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551639    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551642    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551645    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551648    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551651    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551654    2580 flags.go:64] FLAG: --help="false"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551657    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-138-5.ec2.internal"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551660    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551663    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551665    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551669    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551672    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551675    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551678    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551683    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551686    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 19:18:18.558299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551696    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551699    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551702    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551705    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551708    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551711    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551714    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551717    2580 flags.go:64] FLAG: --lock-file=""
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551719    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551722    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551725    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551730    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551733    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551736    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551739    2580 flags.go:64] FLAG: --logging-format="text"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551742    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551745    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551748    2580 flags.go:64] FLAG: --manifest-url=""
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551751    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551755    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551757    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551762    2580 flags.go:64] FLAG: --max-pods="110"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551764    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551767    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551770    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 19:18:18.558980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551773    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551776    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551779    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551782    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551789    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551794    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551797    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551801    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551810    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551815    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551818    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551821    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551824    2580 flags.go:64] FLAG: --port="10250"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551827    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551830    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bcedd3bcf06a2a40"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551833    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551836    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551839    2580 flags.go:64] FLAG: --register-node="true"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551842    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551845    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551848    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551851    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551854    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551857    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551860    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 19:18:18.559696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551863    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551866    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551869    2580 flags.go:64] FLAG: --runonce="false"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551872    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551875    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551878    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551880    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551883    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551886    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551889    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551892    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551895    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551899    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551903    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551906    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551909    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551918    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551921    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551927    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551929    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551932    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551939    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551942    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551944    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551947    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 19:18:18.560444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551950    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551953    2580 flags.go:64] FLAG: --v="2"
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551957    2580 flags.go:64] FLAG: --version="false"
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551961    2580 flags.go:64] FLAG: --vmodule=""
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551964    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.551967    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552109    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552113    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552117    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552120    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552123    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552126    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552130    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552135    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552139    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552144    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552147    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552150    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552152    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552156    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552161    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:18:18.561142 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552163    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552166    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552168    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552177    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552180    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552182    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552185    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552187    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552191    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552193    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552196    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552198    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552201    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552203    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552206    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552209    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552211    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552214    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552216    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552219    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:18:18.561757 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552221    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552224    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552226    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552229    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552232    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552234    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552236    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552239    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552242    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552244    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552248    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552254    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552258    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552261    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552263    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552266    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552275    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552278    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552281    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:18:18.562310 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552284    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552287    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552289    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552292    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552294    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552297    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552299    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552302    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552305    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552308    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552312    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552315    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552318    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552320    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552322    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552325    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552328    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552330    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552333    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:18:18.562818 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552335    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552338    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552340    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552343    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552347    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552351    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552353    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552356    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552359    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552361    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552364    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552372    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552375    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552377    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552380    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552383    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552385    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552388    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552390    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552394    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:18:18.563294 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552397    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552400    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552403    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552405    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552408    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.552411    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.552880    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.560034    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.560048    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.560061    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.560066    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560127    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560132    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560135    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560139    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:18:18.563877 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560142    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560146    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560149    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560152    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560155    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560158    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560161    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560164    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560173    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560176    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560179    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560182    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560184    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560188    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560193    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560196    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560199    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560202    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560204    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:18:18.564499 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560207    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560209    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560212    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560215    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560217    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560220    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560222    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560230    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560233    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560235    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560238    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560240    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560243    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560245    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560248    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560251    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560253    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560256    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560259    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560261    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:18:18.565004 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560264    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560266    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560274    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560278    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560280    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560283    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560285    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560288    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560291    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560295    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560299    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560302    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560304    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560307    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560310    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560313    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560316    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560318    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560321    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:18:18.565615 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560324    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560326    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560329    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560331    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560334    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560337    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560339    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560342    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560344    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560347    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560350    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560352    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560355    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560357    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560360    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560362    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560370    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560373    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560376    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560378    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:18:18.566295 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560381    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560383    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560386    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560388    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560390    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560393    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560396    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560398    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560400    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560403    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560407    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560410    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560413    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560416    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560419    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560437    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:18:18.566997 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560441    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.560446    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560600    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560605    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560609    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560612    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560615    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560618    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560621    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560623    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560626    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560629    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560631    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560641    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560644    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:18:18.567396 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560647    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560649    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560652    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560655    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560657    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560660    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560662    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560665    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560667    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560670    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560673    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560675    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560678    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560680    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560683    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560685    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560687    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560690    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560693    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560695    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:18:18.567862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560698    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560701    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560704    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560707    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560709    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560712    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560714    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560718    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560722    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560725    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560727    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560736    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560738    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560741    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560743    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560746    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560748    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560751    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560753    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:18:18.568371 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560756    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560758    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560761    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560763    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560766    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560768    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560771    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560773    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560776    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560778    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560781    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560784    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560788    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560791    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560794    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560796    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560799    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560801    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560804    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:18:18.568912 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560807    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560809    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560812    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560814    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560817    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560819    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560828    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560832    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560834    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560837    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560840    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560842    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560845    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560848    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560850    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560853    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560855    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560859    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560862    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560865    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:18:18.569368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560867    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560870    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560872    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560875    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560877    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560880    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560882    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:18.560885    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.560890    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.561035    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.563007    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.563747    2580 server.go:1019] "Starting client certificate rotation"
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.563873    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 19:18:18.569873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.563931    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 19:18:18.570201 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.568829    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 19:18:18.573238 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.573222    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 19:18:18.582952 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.582933    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 11 19:18:18.587006 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.586988    2580 log.go:25] "Validated CRI v1 image API"
Sep 11 19:18:18.588240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.588221    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 19:18:18.591058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.591031    2580 fs.go:135] Filesystem UUIDs: map[50ffd5ff-de60-4868-8176-c1be807608a1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8efaa556-a939-4cae-8497-cf7aff72b11d:/dev/nvme0n1p3]
Sep 11 19:18:18.591139 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.591057    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 19:18:18.596237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.596128    2580 manager.go:216] Machine: {Timestamp:2026-09-11 19:18:18.595082187 +0000 UTC m=+0.310145140 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100293 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f03cbcedafc1896058bd13b9bd7c SystemUUID:ec20f03c-bced-afc1-8960-58bd13b9bd7c BootID:ee46d265-bd89-4217-9dab-6a179a93e618 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f5:4d:ec:b8:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f5:4d:ec:b8:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:ac:af:45:a9:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 19:18:18.596237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.596224    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 19:18:18.596361 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.596298    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 19:18:18.596403 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.596360    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 19:18:18.597269 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.597244    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 19:18:18.597414 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.597272    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-5.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 19:18:18.598517 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.598506    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 19:18:18.598517 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.598519    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 19:18:18.598598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.598527    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 19:18:18.599205 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.599195    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 19:18:18.600168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.600157    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 19:18:18.602870 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.602858    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 19:18:18.602980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.602970    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 19:18:18.603018 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.602999    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 19:18:18.603018 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.603012    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 19:18:18.603073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.603023    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 19:18:18.603073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.603033    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 11 19:18:18.603073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.603042    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 19:18:18.603383 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.603373    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 19:18:18.603435 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.603391    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 19:18:18.605391 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.605375    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 19:18:18.608589 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.608567    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 19:18:18.608668 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.608604    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 19:18:18.611119 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.611088    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 19:18:18.611119 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611094    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 19:18:18.611267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611164    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 19:18:18.611267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611175    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 19:18:18.611267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611185    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 19:18:18.611267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611199    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 19:18:18.611267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611207    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 19:18:18.611267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611226    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 19:18:18.611267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611235    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 19:18:18.611267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611246    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 19:18:18.611267 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.611089    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 19:18:18.611267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611254    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 19:18:18.611609 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611281    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 19:18:18.611609 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611289    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 19:18:18.611609 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611315    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 19:18:18.611609 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.611322    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 19:18:18.614490 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.614473    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-5.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 19:18:18.614862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.614850    2580 server.go:1268] "Started kubelet"
Sep 11 19:18:18.614956 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.614926    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 19:18:18.615531 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.615483    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 19:18:18.615624 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.615554    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 19:18:18.615974 ip-10-0-138-5 systemd[1]: Started Kubernetes Kubelet.
Sep 11 19:18:18.617009 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.616056    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 19:18:18.617009 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.616570    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 19:18:18.618827 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.618803    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 19:18:18.619858 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.619841    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g8vhg"
Sep 11 19:18:18.622164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.622144    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 19:18:18.622296 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.621485    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-5.ec2.internal.18d45a5af14cbbce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-5.ec2.internal,UID:ip-10-0-138-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-5.ec2.internal,},FirstTimestamp:2026-09-11 19:18:18.614823886 +0000 UTC m=+0.329886820,LastTimestamp:2026-09-11 19:18:18.614823886 +0000 UTC m=+0.329886820,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-5.ec2.internal,}"
Sep 11 19:18:18.622884 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.622868    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 19:18:18.623147 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.623028    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:18.623547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.623530    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 19:18:18.623547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.623527    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 19:18:18.623703 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.623560    2580 factory.go:55] Registering systemd factory
Sep 11 19:18:18.623703 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.623575    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 11 19:18:18.623703 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.623562    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 19:18:18.623837 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.623822    2580 factory.go:153] Registering CRI-O factory
Sep 11 19:18:18.623837 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.623834    2580 factory.go:223] Registration of the crio container factory successfully
Sep 11 19:18:18.623919 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.623887    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 19:18:18.623919 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.623907    2580 factory.go:103] Registering Raw factory
Sep 11 19:18:18.623919 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.623919    2580 manager.go:1196] Started watching for new ooms in manager
Sep 11 19:18:18.624228 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.624217    2580 manager.go:349] Starting recovery of all containers
Sep 11 19:18:18.624521 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.624506    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 19:18:18.624521 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.624519    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 19:18:18.625578 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.625555    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g8vhg"
Sep 11 19:18:18.627176 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.627146    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 19:18:18.627285 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.627265    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 19:18:18.633750 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.633734    2580 manager.go:354] Recovery completed
Sep 11 19:18:18.641116 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.641097    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:18:18.644157 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.644137    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:18:18.644221 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.644178    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:18:18.644221 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.644196    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:18:18.644978 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.644841    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 19:18:18.644978 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.644979    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 19:18:18.645099 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.644994    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 19:18:18.645485 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.644882    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:18:18.646217 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.646202    2580 policy_none.go:49] "None policy: Start"
Sep 11 19:18:18.646278 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.646222    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 19:18:18.646278 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.646235    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 19:18:18.646554 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.646540    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:18:18.646604 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.646567    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:18:18.646604 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.646578    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:18:18.647271 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.647260    2580 policy_none.go:47] "Start"
Sep 11 19:18:18.671068 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.671051    2580 manager.go:337] "Starting Device Plugin manager"
Sep 11 19:18:18.671141 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.671092    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 19:18:18.671141 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.671104    2580 server.go:87] "Starting device plugin registration server"
Sep 11 19:18:18.671340 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.671326    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 19:18:18.671395 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.671341    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 19:18:18.671586 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.671572    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 19:18:18.671678 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.671646    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 19:18:18.671678 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.671654    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 19:18:18.672323 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.672283    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 19:18:18.672405 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.672338    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:18.747188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.747158    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 19:18:18.748409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.748387    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 19:18:18.748544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.748447    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 19:18:18.748544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.748474    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 19:18:18.748649 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.748560    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 19:18:18.750874 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.750856    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:18:18.771869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.771846    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:18:18.777949 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.777925    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:18:18.778030 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.777954    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:18:18.778030 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.777965    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:18:18.778030 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.777987    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-5.ec2.internal"
Sep 11 19:18:18.789083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.789068    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-5.ec2.internal"
Sep 11 19:18:18.789131 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.789090    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-5.ec2.internal\": node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:18.806558 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.806492    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:18.849360 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.849326    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"]
Sep 11 19:18:18.849466 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.849404    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:18:18.850902 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.850887    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:18:18.850976 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.850914    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:18:18.850976 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.850923    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:18:18.852247 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.852233    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:18:18.852381 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.852367    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:18.852448 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.852399    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:18:18.852982 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.852967    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:18:18.853035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.853006    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:18:18.853035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.853017    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:18:18.853095 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.853031    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:18:18.853095 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.853056    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:18:18.853095 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.853069    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:18:18.854171 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.854158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:18.854222 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.854181    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:18:18.856265 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.856247    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:18:18.856326 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.856286    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:18:18.856326 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.856303    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:18:18.877054 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.877035    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-5.ec2.internal\" not found" node="ip-10-0-138-5.ec2.internal"
Sep 11 19:18:18.881414 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.881401    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-5.ec2.internal\" not found" node="ip-10-0-138-5.ec2.internal"
Sep 11 19:18:18.907467 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:18.907422    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:18.925787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.925769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/051181072184f05a76ee6ab6a4d689fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"051181072184f05a76ee6ab6a4d689fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:18.925838 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.925792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/051181072184f05a76ee6ab6a4d689fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"051181072184f05a76ee6ab6a4d689fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:18.925838 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:18.925810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/018f2dd0b968b4275775f115aced9005-config\") pod \"kube-apiserver-proxy-ip-10-0-138-5.ec2.internal\" (UID: \"018f2dd0b968b4275775f115aced9005\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:19.007751 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:19.007726    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:19.026084 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:19.026060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/051181072184f05a76ee6ab6a4d689fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"051181072184f05a76ee6ab6a4d689fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:19.026161 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:19.026088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/051181072184f05a76ee6ab6a4d689fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"051181072184f05a76ee6ab6a4d689fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:19.026161 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:19.026105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/018f2dd0b968b4275775f115aced9005-config\") pod \"kube-apiserver-proxy-ip-10-0-138-5.ec2.internal\" (UID: \"018f2dd0b968b4275775f115aced9005\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:19.026161 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:19.026139    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/018f2dd0b968b4275775f115aced9005-config\") pod \"kube-apiserver-proxy-ip-10-0-138-5.ec2.internal\" (UID: \"018f2dd0b968b4275775f115aced9005\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:19.026247 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:19.026170    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/051181072184f05a76ee6ab6a4d689fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"051181072184f05a76ee6ab6a4d689fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:19.026247 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:19.026170    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/051181072184f05a76ee6ab6a4d689fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"051181072184f05a76ee6ab6a4d689fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:19.108519 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:19.108457    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:19.179918 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:19.179885    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:19.183716 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:19.183698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:19.209197 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:19.209174    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:21.003594 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:21.003562    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:21.104067 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:21.104014    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:21.204701 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:21.204675    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:21.258151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.258127    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 19:18:21.258671 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.258295    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 19:18:21.305673 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:21.305643    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:21.323685 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.323652    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 19:13:20 +0000 UTC" deadline="2028-03-04 18:24:35.059121697 +0000 UTC"
Sep 11 19:18:21.323685 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.323682    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12959h6m13.735442157s"
Sep 11 19:18:21.405981 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:21.405911    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:21.444403 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.444381    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:18:21.471790 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:21.471757    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018f2dd0b968b4275775f115aced9005.slice/crio-94bb136a70165241701b5feaf7041d777cfccb8c22c2a757fca9553f499c7e70 WatchSource:0}: Error finding container 94bb136a70165241701b5feaf7041d777cfccb8c22c2a757fca9553f499c7e70: Status 404 returned error can't find the container with id 94bb136a70165241701b5feaf7041d777cfccb8c22c2a757fca9553f499c7e70
Sep 11 19:18:21.472445 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:21.472419    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051181072184f05a76ee6ab6a4d689fc.slice/crio-5b2b49c7d0d878cc470247f6123bf7875b8497f14a35d68311d662baaf34af02 WatchSource:0}: Error finding container 5b2b49c7d0d878cc470247f6123bf7875b8497f14a35d68311d662baaf34af02: Status 404 returned error can't find the container with id 5b2b49c7d0d878cc470247f6123bf7875b8497f14a35d68311d662baaf34af02
Sep 11 19:18:21.476844 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.476827    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:18:21.505990 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:21.505966    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 11 19:18:21.525799 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.525780    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:18:21.617499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.617477    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:21.628339 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.628324    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 19:18:21.629946 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.629933    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 11 19:18:21.635532 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.635509    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 19:18:21.878274 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:21.878196    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:18:22.079973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.079942    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:18:22.298247 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.298174    2580 apiserver.go:52] "Watching apiserver"
Sep 11 19:18:22.307604 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.307572    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 19:18:22.308429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.308398    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-f6k56","openshift-ovn-kubernetes/ovnkube-node-q82hf","kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal","openshift-dns/node-resolver-rlj84","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal","openshift-multus/multus-7ls27","openshift-multus/multus-additional-cni-plugins-9l7q7","openshift-multus/network-metrics-daemon-rhpw5","openshift-network-diagnostics/network-check-target-psfqq","kube-system/global-pull-secret-syncer-zgqpf","kube-system/konnectivity-agent-hdpt4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42","openshift-cluster-node-tuning-operator/tuned-kcdtv","openshift-image-registry/node-ca-8z9xt"]
Sep 11 19:18:22.311327 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.311305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.313705 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.313304    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:22.314382 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.314350    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 19:18:22.314529 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.314511    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5hcl8\""
Sep 11 19:18:22.314851 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.314832    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 19:18:22.315045 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.315024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 19:18:22.315202 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.315188    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 19:18:22.315378 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.315358    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 19:18:22.315671 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.315649    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 19:18:22.316124 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.316106    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.316851 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.316832    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 19:18:22.316945 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.316928    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-875v9\""
Sep 11 19:18:22.317087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.317069    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 19:18:22.318459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.318214    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 19:18:22.318459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.318328    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7pk2m\""
Sep 11 19:18:22.318459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.318336    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 19:18:22.318459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.318423    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 19:18:22.318815 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.318801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.320808 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.320632    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qncxq\""
Sep 11 19:18:22.321373 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.320871    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 19:18:22.321373 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.321046    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 19:18:22.321608 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.321590    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:22.321693 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.321671    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:22.323929 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.323907    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.325922 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.325904    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 19:18:22.326172 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.326154    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5lz2q\""
Sep 11 19:18:22.326548 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.326526    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:22.326639 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.326595    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:22.327333 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327303    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 19:18:22.327589 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/987c1db4-8cff-46a0-b3df-41ed6a3418a3-cnibin\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.327655 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/987c1db4-8cff-46a0-b3df-41ed6a3418a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.327655 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/987c1db4-8cff-46a0-b3df-41ed6a3418a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.327655 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/003a3202-e54d-4582-aa8b-052a1dbfcb51-host\") pod \"node-ca-8z9xt\" (UID: \"003a3202-e54d-4582-aa8b-052a1dbfcb51\") " pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.327806 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8mtd\" (UniqueName: \"kubernetes.io/projected/003a3202-e54d-4582-aa8b-052a1dbfcb51-kube-api-access-w8mtd\") pod \"node-ca-8z9xt\" (UID: \"003a3202-e54d-4582-aa8b-052a1dbfcb51\") " pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.327806 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvs8j\" (UniqueName: \"kubernetes.io/projected/6c8ad17f-cdfd-42a3-8326-04d7894c0fc2-kube-api-access-nvs8j\") pod \"node-resolver-rlj84\" (UID: \"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2\") " pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.327806 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681-agent-certs\") pod \"konnectivity-agent-hdpt4\" (UID: \"7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681\") " pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:22.327806 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/003a3202-e54d-4582-aa8b-052a1dbfcb51-serviceca\") pod \"node-ca-8z9xt\" (UID: \"003a3202-e54d-4582-aa8b-052a1dbfcb51\") " pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.327806 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c8ad17f-cdfd-42a3-8326-04d7894c0fc2-tmp-dir\") pod \"node-resolver-rlj84\" (UID: \"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2\") " pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.327806 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/987c1db4-8cff-46a0-b3df-41ed6a3418a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.327806 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/987c1db4-8cff-46a0-b3df-41ed6a3418a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.327806 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsbhh\" (UniqueName: \"kubernetes.io/projected/987c1db4-8cff-46a0-b3df-41ed6a3418a3-kube-api-access-lsbhh\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.328188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327815    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681-konnectivity-ca\") pod \"konnectivity-agent-hdpt4\" (UID: \"7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681\") " pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:22.328188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/987c1db4-8cff-46a0-b3df-41ed6a3418a3-system-cni-dir\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.328188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.327859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c8ad17f-cdfd-42a3-8326-04d7894c0fc2-hosts-file\") pod \"node-resolver-rlj84\" (UID: \"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2\") " pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.328553 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.328535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.330369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.330350    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:18:22.330472 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.330366    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gd6md\""
Sep 11 19:18:22.330472 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.330385    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 19:18:22.332261 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.331477    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.333377 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.333357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:22.333479 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.333421    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:22.333751 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.333729    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 19:18:22.334400 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.334379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 19:18:22.334757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.334569    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 19:18:22.334757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.334606    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 19:18:22.334757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.334576    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 19:18:22.334757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.334647    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 19:18:22.334942 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.334867    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rznzr\""
Sep 11 19:18:22.336848 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.336830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.338481 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.338461    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:18:22.338739 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.338722    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 19:18:22.338880 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.338836    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 19:18:22.338954 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.338869    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fg9sr\""
Sep 11 19:18:22.339380 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.339361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.341238 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.341221    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 19:18:22.341498 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.341478    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 19:18:22.341644 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.341487    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 19:18:22.342014 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.341987    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nm75x\""
Sep 11 19:18:22.349562 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.349453    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2cfvz"
Sep 11 19:18:22.356785 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.356769    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2cfvz"
Sep 11 19:18:22.419011 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.418979    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.428811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/847a1b73-fa57-436a-9371-74ea6c11f96a-dbus\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.428850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.428876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-node-log\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.428899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-env-overrides\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.428926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c8ad17f-cdfd-42a3-8326-04d7894c0fc2-hosts-file\") pod \"node-resolver-rlj84\" (UID: \"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2\") " pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.428952    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/847a1b73-fa57-436a-9371-74ea6c11f96a-kubelet-config\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.428977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-run-netns\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-var-lib-openvswitch\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e698c58-d9ab-440c-ad3c-df470ab88416-host-slash\") pod \"iptables-alerter-f6k56\" (UID: \"9e698c58-d9ab-440c-ad3c-df470ab88416\") " pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429044    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c8ad17f-cdfd-42a3-8326-04d7894c0fc2-hosts-file\") pod \"node-resolver-rlj84\" (UID: \"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2\") " pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-hostroot\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvs8j\" (UniqueName: \"kubernetes.io/projected/6c8ad17f-cdfd-42a3-8326-04d7894c0fc2-kube-api-access-nvs8j\") pod \"node-resolver-rlj84\" (UID: \"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2\") " pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-kubernetes\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-tuned\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.429298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-run-ovn-kubernetes\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-run-k8s-cni-cncf-io\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-sysctl-d\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e698c58-d9ab-440c-ad3c-df470ab88416-iptables-alerter-script\") pod \"iptables-alerter-f6k56\" (UID: \"9e698c58-d9ab-440c-ad3c-df470ab88416\") " pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-var-lib-cni-bin\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/987c1db4-8cff-46a0-b3df-41ed6a3418a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsbhh\" (UniqueName: \"kubernetes.io/projected/987c1db4-8cff-46a0-b3df-41ed6a3418a3-kube-api-access-lsbhh\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlz6h\" (UniqueName: \"kubernetes.io/projected/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-kube-api-access-dlz6h\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-run-openvswitch\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-sysctl-conf\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-run-netns\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-var-lib-cni-multus\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/987c1db4-8cff-46a0-b3df-41ed6a3418a3-cnibin\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/987c1db4-8cff-46a0-b3df-41ed6a3418a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.430237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/003a3202-e54d-4582-aa8b-052a1dbfcb51-host\") pod \"node-ca-8z9xt\" (UID: \"003a3202-e54d-4582-aa8b-052a1dbfcb51\") " pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-sys-fs\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-systemd-units\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-etc-openvswitch\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vnrr\" (UniqueName: \"kubernetes.io/projected/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-kube-api-access-4vnrr\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b694796-3a09-4088-a92e-085fc3c797a0-cni-binary-copy\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429815    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-modprobe-d\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429838    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-cni-bin\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7h8w\" (UniqueName: \"kubernetes.io/projected/8b694796-3a09-4088-a92e-085fc3c797a0-kube-api-access-r7h8w\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-systemd\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429925    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-kubelet\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-run-systemd\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/987c1db4-8cff-46a0-b3df-41ed6a3418a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.429977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-ovn-node-metrics-cert\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/987c1db4-8cff-46a0-b3df-41ed6a3418a3-system-cni-dir\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a642101-aeb1-4db8-9641-b35dbd4fba96-tmp\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.430927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-socket-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-multus-conf-dir\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-registration-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-device-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shfp2\" (UniqueName: \"kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2\") pod \"network-check-target-psfqq\" (UID: \"1f8443a8-9b08-4339-987d-e18d010d46b7\") " pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-run-ovn\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-run-multus-certs\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681-agent-certs\") pod \"konnectivity-agent-hdpt4\" (UID: \"7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681\") " pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/003a3202-e54d-4582-aa8b-052a1dbfcb51-serviceca\") pod \"node-ca-8z9xt\" (UID: \"003a3202-e54d-4582-aa8b-052a1dbfcb51\") " pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430385    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/987c1db4-8cff-46a0-b3df-41ed6a3418a3-cnibin\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/003a3202-e54d-4582-aa8b-052a1dbfcb51-host\") pod \"node-ca-8z9xt\" (UID: \"003a3202-e54d-4582-aa8b-052a1dbfcb51\") " pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-ovnkube-config\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-multus-cni-dir\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-var-lib-kubelet\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-log-socket\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430870    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/987c1db4-8cff-46a0-b3df-41ed6a3418a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.431675 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681-konnectivity-ca\") pod \"konnectivity-agent-hdpt4\" (UID: \"7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681\") " pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-sysconfig\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-run\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.430746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/987c1db4-8cff-46a0-b3df-41ed6a3418a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-sys\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-var-lib-kubelet\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-lib-modules\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431126    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/003a3202-e54d-4582-aa8b-052a1dbfcb51-serviceca\") pod \"node-ca-8z9xt\" (UID: \"003a3202-e54d-4582-aa8b-052a1dbfcb51\") " pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-host\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/987c1db4-8cff-46a0-b3df-41ed6a3418a3-system-cni-dir\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwc2j\" (UniqueName: \"kubernetes.io/projected/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-kube-api-access-zwc2j\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-slash\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-cni-netd\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-ovnkube-script-lib\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b694796-3a09-4088-a92e-085fc3c797a0-multus-daemon-config\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/987c1db4-8cff-46a0-b3df-41ed6a3418a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8mtd\" (UniqueName: \"kubernetes.io/projected/003a3202-e54d-4582-aa8b-052a1dbfcb51-kube-api-access-w8mtd\") pod \"node-ca-8z9xt\" (UID: \"003a3202-e54d-4582-aa8b-052a1dbfcb51\") " pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.432415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9j2c\" (UniqueName: \"kubernetes.io/projected/9e698c58-d9ab-440c-ad3c-df470ab88416-kube-api-access-m9j2c\") pod \"iptables-alerter-f6k56\" (UID: \"9e698c58-d9ab-440c-ad3c-df470ab88416\") " pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.433190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-system-cni-dir\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.433190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-cnibin\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.433190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/987c1db4-8cff-46a0-b3df-41ed6a3418a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.433190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c8ad17f-cdfd-42a3-8326-04d7894c0fc2-tmp-dir\") pod \"node-resolver-rlj84\" (UID: \"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2\") " pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.433190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-594sz\" (UniqueName: \"kubernetes.io/projected/6a642101-aeb1-4db8-9641-b35dbd4fba96-kube-api-access-594sz\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.433190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-multus-socket-dir-parent\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.433190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431726    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/987c1db4-8cff-46a0-b3df-41ed6a3418a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.433190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-etc-kubernetes\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.433190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681-konnectivity-ca\") pod \"konnectivity-agent-hdpt4\" (UID: \"7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681\") " pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:22.433190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.431883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c8ad17f-cdfd-42a3-8326-04d7894c0fc2-tmp-dir\") pod \"node-resolver-rlj84\" (UID: \"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2\") " pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.434960 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.434941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681-agent-certs\") pod \"konnectivity-agent-hdpt4\" (UID: \"7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681\") " pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:22.438808 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.438767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvs8j\" (UniqueName: \"kubernetes.io/projected/6c8ad17f-cdfd-42a3-8326-04d7894c0fc2-kube-api-access-nvs8j\") pod \"node-resolver-rlj84\" (UID: \"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2\") " pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.438808 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.438797    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsbhh\" (UniqueName: \"kubernetes.io/projected/987c1db4-8cff-46a0-b3df-41ed6a3418a3-kube-api-access-lsbhh\") pod \"multus-additional-cni-plugins-9l7q7\" (UID: \"987c1db4-8cff-46a0-b3df-41ed6a3418a3\") " pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.438939 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.438878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8mtd\" (UniqueName: \"kubernetes.io/projected/003a3202-e54d-4582-aa8b-052a1dbfcb51-kube-api-access-w8mtd\") pod \"node-ca-8z9xt\" (UID: \"003a3202-e54d-4582-aa8b-052a1dbfcb51\") " pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.446593 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.446547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" event={"ID":"051181072184f05a76ee6ab6a4d689fc","Type":"ContainerStarted","Data":"5b2b49c7d0d878cc470247f6123bf7875b8497f14a35d68311d662baaf34af02"}
Sep 11 19:18:22.447738 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.447716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" event={"ID":"018f2dd0b968b4275775f115aced9005","Type":"ContainerStarted","Data":"94bb136a70165241701b5feaf7041d777cfccb8c22c2a757fca9553f499c7e70"}
Sep 11 19:18:22.533016 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.532983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a642101-aeb1-4db8-9641-b35dbd4fba96-tmp\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.533188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-socket-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.533188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-multus-conf-dir\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.533188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-multus-conf-dir\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.533188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-registration-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.533188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-device-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.533188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shfp2\" (UniqueName: \"kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2\") pod \"network-check-target-psfqq\" (UID: \"1f8443a8-9b08-4339-987d-e18d010d46b7\") " pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:22.533482 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-run-ovn\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.533482 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-socket-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.533482 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-device-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.533482 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-registration-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.533482 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-run-ovn\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.533482 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-run-multus-certs\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.533482 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-ovnkube-config\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.533482 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-multus-cni-dir\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-var-lib-kubelet\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533500    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-run-multus-certs\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-log-socket\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-sysconfig\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-run\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-multus-cni-dir\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-sys\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-var-lib-kubelet\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-var-lib-kubelet\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-log-socket\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-sysconfig\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-var-lib-kubelet\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-run\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-lib-modules\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-host\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwc2j\" (UniqueName: \"kubernetes.io/projected/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-kube-api-access-zwc2j\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-slash\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.533862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533756    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-sys\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-lib-modules\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-slash\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533836    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-host\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-cni-netd\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-ovnkube-script-lib\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.533923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b694796-3a09-4088-a92e-085fc3c797a0-multus-daemon-config\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-cni-netd\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9j2c\" (UniqueName: \"kubernetes.io/projected/9e698c58-d9ab-440c-ad3c-df470ab88416-kube-api-access-m9j2c\") pod \"iptables-alerter-f6k56\" (UID: \"9e698c58-d9ab-440c-ad3c-df470ab88416\") " pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-system-cni-dir\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-cnibin\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-594sz\" (UniqueName: \"kubernetes.io/projected/6a642101-aeb1-4db8-9641-b35dbd4fba96-kube-api-access-594sz\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-ovnkube-config\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-multus-socket-dir-parent\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-multus-socket-dir-parent\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-etc-kubernetes\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/847a1b73-fa57-436a-9371-74ea6c11f96a-dbus\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-system-cni-dir\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.534776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-node-log\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534271    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-env-overrides\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/847a1b73-fa57-436a-9371-74ea6c11f96a-kubelet-config\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534334    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-etc-kubernetes\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-run-netns\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-var-lib-openvswitch\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/847a1b73-fa57-436a-9371-74ea6c11f96a-dbus\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534374    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-node-log\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e698c58-d9ab-440c-ad3c-df470ab88416-host-slash\") pod \"iptables-alerter-f6k56\" (UID: \"9e698c58-d9ab-440c-ad3c-df470ab88416\") " pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-cnibin\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-var-lib-openvswitch\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-hostroot\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b694796-3a09-4088-a92e-085fc3c797a0-multus-daemon-config\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-hostroot\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-ovnkube-script-lib\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-kubernetes\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.535640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-run-netns\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/847a1b73-fa57-436a-9371-74ea6c11f96a-kubelet-config\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-tuned\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e698c58-d9ab-440c-ad3c-df470ab88416-host-slash\") pod \"iptables-alerter-f6k56\" (UID: \"9e698c58-d9ab-440c-ad3c-df470ab88416\") " pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-kubernetes\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.534634    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.534722    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret podName:847a1b73-fa57-436a-9371-74ea6c11f96a nodeName:}" failed. No retries permitted until 2026-09-11 19:18:23.034683491 +0000 UTC m=+3.055891638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret") pod "global-pull-secret-syncer-zgqpf" (UID: "847a1b73-fa57-436a-9371-74ea6c11f96a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-run-ovn-kubernetes\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-run-k8s-cni-cncf-io\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-sysctl-d\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-run-ovn-kubernetes\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534853    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e698c58-d9ab-440c-ad3c-df470ab88416-iptables-alerter-script\") pod \"iptables-alerter-f6k56\" (UID: \"9e698c58-d9ab-440c-ad3c-df470ab88416\") " pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-var-lib-cni-bin\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.536511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-run-k8s-cni-cncf-io\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.534921    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-sysctl-d\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-var-lib-cni-bin\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.534906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlz6h\" (UniqueName: \"kubernetes.io/projected/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-kube-api-access-dlz6h\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.534971    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs podName:7ad42a98-9354-4ba3-b14f-77e0c163a8d3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:23.034956051 +0000 UTC m=+3.056164197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs") pod "network-metrics-daemon-rhpw5" (UID: "7ad42a98-9354-4ba3-b14f-77e0c163a8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-run-openvswitch\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-sysctl-conf\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-run-openvswitch\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-run-netns\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-var-lib-cni-multus\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-sys-fs\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-sysctl-conf\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-systemd-units\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-run-netns\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.537169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-etc-openvswitch\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vnrr\" (UniqueName: \"kubernetes.io/projected/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-kube-api-access-4vnrr\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b694796-3a09-4088-a92e-085fc3c797a0-host-var-lib-cni-multus\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b694796-3a09-4088-a92e-085fc3c797a0-cni-binary-copy\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-sys-fs\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-modprobe-d\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-cni-bin\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7h8w\" (UniqueName: \"kubernetes.io/projected/8b694796-3a09-4088-a92e-085fc3c797a0-kube-api-access-r7h8w\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-systemd\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-kubelet\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-run-systemd\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-ovn-node-metrics-cert\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-etc-openvswitch\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535199    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-systemd-units\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535523    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e698c58-d9ab-440c-ad3c-df470ab88416-iptables-alerter-script\") pod \"iptables-alerter-f6k56\" (UID: \"9e698c58-d9ab-440c-ad3c-df470ab88416\") " pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-modprobe-d\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-systemd\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-cni-bin\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.537811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-host-kubelet\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.538419 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-run-systemd\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.538419 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b694796-3a09-4088-a92e-085fc3c797a0-cni-binary-copy\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.538419 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.535991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a642101-aeb1-4db8-9641-b35dbd4fba96-tmp\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.538419 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.536134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-env-overrides\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.538419 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.536847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a642101-aeb1-4db8-9641-b35dbd4fba96-etc-tuned\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.538419 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.537842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-ovn-node-metrics-cert\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.540741 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.540630    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:22.540741 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.540688    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:22.540741 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.540702    2580 projected.go:196] Error preparing data for projected volume kube-api-access-shfp2 for pod openshift-network-diagnostics/network-check-target-psfqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:22.540948 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:22.540774    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2 podName:1f8443a8-9b08-4339-987d-e18d010d46b7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:23.040760335 +0000 UTC m=+3.061968464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-shfp2" (UniqueName: "kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2") pod "network-check-target-psfqq" (UID: "1f8443a8-9b08-4339-987d-e18d010d46b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:22.543104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.543063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-594sz\" (UniqueName: \"kubernetes.io/projected/6a642101-aeb1-4db8-9641-b35dbd4fba96-kube-api-access-594sz\") pod \"tuned-kcdtv\" (UID: \"6a642101-aeb1-4db8-9641-b35dbd4fba96\") " pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.543537 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.543429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwc2j\" (UniqueName: \"kubernetes.io/projected/1afdac3c-ecee-46a4-8052-cb7ea496ec7c-kube-api-access-zwc2j\") pod \"aws-ebs-csi-driver-node-jpt42\" (UID: \"1afdac3c-ecee-46a4-8052-cb7ea496ec7c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:22.544147 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.544122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9j2c\" (UniqueName: \"kubernetes.io/projected/9e698c58-d9ab-440c-ad3c-df470ab88416-kube-api-access-m9j2c\") pod \"iptables-alerter-f6k56\" (UID: \"9e698c58-d9ab-440c-ad3c-df470ab88416\") " pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.544973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.544950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7h8w\" (UniqueName: \"kubernetes.io/projected/8b694796-3a09-4088-a92e-085fc3c797a0-kube-api-access-r7h8w\") pod \"multus-7ls27\" (UID: \"8b694796-3a09-4088-a92e-085fc3c797a0\") " pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.545069 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.544979    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlz6h\" (UniqueName: \"kubernetes.io/projected/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-kube-api-access-dlz6h\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:22.545159 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.545138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vnrr\" (UniqueName: \"kubernetes.io/projected/29a74d9c-2b1e-4d15-ba98-bf16f42dbd65-kube-api-access-4vnrr\") pod \"ovnkube-node-q82hf\" (UID: \"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65\") " pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.625465 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.625387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9l7q7"
Sep 11 19:18:22.633726 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.633704    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:22.642417 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.642397    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8z9xt"
Sep 11 19:18:22.652009 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.651987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rlj84"
Sep 11 19:18:22.658783 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.658764    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7ls27"
Sep 11 19:18:22.666463 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.666443    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kcdtv"
Sep 11 19:18:22.674149 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.674130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:22.682759 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.682742    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f6k56"
Sep 11 19:18:22.689394 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:22.689373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42"
Sep 11 19:18:23.038502 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.038429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:23.038502 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.038469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:23.038696 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:23.038562    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:23.038696 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:23.038617    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret podName:847a1b73-fa57-436a-9371-74ea6c11f96a nodeName:}" failed. No retries permitted until 2026-09-11 19:18:24.038602783 +0000 UTC m=+4.059810911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret") pod "global-pull-secret-syncer-zgqpf" (UID: "847a1b73-fa57-436a-9371-74ea6c11f96a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:23.038696 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:23.038562    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:23.038810 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:23.038703    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs podName:7ad42a98-9354-4ba3-b14f-77e0c163a8d3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:24.038686279 +0000 UTC m=+4.059894421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs") pod "network-metrics-daemon-rhpw5" (UID: "7ad42a98-9354-4ba3-b14f-77e0c163a8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:23.139166 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.139125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shfp2\" (UniqueName: \"kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2\") pod \"network-check-target-psfqq\" (UID: \"1f8443a8-9b08-4339-987d-e18d010d46b7\") " pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:23.139340 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:23.139291    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:23.139340 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:23.139310    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:23.139340 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:23.139320    2580 projected.go:196] Error preparing data for projected volume kube-api-access-shfp2 for pod openshift-network-diagnostics/network-check-target-psfqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:23.139510 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:23.139370    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2 podName:1f8443a8-9b08-4339-987d-e18d010d46b7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:24.139356192 +0000 UTC m=+4.160564319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-shfp2" (UniqueName: "kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2") pod "network-check-target-psfqq" (UID: "1f8443a8-9b08-4339-987d-e18d010d46b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:23.359680 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.359587    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 19:13:22 +0000 UTC" deadline="2028-04-26 06:22:55.482842192 +0000 UTC"
Sep 11 19:18:23.359680 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.359622    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14219h4m32.123227963s"
Sep 11 19:18:23.395831 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:23.395727    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b694796_3a09_4088_a92e_085fc3c797a0.slice/crio-fcc8c2d200c1f7d001e330eb36425d5ae946fb8dcbc248b55b91d00c0037f16b WatchSource:0}: Error finding container fcc8c2d200c1f7d001e330eb36425d5ae946fb8dcbc248b55b91d00c0037f16b: Status 404 returned error can't find the container with id fcc8c2d200c1f7d001e330eb36425d5ae946fb8dcbc248b55b91d00c0037f16b
Sep 11 19:18:23.397372 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:23.397349    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a642101_aeb1_4db8_9641_b35dbd4fba96.slice/crio-95c821c52cd437e10fe762b3a8fbeebeb334244e1b21b60b96308f632c51b529 WatchSource:0}: Error finding container 95c821c52cd437e10fe762b3a8fbeebeb334244e1b21b60b96308f632c51b529: Status 404 returned error can't find the container with id 95c821c52cd437e10fe762b3a8fbeebeb334244e1b21b60b96308f632c51b529
Sep 11 19:18:23.399680 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:23.399660    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987c1db4_8cff_46a0_b3df_41ed6a3418a3.slice/crio-7a58487c796246d3a7012729a811c6ba7e26a33099fd34c67615965fc57e0a5f WatchSource:0}: Error finding container 7a58487c796246d3a7012729a811c6ba7e26a33099fd34c67615965fc57e0a5f: Status 404 returned error can't find the container with id 7a58487c796246d3a7012729a811c6ba7e26a33099fd34c67615965fc57e0a5f
Sep 11 19:18:23.401406 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:23.401383    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa2edcc_a4cc_4d1a_8a3b_d808d50b8681.slice/crio-24a86909d505c243424208e3aacfcd3cfca0702ee2decd5db6bdbcf7bc1a638e WatchSource:0}: Error finding container 24a86909d505c243424208e3aacfcd3cfca0702ee2decd5db6bdbcf7bc1a638e: Status 404 returned error can't find the container with id 24a86909d505c243424208e3aacfcd3cfca0702ee2decd5db6bdbcf7bc1a638e
Sep 11 19:18:23.423598 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:23.423573    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003a3202_e54d_4582_aa8b_052a1dbfcb51.slice/crio-3ca212090d6fa4b95e7f06c7860bc177daa7dcaada34f5d1464d817042cdd7e4 WatchSource:0}: Error finding container 3ca212090d6fa4b95e7f06c7860bc177daa7dcaada34f5d1464d817042cdd7e4: Status 404 returned error can't find the container with id 3ca212090d6fa4b95e7f06c7860bc177daa7dcaada34f5d1464d817042cdd7e4
Sep 11 19:18:23.424237 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:23.424220    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e698c58_d9ab_440c_ad3c_df470ab88416.slice/crio-0c681be2d8a03123484de08891f59220a8a21366fbfe940cce89bb27b9a14577 WatchSource:0}: Error finding container 0c681be2d8a03123484de08891f59220a8a21366fbfe940cce89bb27b9a14577: Status 404 returned error can't find the container with id 0c681be2d8a03123484de08891f59220a8a21366fbfe940cce89bb27b9a14577
Sep 11 19:18:23.425775 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:23.425697    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a74d9c_2b1e_4d15_ba98_bf16f42dbd65.slice/crio-27308108342f0aae7e47c313e6043e7860e6205592805578efc1528acef65fdb WatchSource:0}: Error finding container 27308108342f0aae7e47c313e6043e7860e6205592805578efc1528acef65fdb: Status 404 returned error can't find the container with id 27308108342f0aae7e47c313e6043e7860e6205592805578efc1528acef65fdb
Sep 11 19:18:23.426771 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:23.426751    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afdac3c_ecee_46a4_8052_cb7ea496ec7c.slice/crio-fcbc1708d1152493ca4d90dbc6c97aee1bc0740ab3f1c7de57eefcfb4c6a51bf WatchSource:0}: Error finding container fcbc1708d1152493ca4d90dbc6c97aee1bc0740ab3f1c7de57eefcfb4c6a51bf: Status 404 returned error can't find the container with id fcbc1708d1152493ca4d90dbc6c97aee1bc0740ab3f1c7de57eefcfb4c6a51bf
Sep 11 19:18:23.427384 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:18:23.427353    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8ad17f_cdfd_42a3_8326_04d7894c0fc2.slice/crio-549f52b4269d5931c0847ba44e5141ca0b17262778f220795fc5fd4e260fe802 WatchSource:0}: Error finding container 549f52b4269d5931c0847ba44e5141ca0b17262778f220795fc5fd4e260fe802: Status 404 returned error can't find the container with id 549f52b4269d5931c0847ba44e5141ca0b17262778f220795fc5fd4e260fe802
Sep 11 19:18:23.442532 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.442507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:23.442677 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:23.442619    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:23.451081 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.450921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" event={"ID":"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65","Type":"ContainerStarted","Data":"27308108342f0aae7e47c313e6043e7860e6205592805578efc1528acef65fdb"}
Sep 11 19:18:23.452101 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.452080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f6k56" event={"ID":"9e698c58-d9ab-440c-ad3c-df470ab88416","Type":"ContainerStarted","Data":"0c681be2d8a03123484de08891f59220a8a21366fbfe940cce89bb27b9a14577"}
Sep 11 19:18:23.453534 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.453510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rlj84" event={"ID":"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2","Type":"ContainerStarted","Data":"549f52b4269d5931c0847ba44e5141ca0b17262778f220795fc5fd4e260fe802"}
Sep 11 19:18:23.454662 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.454642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42" event={"ID":"1afdac3c-ecee-46a4-8052-cb7ea496ec7c","Type":"ContainerStarted","Data":"fcbc1708d1152493ca4d90dbc6c97aee1bc0740ab3f1c7de57eefcfb4c6a51bf"}
Sep 11 19:18:23.456895 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.456869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8z9xt" event={"ID":"003a3202-e54d-4582-aa8b-052a1dbfcb51","Type":"ContainerStarted","Data":"3ca212090d6fa4b95e7f06c7860bc177daa7dcaada34f5d1464d817042cdd7e4"}
Sep 11 19:18:23.460498 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.460477    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hdpt4" event={"ID":"7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681","Type":"ContainerStarted","Data":"24a86909d505c243424208e3aacfcd3cfca0702ee2decd5db6bdbcf7bc1a638e"}
Sep 11 19:18:23.463956 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.463933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9l7q7" event={"ID":"987c1db4-8cff-46a0-b3df-41ed6a3418a3","Type":"ContainerStarted","Data":"7a58487c796246d3a7012729a811c6ba7e26a33099fd34c67615965fc57e0a5f"}
Sep 11 19:18:23.465149 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.465128    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kcdtv" event={"ID":"6a642101-aeb1-4db8-9641-b35dbd4fba96","Type":"ContainerStarted","Data":"95c821c52cd437e10fe762b3a8fbeebeb334244e1b21b60b96308f632c51b529"}
Sep 11 19:18:23.466374 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:23.466338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7ls27" event={"ID":"8b694796-3a09-4088-a92e-085fc3c797a0","Type":"ContainerStarted","Data":"fcc8c2d200c1f7d001e330eb36425d5ae946fb8dcbc248b55b91d00c0037f16b"}
Sep 11 19:18:24.045524 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.045438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:24.045524 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.045484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:24.045731 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:24.045638    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:24.045731 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:24.045700    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs podName:7ad42a98-9354-4ba3-b14f-77e0c163a8d3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:26.045680897 +0000 UTC m=+6.066889048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs") pod "network-metrics-daemon-rhpw5" (UID: "7ad42a98-9354-4ba3-b14f-77e0c163a8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:24.046127 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:24.046100    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:24.046246 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:24.046153    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret podName:847a1b73-fa57-436a-9371-74ea6c11f96a nodeName:}" failed. No retries permitted until 2026-09-11 19:18:26.046138201 +0000 UTC m=+6.067346329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret") pod "global-pull-secret-syncer-zgqpf" (UID: "847a1b73-fa57-436a-9371-74ea6c11f96a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:24.146794 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.146002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shfp2\" (UniqueName: \"kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2\") pod \"network-check-target-psfqq\" (UID: \"1f8443a8-9b08-4339-987d-e18d010d46b7\") " pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:24.146794 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:24.146224    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:24.146794 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:24.146243    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:24.146794 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:24.146256    2580 projected.go:196] Error preparing data for projected volume kube-api-access-shfp2 for pod openshift-network-diagnostics/network-check-target-psfqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:24.146794 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:24.146330    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2 podName:1f8443a8-9b08-4339-987d-e18d010d46b7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:26.146309536 +0000 UTC m=+6.167517680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-shfp2" (UniqueName: "kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2") pod "network-check-target-psfqq" (UID: "1f8443a8-9b08-4339-987d-e18d010d46b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:24.359894 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.359776    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 19:13:22 +0000 UTC" deadline="2028-05-29 20:36:37.685464996 +0000 UTC"
Sep 11 19:18:24.359894 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.359814    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15025h18m13.325655456s"
Sep 11 19:18:24.444075 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.443401    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:24.444075 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:24.443540    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:24.444075 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.443911    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:24.444075 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:24.444006    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:24.481685 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.481565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" event={"ID":"051181072184f05a76ee6ab6a4d689fc","Type":"ContainerDied","Data":"ad20a905d6d8a81241cee89683596c7fca911fadef397ee8900cfd2dc9896a7d"}
Sep 11 19:18:24.482156 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.482063    2580 generic.go:356] "Generic (PLEG): container finished" podID="051181072184f05a76ee6ab6a4d689fc" containerID="ad20a905d6d8a81241cee89683596c7fca911fadef397ee8900cfd2dc9896a7d" exitCode=0
Sep 11 19:18:24.492794 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.492339    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" event={"ID":"018f2dd0b968b4275775f115aced9005","Type":"ContainerStarted","Data":"bbdf9420b31f704b737339e8c7c0a1e44e29b8cc72ca9bba042fff9a202bf325"}
Sep 11 19:18:24.513356 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:24.513298    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" podStartSLOduration=3.5132640090000002 podStartE2EDuration="3.513264009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:24.512917667 +0000 UTC m=+4.534125818" watchObservedRunningTime="2026-09-11 19:18:24.513264009 +0000 UTC m=+4.534472159"
Sep 11 19:18:25.443328 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:25.442834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:25.443328 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:25.442961    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:25.523952 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:25.523836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" event={"ID":"051181072184f05a76ee6ab6a4d689fc","Type":"ContainerStarted","Data":"7e6a9eaf0dfca130b79174604e5ebe49da57eba8d6bdcaaf35785bfb3cb43635"}
Sep 11 19:18:25.538585 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:25.537831    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" podStartSLOduration=4.53781065 podStartE2EDuration="4.53781065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:25.537402359 +0000 UTC m=+5.558610535" watchObservedRunningTime="2026-09-11 19:18:25.53781065 +0000 UTC m=+5.559018801"
Sep 11 19:18:26.063838 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:26.063800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:26.064027 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:26.063855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:26.064087 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:26.064027    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:26.064137 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:26.064087    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs podName:7ad42a98-9354-4ba3-b14f-77e0c163a8d3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:30.064069666 +0000 UTC m=+10.085277810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs") pod "network-metrics-daemon-rhpw5" (UID: "7ad42a98-9354-4ba3-b14f-77e0c163a8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:26.064516 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:26.064497    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:26.064588 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:26.064552    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret podName:847a1b73-fa57-436a-9371-74ea6c11f96a nodeName:}" failed. No retries permitted until 2026-09-11 19:18:30.064537041 +0000 UTC m=+10.085745177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret") pod "global-pull-secret-syncer-zgqpf" (UID: "847a1b73-fa57-436a-9371-74ea6c11f96a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:26.165052 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:26.165015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shfp2\" (UniqueName: \"kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2\") pod \"network-check-target-psfqq\" (UID: \"1f8443a8-9b08-4339-987d-e18d010d46b7\") " pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:26.165237 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:26.165207    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:26.165237 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:26.165228    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:26.165237 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:26.165240    2580 projected.go:196] Error preparing data for projected volume kube-api-access-shfp2 for pod openshift-network-diagnostics/network-check-target-psfqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:26.165444 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:26.165323    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2 podName:1f8443a8-9b08-4339-987d-e18d010d46b7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:30.165297587 +0000 UTC m=+10.186505729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-shfp2" (UniqueName: "kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2") pod "network-check-target-psfqq" (UID: "1f8443a8-9b08-4339-987d-e18d010d46b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:26.443461 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:26.443388    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:26.444037 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:26.443527    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:26.444037 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:26.443902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:26.444037 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:26.443992    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:27.443460 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:27.443427    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:27.443927 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:27.443559    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:28.443191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:28.442939    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:28.443191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:28.442975    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:28.443191 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:28.443089    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:28.443554 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:28.443528    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:29.442920 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:29.442842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:29.443077 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:29.442975    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:30.099932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:30.099891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:30.099932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:30.099942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:30.100485 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:30.100093    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:30.100485 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:30.100156    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs podName:7ad42a98-9354-4ba3-b14f-77e0c163a8d3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:38.100137019 +0000 UTC m=+18.121345166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs") pod "network-metrics-daemon-rhpw5" (UID: "7ad42a98-9354-4ba3-b14f-77e0c163a8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:30.100582 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:30.100507    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:30.100582 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:30.100575    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret podName:847a1b73-fa57-436a-9371-74ea6c11f96a nodeName:}" failed. No retries permitted until 2026-09-11 19:18:38.100555924 +0000 UTC m=+18.121764059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret") pod "global-pull-secret-syncer-zgqpf" (UID: "847a1b73-fa57-436a-9371-74ea6c11f96a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:30.200961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:30.200919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shfp2\" (UniqueName: \"kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2\") pod \"network-check-target-psfqq\" (UID: \"1f8443a8-9b08-4339-987d-e18d010d46b7\") " pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:30.201141 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:30.201102    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:30.201141 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:30.201120    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:30.201141 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:30.201133    2580 projected.go:196] Error preparing data for projected volume kube-api-access-shfp2 for pod openshift-network-diagnostics/network-check-target-psfqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:30.201333 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:30.201209    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2 podName:1f8443a8-9b08-4339-987d-e18d010d46b7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:38.201189553 +0000 UTC m=+18.222397704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-shfp2" (UniqueName: "kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2") pod "network-check-target-psfqq" (UID: "1f8443a8-9b08-4339-987d-e18d010d46b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:30.443906 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:30.443775    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:30.443906 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:30.443808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:30.444110 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:30.443900    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:30.444404 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:30.444373    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:31.443457 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:31.443427    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:31.443914 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:31.443552    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:32.443385 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:32.443353    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:32.443558 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:32.443359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:32.443873 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:32.443628    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:32.443873 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:32.443502    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:33.443298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:33.443255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:33.443454 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:33.443353    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:34.443506 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:34.443467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:34.443942 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:34.443467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:34.443942 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:34.443616    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:34.443942 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:34.443674    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:35.442859 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:35.442824    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:35.443059 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:35.442950    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:36.442951 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:36.442920    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:36.443430 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:36.442966    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:36.443430 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:36.443081    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:36.443430 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:36.443112    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:37.443546 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:37.443509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:37.444050 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:37.443645    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:38.160021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:38.159985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:38.160021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:38.160027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:38.160254 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:38.160149    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:38.160254 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:38.160162    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:38.160254 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:38.160213    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs podName:7ad42a98-9354-4ba3-b14f-77e0c163a8d3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:54.160195959 +0000 UTC m=+34.181404088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs") pod "network-metrics-daemon-rhpw5" (UID: "7ad42a98-9354-4ba3-b14f-77e0c163a8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:38.160254 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:38.160227    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret podName:847a1b73-fa57-436a-9371-74ea6c11f96a nodeName:}" failed. No retries permitted until 2026-09-11 19:18:54.160221233 +0000 UTC m=+34.181429362 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret") pod "global-pull-secret-syncer-zgqpf" (UID: "847a1b73-fa57-436a-9371-74ea6c11f96a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:38.260747 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:38.260709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shfp2\" (UniqueName: \"kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2\") pod \"network-check-target-psfqq\" (UID: \"1f8443a8-9b08-4339-987d-e18d010d46b7\") " pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:38.260925 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:38.260903    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:38.261002 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:38.260933    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:38.261002 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:38.260947    2580 projected.go:196] Error preparing data for projected volume kube-api-access-shfp2 for pod openshift-network-diagnostics/network-check-target-psfqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:38.261099 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:38.261019    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2 podName:1f8443a8-9b08-4339-987d-e18d010d46b7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:54.260999042 +0000 UTC m=+34.282207184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-shfp2" (UniqueName: "kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2") pod "network-check-target-psfqq" (UID: "1f8443a8-9b08-4339-987d-e18d010d46b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:38.442881 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:38.442796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:38.442881 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:38.442840    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:38.443105 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:38.442924    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:38.443105 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:38.443073    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:39.442612 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:39.442579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:39.443048 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:39.442690    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:40.444109 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:40.443871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:40.444602 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:40.444196    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:40.444602 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:40.443949    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:40.444720 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:40.444696    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:41.442746 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.442550    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:41.442882 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:41.442837    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:41.559196 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.559164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rlj84" event={"ID":"6c8ad17f-cdfd-42a3-8326-04d7894c0fc2","Type":"ContainerStarted","Data":"b50f67046011e0b196e830ea45ea9fb91b07d4bea4e3214b3ed9b49c871a7ec4"}
Sep 11 19:18:41.561033 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.561009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42" event={"ID":"1afdac3c-ecee-46a4-8052-cb7ea496ec7c","Type":"ContainerStarted","Data":"b76789f715fd720eff1308d7efeabec57b79904b7860f49481bdb19275e9f6c0"}
Sep 11 19:18:41.563369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.562764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8z9xt" event={"ID":"003a3202-e54d-4582-aa8b-052a1dbfcb51","Type":"ContainerStarted","Data":"8ede4a70778e00eb8c02355ee1a183ca24fe88312e74ff8a3b46cec950dcb043"}
Sep 11 19:18:41.564613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.564591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hdpt4" event={"ID":"7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681","Type":"ContainerStarted","Data":"4179e254fa3c08e129a828432d731720d39788acea0e98fd110c36228aba1c5f"}
Sep 11 19:18:41.566168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.566146    2580 generic.go:356] "Generic (PLEG): container finished" podID="987c1db4-8cff-46a0-b3df-41ed6a3418a3" containerID="fe91ed88bcc8334f281921ac4317a3f04373e91c186d4ab4456db8a568720ca4" exitCode=0
Sep 11 19:18:41.566255 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.566207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9l7q7" event={"ID":"987c1db4-8cff-46a0-b3df-41ed6a3418a3","Type":"ContainerDied","Data":"fe91ed88bcc8334f281921ac4317a3f04373e91c186d4ab4456db8a568720ca4"}
Sep 11 19:18:41.567944 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.567924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kcdtv" event={"ID":"6a642101-aeb1-4db8-9641-b35dbd4fba96","Type":"ContainerStarted","Data":"47ecfb8fe62e98879af83399e04957ad0bf77cd7607e20b602e1decd49bddbd2"}
Sep 11 19:18:41.569564 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.569541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7ls27" event={"ID":"8b694796-3a09-4088-a92e-085fc3c797a0","Type":"ContainerStarted","Data":"bb792fe6d1cad1eaf91bd9923a6591d74bc193f35432d683f04f70fabf1e2c61"}
Sep 11 19:18:41.572268 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.572249    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:18:41.572702 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.572677    2580 generic.go:356] "Generic (PLEG): container finished" podID="29a74d9c-2b1e-4d15-ba98-bf16f42dbd65" containerID="4c09f9c379c1b9fb61c0d176553078f261638d058b8dd2f1798dbdc2ffd98fe9" exitCode=1
Sep 11 19:18:41.572778 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.572717    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" event={"ID":"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65","Type":"ContainerStarted","Data":"1be6da86176680d4f83ee48f5d37e2da7eab730a4b9b33460ce29bfd11dcf860"}
Sep 11 19:18:41.572778 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.572764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" event={"ID":"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65","Type":"ContainerStarted","Data":"531fda9bdffaaf1d2b6978b5a7d65412502c8555cc84a6ff0690b311c84392db"}
Sep 11 19:18:41.572846 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.572794    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" event={"ID":"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65","Type":"ContainerStarted","Data":"b12a80fa5f3cb6fd60ddbd63c091fb952de38680a7c95a0c47ee1455764760be"}
Sep 11 19:18:41.572846 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.572822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" event={"ID":"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65","Type":"ContainerDied","Data":"4c09f9c379c1b9fb61c0d176553078f261638d058b8dd2f1798dbdc2ffd98fe9"}
Sep 11 19:18:41.572918 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.572850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" event={"ID":"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65","Type":"ContainerStarted","Data":"31b12a2643a2e28055c2811c003ad3ec3350ef99ecd7415e9cb1ef2853a2a988"}
Sep 11 19:18:41.575932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.575883    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rlj84" podStartSLOduration=8.113956417 podStartE2EDuration="21.575866393s" totalImagesPullingTime="13.461909976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:41.57518868 +0000 UTC m=+21.596396843" watchObservedRunningTime="2026-09-11 19:18:41.575866393 +0000 UTC m=+21.597074544"
Sep 11 19:18:41.591557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.591515    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7ls27" podStartSLOduration=3.706153903 podStartE2EDuration="21.59150124s" totalImagesPullingTime="17.885347337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:41.591157829 +0000 UTC m=+21.612365980" watchObservedRunningTime="2026-09-11 19:18:41.59150124 +0000 UTC m=+21.612709390"
Sep 11 19:18:41.625632 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.625589    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hdpt4" podStartSLOduration=8.155386605 podStartE2EDuration="21.625574914s" totalImagesPullingTime="13.470188309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:41.62527094 +0000 UTC m=+21.646479108" watchObservedRunningTime="2026-09-11 19:18:41.625574914 +0000 UTC m=+21.646783058"
Sep 11 19:18:41.651577 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.650244    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kcdtv" podStartSLOduration=4.052218163 podStartE2EDuration="21.650224812s" totalImagesPullingTime="17.598006649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:41.649600141 +0000 UTC m=+21.670808284" watchObservedRunningTime="2026-09-11 19:18:41.650224812 +0000 UTC m=+21.671432963"
Sep 11 19:18:41.664133 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:41.664087    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8z9xt" podStartSLOduration=4.093298076 podStartE2EDuration="21.664071625s" totalImagesPullingTime="17.570773549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:41.66387151 +0000 UTC m=+21.685079680" watchObservedRunningTime="2026-09-11 19:18:41.664071625 +0000 UTC m=+21.685279775"
Sep 11 19:18:42.443230 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:42.443202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:42.443349 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:42.443206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:42.443349 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:42.443328    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:42.443445 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:42.443394    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:42.583221 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:42.583143    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:18:42.584091 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:42.584059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" event={"ID":"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65","Type":"ContainerStarted","Data":"43f694166cdbbcda2bea97ee860a8abf34bd35953d28aef3017d3a359266cf5f"}
Sep 11 19:18:42.589665 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:42.589333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f6k56" event={"ID":"9e698c58-d9ab-440c-ad3c-df470ab88416","Type":"ContainerStarted","Data":"f53df6ee907c8756beb78d5251b938b5923113ed27a4df7c7cceb7a513a6d29f"}
Sep 11 19:18:42.589665 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:42.589412    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 19:18:42.605895 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:42.605846    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f6k56" podStartSLOduration=5.035696186 podStartE2EDuration="22.605829531s" totalImagesPullingTime="17.570133345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:42.604491396 +0000 UTC m=+22.625699564" watchObservedRunningTime="2026-09-11 19:18:42.605829531 +0000 UTC m=+22.627037678"
Sep 11 19:18:43.376690 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:43.376584    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T19:18:42.589428515Z","UUID":"894b68cc-6d76-4dee-9634-71e81079d4e6","Handler":null,"Name":"","Endpoint":""}
Sep 11 19:18:43.378397 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:43.378358    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 19:18:43.378397 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:43.378395    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 19:18:43.443018 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:43.442985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:43.443184 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:43.443117    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:43.594151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:43.594116    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42" event={"ID":"1afdac3c-ecee-46a4-8052-cb7ea496ec7c","Type":"ContainerStarted","Data":"2b68e6aef8bd57fb47cd6d4a37e75a2414f132f47da956ba56d6bd96043936d8"}
Sep 11 19:18:44.069968 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:44.069656    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:44.070334 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:44.070314    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:44.443688 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:44.443604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:44.443847 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:44.443742    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:44.443847 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:44.443789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:44.443959 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:44.443889    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:44.602390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:44.602356    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:18:44.602810 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:44.602786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" event={"ID":"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65","Type":"ContainerStarted","Data":"96f20593d4f28c9265bd3b2805a011961f2932bcfb26c934446b6120e0dd9f53"}
Sep 11 19:18:44.605120 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:44.605091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42" event={"ID":"1afdac3c-ecee-46a4-8052-cb7ea496ec7c","Type":"ContainerStarted","Data":"1def7e6eca4eeee0eac2a7a15ae99d07eab0e4904de11e44521609a1fd940265"}
Sep 11 19:18:44.605437 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:44.605415    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:44.606030 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:44.606010    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hdpt4"
Sep 11 19:18:44.622195 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:44.622145    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpt42" podStartSLOduration=4.853237857 podStartE2EDuration="24.622126151s" totalImagesPullingTime="19.768888294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:44.621367123 +0000 UTC m=+24.642575291" watchObservedRunningTime="2026-09-11 19:18:44.622126151 +0000 UTC m=+24.643334306"
Sep 11 19:18:45.019237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:45.019211    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rlj84_6c8ad17f-cdfd-42a3-8326-04d7894c0fc2/dns-node-resolver/0.log"
Sep 11 19:18:45.443299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:45.443218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:45.443443 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:45.443343    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:45.801518 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:45.801449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8z9xt_003a3202-e54d-4582-aa8b-052a1dbfcb51/node-ca/0.log"
Sep 11 19:18:46.442855 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:46.442618    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:46.442961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:46.442669    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:46.443005 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:46.442983    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:46.443038 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:46.443005    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:46.611403 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:46.611361    2580 generic.go:356] "Generic (PLEG): container finished" podID="987c1db4-8cff-46a0-b3df-41ed6a3418a3" containerID="83f7d0a2ccc33e6354c6230afc4d87b9c969dadbb852a93d1e28e3ac1210be36" exitCode=0
Sep 11 19:18:46.611572 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:46.611404    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9l7q7" event={"ID":"987c1db4-8cff-46a0-b3df-41ed6a3418a3","Type":"ContainerDied","Data":"83f7d0a2ccc33e6354c6230afc4d87b9c969dadbb852a93d1e28e3ac1210be36"}
Sep 11 19:18:46.615543 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:46.615525    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:18:46.615894 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:46.615876    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" event={"ID":"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65","Type":"ContainerStarted","Data":"5b61d58fcb01bb4ad400c1afa3e276c3eff198251e465e31589cd205963cc9af"}
Sep 11 19:18:46.616128 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:46.616113    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:46.616191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:46.616180    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:46.616310 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:46.616273    2580 scope.go:117] "RemoveContainer" containerID="4c09f9c379c1b9fb61c0d176553078f261638d058b8dd2f1798dbdc2ffd98fe9"
Sep 11 19:18:46.633845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:46.633815    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:47.443390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:47.443357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:47.443975 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:47.443490    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:47.622271 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:47.622195    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:18:47.622622 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:47.622588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" event={"ID":"29a74d9c-2b1e-4d15-ba98-bf16f42dbd65","Type":"ContainerStarted","Data":"f0f5d6f63e0d8ef8a3491c28b55699df8b0f5343b6da154eda5af5e6411c0d1d"}
Sep 11 19:18:47.622895 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:47.622872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:47.624781 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:47.624756    2580 generic.go:356] "Generic (PLEG): container finished" podID="987c1db4-8cff-46a0-b3df-41ed6a3418a3" containerID="c0cfa3f23b10eb5496236208fa40afca2bc84a86813a967cdb1dc09069924640" exitCode=0
Sep 11 19:18:47.624878 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:47.624796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9l7q7" event={"ID":"987c1db4-8cff-46a0-b3df-41ed6a3418a3","Type":"ContainerDied","Data":"c0cfa3f23b10eb5496236208fa40afca2bc84a86813a967cdb1dc09069924640"}
Sep 11 19:18:47.638878 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:47.638853    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:18:47.656547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:47.656403    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf" podStartSLOduration=10.069459963 podStartE2EDuration="27.656385595s" totalImagesPullingTime="17.586925632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:47.655867573 +0000 UTC m=+27.677075734" watchObservedRunningTime="2026-09-11 19:18:47.656385595 +0000 UTC m=+27.677593745"
Sep 11 19:18:48.221912 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:48.221842    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-psfqq"]
Sep 11 19:18:48.222061 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:48.222016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:48.222144 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:48.222123    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:48.231678 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:48.231649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rhpw5"]
Sep 11 19:18:48.231842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:48.231794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:48.231913 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:48.231894    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:48.239030 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:48.239003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zgqpf"]
Sep 11 19:18:48.239172 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:48.239117    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:48.239233 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:48.239215    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:48.629380 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:48.629349    2580 generic.go:356] "Generic (PLEG): container finished" podID="987c1db4-8cff-46a0-b3df-41ed6a3418a3" containerID="bebd4ec5620ea2de21dd919f63d7874a83fdcbdf584e0200378dfe0a4630b699" exitCode=0
Sep 11 19:18:48.629994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:48.629436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9l7q7" event={"ID":"987c1db4-8cff-46a0-b3df-41ed6a3418a3","Type":"ContainerDied","Data":"bebd4ec5620ea2de21dd919f63d7874a83fdcbdf584e0200378dfe0a4630b699"}
Sep 11 19:18:49.443127 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:49.443083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:49.443347 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:49.443208    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:50.444977 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:50.444414    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:50.444977 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:50.444490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:50.444977 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:50.444781    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:50.444977 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:50.444661    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:51.443014 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:51.442977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:51.443194 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:51.443098    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:52.442574 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:52.442536    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:52.443047 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:52.442673    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:52.443047 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:52.442535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:52.443169 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:52.443120    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:53.442667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:53.442624    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:53.443174 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:53.442754    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:53.644268 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:53.644237    2580 generic.go:356] "Generic (PLEG): container finished" podID="987c1db4-8cff-46a0-b3df-41ed6a3418a3" containerID="77235ed6d882d1a335a6bc62239184886cc67756c0a1df81358a92a821c39eac" exitCode=0
Sep 11 19:18:53.644459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:53.644312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9l7q7" event={"ID":"987c1db4-8cff-46a0-b3df-41ed6a3418a3","Type":"ContainerDied","Data":"77235ed6d882d1a335a6bc62239184886cc67756c0a1df81358a92a821c39eac"}
Sep 11 19:18:54.172515 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:54.172434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:54.172515 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:54.172472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:54.172687 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:54.172565    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:54.172687 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:54.172565    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:54.172687 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:54.172617    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs podName:7ad42a98-9354-4ba3-b14f-77e0c163a8d3 nodeName:}" failed. No retries permitted until 2026-09-11 19:19:26.172604429 +0000 UTC m=+66.193812557 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs") pod "network-metrics-daemon-rhpw5" (UID: "7ad42a98-9354-4ba3-b14f-77e0c163a8d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:54.172687 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:54.172630    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret podName:847a1b73-fa57-436a-9371-74ea6c11f96a nodeName:}" failed. No retries permitted until 2026-09-11 19:19:26.172624189 +0000 UTC m=+66.193832317 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret") pod "global-pull-secret-syncer-zgqpf" (UID: "847a1b73-fa57-436a-9371-74ea6c11f96a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:54.273019 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:54.272989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shfp2\" (UniqueName: \"kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2\") pod \"network-check-target-psfqq\" (UID: \"1f8443a8-9b08-4339-987d-e18d010d46b7\") " pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:54.273181 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:54.273104    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:54.273181 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:54.273118    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:54.273181 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:54.273127    2580 projected.go:196] Error preparing data for projected volume kube-api-access-shfp2 for pod openshift-network-diagnostics/network-check-target-psfqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:54.273181 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:54.273174    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2 podName:1f8443a8-9b08-4339-987d-e18d010d46b7 nodeName:}" failed. No retries permitted until 2026-09-11 19:19:26.273162047 +0000 UTC m=+66.294370174 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-shfp2" (UniqueName: "kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2") pod "network-check-target-psfqq" (UID: "1f8443a8-9b08-4339-987d-e18d010d46b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:54.443631 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:54.443603    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:54.444067 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:54.443723    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:54.444067 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:54.443770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:54.444067 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:54.443865    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:54.649926 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:54.649891    2580 generic.go:356] "Generic (PLEG): container finished" podID="987c1db4-8cff-46a0-b3df-41ed6a3418a3" containerID="4a2e16345ec6894b78cd89f88f44e97432d624e68f41c5bbfc8190e5ee2b7087" exitCode=0
Sep 11 19:18:54.650072 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:54.649960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9l7q7" event={"ID":"987c1db4-8cff-46a0-b3df-41ed6a3418a3","Type":"ContainerDied","Data":"4a2e16345ec6894b78cd89f88f44e97432d624e68f41c5bbfc8190e5ee2b7087"}
Sep 11 19:18:55.443640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:55.443460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:55.444004 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:55.443715    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:55.656046 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:55.656008    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9l7q7" event={"ID":"987c1db4-8cff-46a0-b3df-41ed6a3418a3","Type":"ContainerStarted","Data":"526c78f2490a64a1effb09b2bd8de932754aff2845e2e3ce3542697c8ea13ff5"}
Sep 11 19:18:55.676151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:55.676104    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9l7q7" podStartSLOduration=7.541514643 podStartE2EDuration="35.676090561s" totalImagesPullingTime="28.134575918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:55.675056392 +0000 UTC m=+35.696264560" watchObservedRunningTime="2026-09-11 19:18:55.676090561 +0000 UTC m=+35.697298708"
Sep 11 19:18:56.443504 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:56.443464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:56.443642 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:56.443608    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:56.443693 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:56.443646    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:56.443937 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:56.443725    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:57.443487 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:57.443459    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:57.443649 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:57.443560    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:18:58.443558 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:58.443524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:18:58.443935 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:58.443643    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:18:58.443935 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:58.443695    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:18:58.443935 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:58.443787    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:18:59.442672 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:18:59.442636    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:18:59.442870 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:18:59.442770    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:19:00.444300 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:00.444256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:19:00.444663 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:00.444338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:19:00.444663 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:00.444356    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:19:00.444663 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:00.444438    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:19:01.442993 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:01.442963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:19:01.443127 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:01.443066    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:19:02.442788 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:02.442748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:19:02.443225 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:02.442751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:19:02.443225 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:02.442848    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:19:02.443225 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:02.442958    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:19:03.443114 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:03.443081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:19:03.443509 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:03.443193    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:19:04.442545 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:04.442504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:19:04.442814 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:04.442513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:19:04.442814 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:04.442614    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:19:04.442814 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:04.442695    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:19:05.443478 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:05.443446    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:19:05.443833 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:05.443554    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:19:06.443056 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:06.443022    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:19:06.443219 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:06.443023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:19:06.443219 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:06.443125    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:19:06.443219 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:06.443194    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:19:07.442672 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:07.442645    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:19:07.443034 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:07.442763    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhpw5" podUID="7ad42a98-9354-4ba3-b14f-77e0c163a8d3"
Sep 11 19:19:08.442798 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.442762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:19:08.443160 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:08.442860    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psfqq" podUID="1f8443a8-9b08-4339-987d-e18d010d46b7"
Sep 11 19:19:08.443160 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.442939    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:19:08.443160 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:08.443050    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zgqpf" podUID="847a1b73-fa57-436a-9371-74ea6c11f96a"
Sep 11 19:19:08.713547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.713524    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeReady"
Sep 11 19:19:08.713667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.713651    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 19:19:08.764344 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.764312    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-89fc5cdcf-6slx5"]
Sep 11 19:19:08.774456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.774428    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.776742 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.776697    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 19:19:08.776883 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.776736    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 19:19:08.777072 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.777046    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8zlw\""
Sep 11 19:19:08.777679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.777659    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sx8dc"]
Sep 11 19:19:08.777778 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.777669    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 19:19:08.786729 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.786709    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 19:19:08.788690 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.788674    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-89fc5cdcf-6slx5"]
Sep 11 19:19:08.788767 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.788701    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w8mn9"]
Sep 11 19:19:08.788807 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.788781    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.792903 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.792885    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 19:19:08.793003 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.792904    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pjmhv\""
Sep 11 19:19:08.793003 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.792924    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 19:19:08.793003 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.792987    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 19:19:08.793235 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.793220    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 19:19:08.800987 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.800965    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sx8dc"]
Sep 11 19:19:08.801094 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.801047    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8mn9"
Sep 11 19:19:08.802372 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.802351    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8mn9"]
Sep 11 19:19:08.803381 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.803365    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 19:19:08.803481 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.803391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 19:19:08.803481 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.803371    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ndgb2\""
Sep 11 19:19:08.803587 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.803542    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 19:19:08.868548 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/361c652f-40af-4416-b0e2-1e1eff66d0bd-image-registry-private-configuration\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.868548 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361c652f-40af-4416-b0e2-1e1eff66d0bd-registry-tls\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.868798 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bece38e9-ee8b-4e74-ab87-e9216930c3b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.868798 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bece38e9-ee8b-4e74-ab87-e9216930c3b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.868798 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/361c652f-40af-4416-b0e2-1e1eff66d0bd-ca-trust-extracted\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.868798 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bece38e9-ee8b-4e74-ab87-e9216930c3b8-data-volume\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.868798 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/361c652f-40af-4416-b0e2-1e1eff66d0bd-registry-certificates\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.868798 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bece38e9-ee8b-4e74-ab87-e9216930c3b8-crio-socket\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.868798 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/361c652f-40af-4416-b0e2-1e1eff66d0bd-bound-sa-token\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.869050 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868801    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/361c652f-40af-4416-b0e2-1e1eff66d0bd-installation-pull-secrets\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.869050 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/361c652f-40af-4416-b0e2-1e1eff66d0bd-trusted-ca\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.869050 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868864    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cltg\" (UniqueName: \"kubernetes.io/projected/361c652f-40af-4416-b0e2-1e1eff66d0bd-kube-api-access-7cltg\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.869050 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.868906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh77t\" (UniqueName: \"kubernetes.io/projected/bece38e9-ee8b-4e74-ab87-e9216930c3b8-kube-api-access-vh77t\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.897674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.897640    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-56wnj"]
Sep 11 19:19:08.903189 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.903169    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:08.906134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.906113    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 19:19:08.906260 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.906244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-257h7\""
Sep 11 19:19:08.906357 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.906315    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 19:19:08.912412 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.912387    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-56wnj"]
Sep 11 19:19:08.969619 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/361c652f-40af-4416-b0e2-1e1eff66d0bd-image-registry-private-configuration\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.969619 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361c652f-40af-4416-b0e2-1e1eff66d0bd-registry-tls\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.969619 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bece38e9-ee8b-4e74-ab87-e9216930c3b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.969619 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bece38e9-ee8b-4e74-ab87-e9216930c3b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.969902 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/361c652f-40af-4416-b0e2-1e1eff66d0bd-ca-trust-extracted\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.969902 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bece38e9-ee8b-4e74-ab87-e9216930c3b8-data-volume\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.969902 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54d0f78c-cc1a-4148-9a69-55dc9097f176-cert\") pod \"ingress-canary-w8mn9\" (UID: \"54d0f78c-cc1a-4148-9a69-55dc9097f176\") " pod="openshift-ingress-canary/ingress-canary-w8mn9"
Sep 11 19:19:08.969902 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969882    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/361c652f-40af-4416-b0e2-1e1eff66d0bd-registry-certificates\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.970100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bece38e9-ee8b-4e74-ab87-e9216930c3b8-crio-socket\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.970100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pgpp\" (UniqueName: \"kubernetes.io/projected/54d0f78c-cc1a-4148-9a69-55dc9097f176-kube-api-access-6pgpp\") pod \"ingress-canary-w8mn9\" (UID: \"54d0f78c-cc1a-4148-9a69-55dc9097f176\") " pod="openshift-ingress-canary/ingress-canary-w8mn9"
Sep 11 19:19:08.970100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.969980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/361c652f-40af-4416-b0e2-1e1eff66d0bd-bound-sa-token\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.970100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.970024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/361c652f-40af-4416-b0e2-1e1eff66d0bd-installation-pull-secrets\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.970100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.970032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bece38e9-ee8b-4e74-ab87-e9216930c3b8-data-volume\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.970100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.970062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/361c652f-40af-4416-b0e2-1e1eff66d0bd-trusted-ca\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.970100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.970092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cltg\" (UniqueName: \"kubernetes.io/projected/361c652f-40af-4416-b0e2-1e1eff66d0bd-kube-api-access-7cltg\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.970505 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.970121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh77t\" (UniqueName: \"kubernetes.io/projected/bece38e9-ee8b-4e74-ab87-e9216930c3b8-kube-api-access-vh77t\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.970505 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.970141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/361c652f-40af-4416-b0e2-1e1eff66d0bd-ca-trust-extracted\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.970505 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.970217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bece38e9-ee8b-4e74-ab87-e9216930c3b8-crio-socket\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.970505 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.970344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bece38e9-ee8b-4e74-ab87-e9216930c3b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.970813 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.970792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/361c652f-40af-4416-b0e2-1e1eff66d0bd-registry-certificates\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.971663 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.971635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/361c652f-40af-4416-b0e2-1e1eff66d0bd-trusted-ca\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.973984 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.973959    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/361c652f-40af-4416-b0e2-1e1eff66d0bd-installation-pull-secrets\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.974065 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.973993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bece38e9-ee8b-4e74-ab87-e9216930c3b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.974164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.974143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361c652f-40af-4416-b0e2-1e1eff66d0bd-registry-tls\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.974200 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.974145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/361c652f-40af-4416-b0e2-1e1eff66d0bd-image-registry-private-configuration\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.988190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.988167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cltg\" (UniqueName: \"kubernetes.io/projected/361c652f-40af-4416-b0e2-1e1eff66d0bd-kube-api-access-7cltg\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.988310 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.988193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh77t\" (UniqueName: \"kubernetes.io/projected/bece38e9-ee8b-4e74-ab87-e9216930c3b8-kube-api-access-vh77t\") pod \"insights-runtime-extractor-sx8dc\" (UID: \"bece38e9-ee8b-4e74-ab87-e9216930c3b8\") " pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:08.989163 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.989144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/361c652f-40af-4416-b0e2-1e1eff66d0bd-bound-sa-token\") pod \"image-registry-89fc5cdcf-6slx5\" (UID: \"361c652f-40af-4416-b0e2-1e1eff66d0bd\") " pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:08.989445 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:08.989427    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-75scj"]
Sep 11 19:19:09.003468 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.003450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-75scj"
Sep 11 19:19:09.005299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.005252    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-75scj"]
Sep 11 19:19:09.005814 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.005793    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 19:19:09.005890 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.005877    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 19:19:09.006443 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.006421    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ffgxx\""
Sep 11 19:19:09.070837 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.070797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr55d\" (UniqueName: \"kubernetes.io/projected/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-kube-api-access-sr55d\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.071041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.070886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54d0f78c-cc1a-4148-9a69-55dc9097f176-cert\") pod \"ingress-canary-w8mn9\" (UID: \"54d0f78c-cc1a-4148-9a69-55dc9097f176\") " pod="openshift-ingress-canary/ingress-canary-w8mn9"
Sep 11 19:19:09.071041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.070913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-config-volume\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.071041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.070940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pgpp\" (UniqueName: \"kubernetes.io/projected/54d0f78c-cc1a-4148-9a69-55dc9097f176-kube-api-access-6pgpp\") pod \"ingress-canary-w8mn9\" (UID: \"54d0f78c-cc1a-4148-9a69-55dc9097f176\") " pod="openshift-ingress-canary/ingress-canary-w8mn9"
Sep 11 19:19:09.071041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.070979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-metrics-tls\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.071041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.071020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-tmp-dir\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.073138 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.073112    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54d0f78c-cc1a-4148-9a69-55dc9097f176-cert\") pod \"ingress-canary-w8mn9\" (UID: \"54d0f78c-cc1a-4148-9a69-55dc9097f176\") " pod="openshift-ingress-canary/ingress-canary-w8mn9"
Sep 11 19:19:09.083808 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.083787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pgpp\" (UniqueName: \"kubernetes.io/projected/54d0f78c-cc1a-4148-9a69-55dc9097f176-kube-api-access-6pgpp\") pod \"ingress-canary-w8mn9\" (UID: \"54d0f78c-cc1a-4148-9a69-55dc9097f176\") " pod="openshift-ingress-canary/ingress-canary-w8mn9"
Sep 11 19:19:09.084599 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.084582    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:09.096846 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.096830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sx8dc"
Sep 11 19:19:09.110492 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.110471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8mn9"
Sep 11 19:19:09.172247 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.172208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ktdm\" (UniqueName: \"kubernetes.io/projected/284549c4-5036-4a74-b144-b265e34943b7-kube-api-access-2ktdm\") pod \"downloads-76f99584f4-75scj\" (UID: \"284549c4-5036-4a74-b144-b265e34943b7\") " pod="openshift-console/downloads-76f99584f4-75scj"
Sep 11 19:19:09.172412 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.172273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-config-volume\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.172412 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.172318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-metrics-tls\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.172412 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.172347    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-tmp-dir\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.172575 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.172425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr55d\" (UniqueName: \"kubernetes.io/projected/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-kube-api-access-sr55d\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.174293 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.173345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-config-volume\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.174293 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.173848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-tmp-dir\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.176101 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.176057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-metrics-tls\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.181407 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.181379    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr55d\" (UniqueName: \"kubernetes.io/projected/fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909-kube-api-access-sr55d\") pod \"dns-default-56wnj\" (UID: \"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909\") " pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.211613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.211585    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:09.274075 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.274029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ktdm\" (UniqueName: \"kubernetes.io/projected/284549c4-5036-4a74-b144-b265e34943b7-kube-api-access-2ktdm\") pod \"downloads-76f99584f4-75scj\" (UID: \"284549c4-5036-4a74-b144-b265e34943b7\") " pod="openshift-console/downloads-76f99584f4-75scj"
Sep 11 19:19:09.283435 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.283414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ktdm\" (UniqueName: \"kubernetes.io/projected/284549c4-5036-4a74-b144-b265e34943b7-kube-api-access-2ktdm\") pod \"downloads-76f99584f4-75scj\" (UID: \"284549c4-5036-4a74-b144-b265e34943b7\") " pod="openshift-console/downloads-76f99584f4-75scj"
Sep 11 19:19:09.316488 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.316465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-75scj"
Sep 11 19:19:09.398594 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.398560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sx8dc"]
Sep 11 19:19:09.404349 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.404323    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-89fc5cdcf-6slx5"]
Sep 11 19:19:09.408896 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:19:09.408870    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361c652f_40af_4416_b0e2_1e1eff66d0bd.slice/crio-e9bb8e01660fb35df1780be3b7dc03344661f8cd96a7cb813b14b5620ee339c1 WatchSource:0}: Error finding container e9bb8e01660fb35df1780be3b7dc03344661f8cd96a7cb813b14b5620ee339c1: Status 404 returned error can't find the container with id e9bb8e01660fb35df1780be3b7dc03344661f8cd96a7cb813b14b5620ee339c1
Sep 11 19:19:09.414233 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.414207    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8mn9"]
Sep 11 19:19:09.417702 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:19:09.417681    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d0f78c_cc1a_4148_9a69_55dc9097f176.slice/crio-3559a7045e5fa5c396a9aead99f6b1f5b360cb3cb6c121c6d55f813dbcd3d9f4 WatchSource:0}: Error finding container 3559a7045e5fa5c396a9aead99f6b1f5b360cb3cb6c121c6d55f813dbcd3d9f4: Status 404 returned error can't find the container with id 3559a7045e5fa5c396a9aead99f6b1f5b360cb3cb6c121c6d55f813dbcd3d9f4
Sep 11 19:19:09.442733 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.442709    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:19:09.445359 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.445340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 19:19:09.445727 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.445385    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ht26q\""
Sep 11 19:19:09.513043 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.513018    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-56wnj"]
Sep 11 19:19:09.515809 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:19:09.515767    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa482ecc_c1c1_4a8f_9ea3_73d0a8a13909.slice/crio-5edf4cd02ccd48dd09c7c8b25da251ed3dadf183e71c5387f5de401aa03ae378 WatchSource:0}: Error finding container 5edf4cd02ccd48dd09c7c8b25da251ed3dadf183e71c5387f5de401aa03ae378: Status 404 returned error can't find the container with id 5edf4cd02ccd48dd09c7c8b25da251ed3dadf183e71c5387f5de401aa03ae378
Sep 11 19:19:09.587135 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.587065    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-75scj"]
Sep 11 19:19:09.591081 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:19:09.591056    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284549c4_5036_4a74_b144_b265e34943b7.slice/crio-37dbe1ecb6d06822e834c37f6e15366fb289dfa119a3a83d5668462b4328c57e WatchSource:0}: Error finding container 37dbe1ecb6d06822e834c37f6e15366fb289dfa119a3a83d5668462b4328c57e: Status 404 returned error can't find the container with id 37dbe1ecb6d06822e834c37f6e15366fb289dfa119a3a83d5668462b4328c57e
Sep 11 19:19:09.687542 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.687504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56wnj" event={"ID":"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909","Type":"ContainerStarted","Data":"5edf4cd02ccd48dd09c7c8b25da251ed3dadf183e71c5387f5de401aa03ae378"}
Sep 11 19:19:09.689151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.689117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5" event={"ID":"361c652f-40af-4416-b0e2-1e1eff66d0bd","Type":"ContainerStarted","Data":"2aaee123aefbef3d846470938170a5ce41e07427ce3d7a1c38bf64e7c3df0866"}
Sep 11 19:19:09.689323 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.689174    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5" event={"ID":"361c652f-40af-4416-b0e2-1e1eff66d0bd","Type":"ContainerStarted","Data":"e9bb8e01660fb35df1780be3b7dc03344661f8cd96a7cb813b14b5620ee339c1"}
Sep 11 19:19:09.689323 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.689202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:09.690429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.690400    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-75scj" event={"ID":"284549c4-5036-4a74-b144-b265e34943b7","Type":"ContainerStarted","Data":"37dbe1ecb6d06822e834c37f6e15366fb289dfa119a3a83d5668462b4328c57e"}
Sep 11 19:19:09.691572 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.691545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8mn9" event={"ID":"54d0f78c-cc1a-4148-9a69-55dc9097f176","Type":"ContainerStarted","Data":"3559a7045e5fa5c396a9aead99f6b1f5b360cb3cb6c121c6d55f813dbcd3d9f4"}
Sep 11 19:19:09.693008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.692984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sx8dc" event={"ID":"bece38e9-ee8b-4e74-ab87-e9216930c3b8","Type":"ContainerStarted","Data":"af19b29eae507f1362b91b4c205fe6461052df32f21493c44d76a1fab295fe42"}
Sep 11 19:19:09.693090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.693039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sx8dc" event={"ID":"bece38e9-ee8b-4e74-ab87-e9216930c3b8","Type":"ContainerStarted","Data":"86921cef5c4c749f84ed319c341e137dfe6169f5602226407662b889d087bd59"}
Sep 11 19:19:09.710521 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:09.710464    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5" podStartSLOduration=1.710445833 podStartE2EDuration="1.710445833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:09.709710674 +0000 UTC m=+49.730918844" watchObservedRunningTime="2026-09-11 19:19:09.710445833 +0000 UTC m=+49.731653986"
Sep 11 19:19:10.447804 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:10.447772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:19:10.448504 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:10.448394    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:19:10.452956 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:10.452733    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tdnq7\""
Sep 11 19:19:10.452956 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:10.452811    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 19:19:10.453120 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:10.453053    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 19:19:10.458263 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:10.457997    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 19:19:11.701579 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:11.701533    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sx8dc" event={"ID":"bece38e9-ee8b-4e74-ab87-e9216930c3b8","Type":"ContainerStarted","Data":"1184febc73bc033241d638fb21d15ee7911baf66e868625a69b3dc77da35d350"}
Sep 11 19:19:13.711213 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:13.711171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8mn9" event={"ID":"54d0f78c-cc1a-4148-9a69-55dc9097f176","Type":"ContainerStarted","Data":"794b9c8ac8bec7b914ceac622dc1ef455b1c6fe929f9a2da19c4359883888f4d"}
Sep 11 19:19:13.714180 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:13.713729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sx8dc" event={"ID":"bece38e9-ee8b-4e74-ab87-e9216930c3b8","Type":"ContainerStarted","Data":"69aba0120f134cb1e6d3f53dac2bfe6fe33ecdcabbe2c7b1859421e2da567a05"}
Sep 11 19:19:13.715703 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:13.715679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56wnj" event={"ID":"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909","Type":"ContainerStarted","Data":"44b067cb49f775ea42fccf1002de6a6b14ec3c7d8ce8f38c6009e939a3bed09e"}
Sep 11 19:19:13.715824 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:13.715726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56wnj" event={"ID":"fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909","Type":"ContainerStarted","Data":"74a3281d23da97753834c6cc1a6105d8bf90b0e693281b71dc83d51863b28bb2"}
Sep 11 19:19:13.715902 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:13.715884    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:13.729509 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:13.729456    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w8mn9" podStartSLOduration=2.318857564 podStartE2EDuration="5.72944213s" totalImagesPullingTime="3.410584566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:13.728042402 +0000 UTC m=+53.749250568" watchObservedRunningTime="2026-09-11 19:19:13.72944213 +0000 UTC m=+53.750650280"
Sep 11 19:19:13.743703 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:13.743654    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sx8dc" podStartSLOduration=2.547337406 podStartE2EDuration="5.743634781s" totalImagesPullingTime="3.196297375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:19:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:13.74263454 +0000 UTC m=+53.763842709" watchObservedRunningTime="2026-09-11 19:19:13.743634781 +0000 UTC m=+53.764842933"
Sep 11 19:19:13.759724 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:13.759681    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-56wnj" podStartSLOduration=2.459997111 podStartE2EDuration="5.759671723s" totalImagesPullingTime="3.299674612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:13.758399175 +0000 UTC m=+53.779607343" watchObservedRunningTime="2026-09-11 19:19:13.759671723 +0000 UTC m=+53.780879872"
Sep 11 19:19:19.103264 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.103228    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"]
Sep 11 19:19:19.106351 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.106325    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.108532 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.108510    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 19:19:19.108791 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.108770    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 19:19:19.109386 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.109363    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8q525\""
Sep 11 19:19:19.109484 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.109407    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 19:19:19.109552 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.109504    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 19:19:19.109698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.109679    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 19:19:19.117823 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.117799    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"]
Sep 11 19:19:19.252912 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.252876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.252912 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.252919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.253164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.252991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.253164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.253047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84ffd\" (UniqueName: \"kubernetes.io/projected/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-kube-api-access-84ffd\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.354234 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.354146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84ffd\" (UniqueName: \"kubernetes.io/projected/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-kube-api-access-84ffd\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.354234 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.354222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.354457 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.354253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.354457 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.354323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.354457 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:19.354376    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 11 19:19:19.354600 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:19.354458    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-prometheus-operator-tls podName:edab8b65-9034-4f75-87b0-f3e1af8aa1f8 nodeName:}" failed. No retries permitted until 2026-09-11 19:19:19.85443682 +0000 UTC m=+59.875644965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-dp9gq" (UID: "edab8b65-9034-4f75-87b0-f3e1af8aa1f8") : secret "prometheus-operator-tls" not found
Sep 11 19:19:19.355086 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.355063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.356921 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.356899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.365657 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.365630    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84ffd\" (UniqueName: \"kubernetes.io/projected/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-kube-api-access-84ffd\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.644135 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.644060    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q82hf"
Sep 11 19:19:19.857203 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.857163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:19.859792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:19.859767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/edab8b65-9034-4f75-87b0-f3e1af8aa1f8-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-dp9gq\" (UID: \"edab8b65-9034-4f75-87b0-f3e1af8aa1f8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:20.017188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:20.017145    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"
Sep 11 19:19:23.721139 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:23.721103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-56wnj"
Sep 11 19:19:26.198846 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.198802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:19:26.199257 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.198862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:19:26.201389 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.201363    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 19:19:26.201923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.201899    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 19:19:26.212264 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.212236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/847a1b73-fa57-436a-9371-74ea6c11f96a-original-pull-secret\") pod \"global-pull-secret-syncer-zgqpf\" (UID: \"847a1b73-fa57-436a-9371-74ea6c11f96a\") " pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:19:26.212403 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.212369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ad42a98-9354-4ba3-b14f-77e0c163a8d3-metrics-certs\") pod \"network-metrics-daemon-rhpw5\" (UID: \"7ad42a98-9354-4ba3-b14f-77e0c163a8d3\") " pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:19:26.270413 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.270385    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ht26q\""
Sep 11 19:19:26.279109 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.279081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhpw5"
Sep 11 19:19:26.299690 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.299588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shfp2\" (UniqueName: \"kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2\") pod \"network-check-target-psfqq\" (UID: \"1f8443a8-9b08-4339-987d-e18d010d46b7\") " pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:19:26.301923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.301904    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 19:19:26.312477 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.312457    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 19:19:26.323932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.323909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shfp2\" (UniqueName: \"kubernetes.io/projected/1f8443a8-9b08-4339-987d-e18d010d46b7-kube-api-access-shfp2\") pod \"network-check-target-psfqq\" (UID: \"1f8443a8-9b08-4339-987d-e18d010d46b7\") " pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:19:26.367936 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.367902    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tdnq7\""
Sep 11 19:19:26.373778 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.373753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zgqpf"
Sep 11 19:19:26.375692 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.375674    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:19:26.709030 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.708998    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rhpw5"]
Sep 11 19:19:26.712249 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:19:26.712165    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad42a98_9354_4ba3_b14f_77e0c163a8d3.slice/crio-c234f780548a81452a53428050c7e1d4b409218a59e001d1dfe8762a755b9a6c WatchSource:0}: Error finding container c234f780548a81452a53428050c7e1d4b409218a59e001d1dfe8762a755b9a6c: Status 404 returned error can't find the container with id c234f780548a81452a53428050c7e1d4b409218a59e001d1dfe8762a755b9a6c
Sep 11 19:19:26.713905 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.713820    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zgqpf"]
Sep 11 19:19:26.718177 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.717546    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-psfqq"]
Sep 11 19:19:26.718809 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.718601    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq"]
Sep 11 19:19:26.721253 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:19:26.721230    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8443a8_9b08_4339_987d_e18d010d46b7.slice/crio-08af51a88f1a583976d9ba90aab9f8347cb630dafadbb69195bd725ed3b5cd1e WatchSource:0}: Error finding container 08af51a88f1a583976d9ba90aab9f8347cb630dafadbb69195bd725ed3b5cd1e: Status 404 returned error can't find the container with id 08af51a88f1a583976d9ba90aab9f8347cb630dafadbb69195bd725ed3b5cd1e
Sep 11 19:19:26.722201 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:19:26.722169    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedab8b65_9034_4f75_87b0_f3e1af8aa1f8.slice/crio-576cc9fd4aff046e87d92f9a20b4a3117652250d81d100823e5410a5f56dfd10 WatchSource:0}: Error finding container 576cc9fd4aff046e87d92f9a20b4a3117652250d81d100823e5410a5f56dfd10: Status 404 returned error can't find the container with id 576cc9fd4aff046e87d92f9a20b4a3117652250d81d100823e5410a5f56dfd10
Sep 11 19:19:26.760446 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.760215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-75scj" event={"ID":"284549c4-5036-4a74-b144-b265e34943b7","Type":"ContainerStarted","Data":"03c3afe4ef8c3b644d50021f39790e052e409b532e9c11d53f218c8dd523f1ce"}
Sep 11 19:19:26.760559 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.760446    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-75scj"
Sep 11 19:19:26.762213 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.762182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zgqpf" event={"ID":"847a1b73-fa57-436a-9371-74ea6c11f96a","Type":"ContainerStarted","Data":"62c2a02bc8395910c4b26063c3ba021c4c7d0b7e649de10fe4ac2f6da10b4280"}
Sep 11 19:19:26.763566 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.763531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq" event={"ID":"edab8b65-9034-4f75-87b0-f3e1af8aa1f8","Type":"ContainerStarted","Data":"576cc9fd4aff046e87d92f9a20b4a3117652250d81d100823e5410a5f56dfd10"}
Sep 11 19:19:26.764829 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.764807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-psfqq" event={"ID":"1f8443a8-9b08-4339-987d-e18d010d46b7","Type":"ContainerStarted","Data":"08af51a88f1a583976d9ba90aab9f8347cb630dafadbb69195bd725ed3b5cd1e"}
Sep 11 19:19:26.765955 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.765936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rhpw5" event={"ID":"7ad42a98-9354-4ba3-b14f-77e0c163a8d3","Type":"ContainerStarted","Data":"c234f780548a81452a53428050c7e1d4b409218a59e001d1dfe8762a755b9a6c"}
Sep 11 19:19:26.769610 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.769579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-75scj"
Sep 11 19:19:26.776792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:26.776743    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-75scj" podStartSLOduration=1.845928925 podStartE2EDuration="18.776729385s" totalImagesPullingTime="16.93080046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:26.776434469 +0000 UTC m=+66.797642638" watchObservedRunningTime="2026-09-11 19:19:26.776729385 +0000 UTC m=+66.797937528"
Sep 11 19:19:29.804342 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:29.804200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq" event={"ID":"edab8b65-9034-4f75-87b0-f3e1af8aa1f8","Type":"ContainerStarted","Data":"d6a7c1c494e47287cc269a0fbf61889e9f99c9a38aa006b3384f5593f543fe5f"}
Sep 11 19:19:29.810873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:29.810758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rhpw5" event={"ID":"7ad42a98-9354-4ba3-b14f-77e0c163a8d3","Type":"ContainerStarted","Data":"2798676054a0d7bee31af9745ee863303c6996f35d5fca11aae96cf20262be15"}
Sep 11 19:19:30.702210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:30.702179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-89fc5cdcf-6slx5"
Sep 11 19:19:30.818991 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:30.818954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rhpw5" event={"ID":"7ad42a98-9354-4ba3-b14f-77e0c163a8d3","Type":"ContainerStarted","Data":"00b047b3304a1a0b25e5fc0ba11a85c955fccfb32b437eb42bedcbe82e03614a"}
Sep 11 19:19:30.821939 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:30.821909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq" event={"ID":"edab8b65-9034-4f75-87b0-f3e1af8aa1f8","Type":"ContainerStarted","Data":"c958da15ba8536ccc655bedd5ad7b3a19f2133082ff4c3c9882384b8dc078d46"}
Sep 11 19:19:30.845662 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:30.845017    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rhpw5" podStartSLOduration=68.061185299 podStartE2EDuration="1m10.844997736s" totalImagesPullingTime="2.783812437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:30.844875269 +0000 UTC m=+70.866083421" watchObservedRunningTime="2026-09-11 19:19:30.844997736 +0000 UTC m=+70.866205884"
Sep 11 19:19:30.867032 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:30.866519    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-dp9gq" podStartSLOduration=9.088067342 podStartE2EDuration="11.866500175s" totalImagesPullingTime="2.778432833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:30.865129019 +0000 UTC m=+70.886337193" watchObservedRunningTime="2026-09-11 19:19:30.866500175 +0000 UTC m=+70.887708325"
Sep 11 19:19:32.459614 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.459560    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7mqgw"]
Sep 11 19:19:32.484974 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.484939    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.487524 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.487492    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 19:19:32.487661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.487507    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6zjdh\""
Sep 11 19:19:32.487661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.487632    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 19:19:32.488025 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.488002    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 19:19:32.558661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.558621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.558853 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.558673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-textfile\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.558853 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.558749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wz7t\" (UniqueName: \"kubernetes.io/projected/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-kube-api-access-8wz7t\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.558853 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.558773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-tls\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.558853 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.558802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-sys\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.559067 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.558870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-wtmp\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.559067 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.558970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-metrics-client-ca\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.559067 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.559051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.559209 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.559098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-root\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.660528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-root\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.660593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.660622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-textfile\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.660649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wz7t\" (UniqueName: \"kubernetes.io/projected/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-kube-api-access-8wz7t\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.660678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-tls\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.660723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-sys\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.660752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-wtmp\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.660780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-metrics-client-ca\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.660945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-root\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.661025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.661572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-sys\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.661649    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.661713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.661650    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-wtmp\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.662486 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.661729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-textfile\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.662486 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.661781    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-metrics-client-ca\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.664945 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.664897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.665899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.665875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-node-exporter-tls\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.680321 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.680271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wz7t\" (UniqueName: \"kubernetes.io/projected/0eea0b7a-0603-484d-8b3a-e97d9a20c8f5-kube-api-access-8wz7t\") pod \"node-exporter-7mqgw\" (UID: \"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5\") " pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:32.798870 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:32.798591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7mqgw"
Sep 11 19:19:33.515608 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.515574    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:19:33.535749 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.535720    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:19:33.535938 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.535869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.538210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.538183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 19:19:33.538375 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.538349    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 19:19:33.538506 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.538474    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 19:19:33.539045 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.538562    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 19:19:33.539045 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.538581    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 19:19:33.539045 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.538359    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 19:19:33.539045 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.538693    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 19:19:33.539045 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.538808    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 19:19:33.539045 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.538889    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fdrlf\""
Sep 11 19:19:33.539045 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.538996    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 19:19:33.568674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.568638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-web-config\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.568835 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.568680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.568835 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.568751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.568835 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.568798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.568997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.568832    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlm48\" (UniqueName: \"kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-kube-api-access-zlm48\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.568997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.568897    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.568997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.568946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.568997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.568984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.569202 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.569024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-out\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.569202 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.569085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.569202 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.569120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.569202 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.569154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.569202 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.569180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670024 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.669985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-out\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-web-config\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670587 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670587 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670587 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlm48\" (UniqueName: \"kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-kube-api-access-zlm48\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670587 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670587 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.670820 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:33.670702    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-trusted-ca-bundle podName:d85f4a20-e43f-4ce7-baba-9d269470e75d nodeName:}" failed. No retries permitted until 2026-09-11 19:19:34.170676867 +0000 UTC m=+74.191885017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d") : configmap references non-existent config key: ca-bundle.crt
Sep 11 19:19:33.670820 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.670774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.671090 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:33.671058    2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 11 19:19:33.671202 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:19:33.671132    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-main-tls podName:d85f4a20-e43f-4ce7-baba-9d269470e75d nodeName:}" failed. No retries permitted until 2026-09-11 19:19:34.171115967 +0000 UTC m=+74.192324099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d") : secret "alertmanager-main-tls" not found
Sep 11 19:19:33.672237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.671967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.674226 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.674201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.674343 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.674201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-volume\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.674634 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.674608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.676215 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.676177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-out\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.676341 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.676238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.676519 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.676496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-web-config\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.677098 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.677077    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.677630 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.677607    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.678633 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.678614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlm48\" (UniqueName: \"kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-kube-api-access-zlm48\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:33.745901 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:19:33.745863    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eea0b7a_0603_484d_8b3a_e97d9a20c8f5.slice/crio-a9e9897b3722591888849ff5b0e215e79f3c92137abd54b8c968ba92e92eccd5 WatchSource:0}: Error finding container a9e9897b3722591888849ff5b0e215e79f3c92137abd54b8c968ba92e92eccd5: Status 404 returned error can't find the container with id a9e9897b3722591888849ff5b0e215e79f3c92137abd54b8c968ba92e92eccd5
Sep 11 19:19:33.839196 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:33.839115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mqgw" event={"ID":"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5","Type":"ContainerStarted","Data":"a9e9897b3722591888849ff5b0e215e79f3c92137abd54b8c968ba92e92eccd5"}
Sep 11 19:19:34.176138 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.176049    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:34.176325 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.176200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:34.177038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.177014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:34.179197 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.179169    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:34.447672 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.447634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:19:34.795716 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.795677    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:19:34.845176 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.845135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zgqpf" event={"ID":"847a1b73-fa57-436a-9371-74ea6c11f96a","Type":"ContainerStarted","Data":"38f7a4836981337f4a7000a911fc9fbd13f58e911339ca8a72b646f6caeeba96"}
Sep 11 19:19:34.847108 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.847077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-psfqq" event={"ID":"1f8443a8-9b08-4339-987d-e18d010d46b7","Type":"ContainerStarted","Data":"c067f4f8ae6a093110aca77adf7931f809e538f77b62cd644c8e55b7776906fd"}
Sep 11 19:19:34.847248 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.847224    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:19:34.863470 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.863400    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zgqpf" podStartSLOduration=67.826847562 podStartE2EDuration="1m14.863383258s" totalImagesPullingTime="7.036535696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:34.863212109 +0000 UTC m=+74.884420286" watchObservedRunningTime="2026-09-11 19:19:34.863383258 +0000 UTC m=+74.884591408"
Sep 11 19:19:34.879867 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:34.879795    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-psfqq" podStartSLOduration=67.861484954 podStartE2EDuration="1m14.879776357s" totalImagesPullingTime="7.018291403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:34.877857737 +0000 UTC m=+74.899065906" watchObservedRunningTime="2026-09-11 19:19:34.879776357 +0000 UTC m=+74.900984510"
Sep 11 19:19:35.852719 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:35.852680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerStarted","Data":"3714170c2bdf9e3a3e0ac3ac7a4332ee355ab3715d3ec2016a805ea86b063f96"}
Sep 11 19:19:35.854651 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:35.854623    2580 generic.go:356] "Generic (PLEG): container finished" podID="0eea0b7a-0603-484d-8b3a-e97d9a20c8f5" containerID="8a8fa4ea2cadc37e593b365fdc08f189456ed7f9e8bac65d7af8ae41617a2b03" exitCode=0
Sep 11 19:19:35.854786 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:35.854693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mqgw" event={"ID":"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5","Type":"ContainerDied","Data":"8a8fa4ea2cadc37e593b365fdc08f189456ed7f9e8bac65d7af8ae41617a2b03"}
Sep 11 19:19:36.860757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:36.860714    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mqgw" event={"ID":"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5","Type":"ContainerStarted","Data":"260529be3fdf212ec7c6ad443997d0d82dafd51b49dd0de2ec759b7d42f3b8cb"}
Sep 11 19:19:36.861167 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:36.860772    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mqgw" event={"ID":"0eea0b7a-0603-484d-8b3a-e97d9a20c8f5","Type":"ContainerStarted","Data":"1107d49cab9be41366910b0c98e733abc1a03836e1aac42511b5e0c225ba12c1"}
Sep 11 19:19:36.862307 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:36.862268    2580 generic.go:356] "Generic (PLEG): container finished" podID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerID="d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6" exitCode=0
Sep 11 19:19:36.862389 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:36.862350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerDied","Data":"d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6"}
Sep 11 19:19:36.879296 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:36.879187    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7mqgw" podStartSLOduration=3.256024848 podStartE2EDuration="4.879171873s" totalImagesPullingTime="1.54988114s" totalInitContainerRuntime="73.265885ms" isStatefulPod=true podCreationTimestamp="2026-09-11 19:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:36.878273749 +0000 UTC m=+76.899481912" watchObservedRunningTime="2026-09-11 19:19:36.879171873 +0000 UTC m=+76.900380054"
Sep 11 19:19:37.252369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.252331    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"]
Sep 11 19:19:37.274039 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.274004    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"]
Sep 11 19:19:37.274186 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.274123    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"
Sep 11 19:19:37.278414 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.278391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 19:19:37.278688 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.278670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ffpww\""
Sep 11 19:19:37.409632 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.409597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xztgx\" (UniqueName: \"kubernetes.io/projected/6e0a7e3b-185c-4f96-9472-d01b8df9ce7b-kube-api-access-xztgx\") pod \"monitoring-plugin-5d85778b9d-47tf6\" (UID: \"6e0a7e3b-185c-4f96-9472-d01b8df9ce7b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"
Sep 11 19:19:37.409812 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.409663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e0a7e3b-185c-4f96-9472-d01b8df9ce7b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-47tf6\" (UID: \"6e0a7e3b-185c-4f96-9472-d01b8df9ce7b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"
Sep 11 19:19:37.510651 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.510570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e0a7e3b-185c-4f96-9472-d01b8df9ce7b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-47tf6\" (UID: \"6e0a7e3b-185c-4f96-9472-d01b8df9ce7b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"
Sep 11 19:19:37.510651 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.510618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xztgx\" (UniqueName: \"kubernetes.io/projected/6e0a7e3b-185c-4f96-9472-d01b8df9ce7b-kube-api-access-xztgx\") pod \"monitoring-plugin-5d85778b9d-47tf6\" (UID: \"6e0a7e3b-185c-4f96-9472-d01b8df9ce7b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"
Sep 11 19:19:37.513061 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.513031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e0a7e3b-185c-4f96-9472-d01b8df9ce7b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-47tf6\" (UID: \"6e0a7e3b-185c-4f96-9472-d01b8df9ce7b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"
Sep 11 19:19:37.519153 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.519123    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xztgx\" (UniqueName: \"kubernetes.io/projected/6e0a7e3b-185c-4f96-9472-d01b8df9ce7b-kube-api-access-xztgx\") pod \"monitoring-plugin-5d85778b9d-47tf6\" (UID: \"6e0a7e3b-185c-4f96-9472-d01b8df9ce7b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"
Sep 11 19:19:37.583086 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.583047    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"
Sep 11 19:19:37.883199 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:37.883175    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"]
Sep 11 19:19:37.885715 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:19:37.885684    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0a7e3b_185c_4f96_9472_d01b8df9ce7b.slice/crio-775d1d81802b6e68dff5de015d258a9638420cf8e4c000aa315ec9dbcd159c5d WatchSource:0}: Error finding container 775d1d81802b6e68dff5de015d258a9638420cf8e4c000aa315ec9dbcd159c5d: Status 404 returned error can't find the container with id 775d1d81802b6e68dff5de015d258a9638420cf8e4c000aa315ec9dbcd159c5d
Sep 11 19:19:38.656438 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.656398    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cd96bc9bd-vlsqc"]
Sep 11 19:19:38.675738 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.674719    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd96bc9bd-vlsqc"]
Sep 11 19:19:38.675738 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.674835    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.677869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.677706    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ck5mr\""
Sep 11 19:19:38.677869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.677737    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 19:19:38.678055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.677981    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 19:19:38.678726 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.678678    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 19:19:38.678989 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.678974    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 19:19:38.680346 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.679784    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 19:19:38.684541 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.684340    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 19:19:38.721122 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.721082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-467jp\" (UniqueName: \"kubernetes.io/projected/fa8bc628-f15e-4db2-9bdc-21cb46538313-kube-api-access-467jp\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.721301 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.721158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-serving-cert\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.721301 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.721193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-service-ca\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.721301 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.721225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-oauth-config\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.721301 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.721248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-oauth-serving-cert\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.721523 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.721347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-trusted-ca-bundle\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.721523 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.721389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-config\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.822349 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.822308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-trusted-ca-bundle\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.822544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.822366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-config\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.822544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.822428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-467jp\" (UniqueName: \"kubernetes.io/projected/fa8bc628-f15e-4db2-9bdc-21cb46538313-kube-api-access-467jp\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.822544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.822484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-serving-cert\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.822544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.822516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-service-ca\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.822752 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.822547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-oauth-config\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.822752 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.822570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-oauth-serving-cert\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.823231 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.823196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-config\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.823347 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.823246    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-oauth-serving-cert\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.823419 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.823367    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-trusted-ca-bundle\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.823835 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.823816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-service-ca\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.828033 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.828004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-oauth-config\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.832875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.832847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-serving-cert\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.846549 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.846523    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-467jp\" (UniqueName: \"kubernetes.io/projected/fa8bc628-f15e-4db2-9bdc-21cb46538313-kube-api-access-467jp\") pod \"console-5cd96bc9bd-vlsqc\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") " pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:38.875179 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.875135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6" event={"ID":"6e0a7e3b-185c-4f96-9472-d01b8df9ce7b","Type":"ContainerStarted","Data":"775d1d81802b6e68dff5de015d258a9638420cf8e4c000aa315ec9dbcd159c5d"}
Sep 11 19:19:38.992612 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:38.992568    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:39.285575 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:39.285490    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd96bc9bd-vlsqc"]
Sep 11 19:19:39.655319 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:19:39.655231    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8bc628_f15e_4db2_9bdc_21cb46538313.slice/crio-7da292acf2372ad066133ab8527c8fef6c7cebb72fb018fcf3324ae78cf7b5e2 WatchSource:0}: Error finding container 7da292acf2372ad066133ab8527c8fef6c7cebb72fb018fcf3324ae78cf7b5e2: Status 404 returned error can't find the container with id 7da292acf2372ad066133ab8527c8fef6c7cebb72fb018fcf3324ae78cf7b5e2
Sep 11 19:19:39.880919 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:39.880880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerStarted","Data":"917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f"}
Sep 11 19:19:39.882112 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:39.882088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd96bc9bd-vlsqc" event={"ID":"fa8bc628-f15e-4db2-9bdc-21cb46538313","Type":"ContainerStarted","Data":"7da292acf2372ad066133ab8527c8fef6c7cebb72fb018fcf3324ae78cf7b5e2"}
Sep 11 19:19:40.889942 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:40.889902    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerStarted","Data":"638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e"}
Sep 11 19:19:40.890498 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:40.889987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerStarted","Data":"9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7"}
Sep 11 19:19:40.890498 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:40.890027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerStarted","Data":"5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d"}
Sep 11 19:19:40.890498 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:40.890069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerStarted","Data":"e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973"}
Sep 11 19:19:40.891941 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:40.891906    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6" event={"ID":"6e0a7e3b-185c-4f96-9472-d01b8df9ce7b","Type":"ContainerStarted","Data":"f825fceae3f097a1a95337bfa11707a8119106944202681c5c93478b0a5748c7"}
Sep 11 19:19:40.892233 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:40.892212    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"
Sep 11 19:19:40.898423 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:40.898399    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6"
Sep 11 19:19:40.907133 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:40.907086    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-47tf6" podStartSLOduration=1.812572366 podStartE2EDuration="3.907062091s" totalImagesPullingTime="2.094489725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:40.906838756 +0000 UTC m=+80.928046917" watchObservedRunningTime="2026-09-11 19:19:40.907062091 +0000 UTC m=+80.928270254"
Sep 11 19:19:43.907410 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:43.907364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerStarted","Data":"bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d"}
Sep 11 19:19:43.909012 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:43.908991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd96bc9bd-vlsqc" event={"ID":"fa8bc628-f15e-4db2-9bdc-21cb46538313","Type":"ContainerStarted","Data":"abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3"}
Sep 11 19:19:43.932760 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:43.932710    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.839084885 podStartE2EDuration="10.93269204s" totalImagesPullingTime="7.07347722s" totalInitContainerRuntime="20.129935ms" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:43.931967282 +0000 UTC m=+83.953175432" watchObservedRunningTime="2026-09-11 19:19:43.93269204 +0000 UTC m=+83.953900189"
Sep 11 19:19:43.949327 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:43.949246    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cd96bc9bd-vlsqc" podStartSLOduration=2.703844568 podStartE2EDuration="5.949224508s" totalImagesPullingTime="3.24537994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:43.947085242 +0000 UTC m=+83.968293419" watchObservedRunningTime="2026-09-11 19:19:43.949224508 +0000 UTC m=+83.970432659"
Sep 11 19:19:48.993138 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:48.993095    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:48.993680 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:48.993160    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:48.998073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:48.998046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:19:49.934594 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:19:49.934564    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:20:05.857295 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:05.857245    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-psfqq"
Sep 11 19:20:52.850614 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:52.850578    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:20:52.851120 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:52.850863    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="alertmanager" containerID="cri-o://917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f" gracePeriod=120
Sep 11 19:20:52.851120 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:52.850910    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy-metric" containerID="cri-o://638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e" gracePeriod=120
Sep 11 19:20:52.851120 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:52.850969    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy-web" containerID="cri-o://5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d" gracePeriod=120
Sep 11 19:20:52.851120 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:52.850984    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="prom-label-proxy" containerID="cri-o://bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d" gracePeriod=120
Sep 11 19:20:52.851120 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:52.851040    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy" containerID="cri-o://9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7" gracePeriod=120
Sep 11 19:20:52.851120 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:52.851061    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="config-reloader" containerID="cri-o://e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973" gracePeriod=120
Sep 11 19:20:53.168997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:53.168909    2580 generic.go:356] "Generic (PLEG): container finished" podID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerID="bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d" exitCode=0
Sep 11 19:20:53.168997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:53.168934    2580 generic.go:356] "Generic (PLEG): container finished" podID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerID="638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e" exitCode=0
Sep 11 19:20:53.168997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:53.168941    2580 generic.go:356] "Generic (PLEG): container finished" podID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerID="9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7" exitCode=0
Sep 11 19:20:53.168997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:53.168947    2580 generic.go:356] "Generic (PLEG): container finished" podID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerID="e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973" exitCode=0
Sep 11 19:20:53.168997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:53.168952    2580 generic.go:356] "Generic (PLEG): container finished" podID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerID="917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f" exitCode=0
Sep 11 19:20:53.168997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:53.168985    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerDied","Data":"bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d"}
Sep 11 19:20:53.169369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:53.169066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerDied","Data":"638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e"}
Sep 11 19:20:53.169369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:53.169105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerDied","Data":"9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7"}
Sep 11 19:20:53.169369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:53.169140    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerDied","Data":"e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973"}
Sep 11 19:20:53.169369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:53.169177    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerDied","Data":"917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f"}
Sep 11 19:20:54.094954 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.094927    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.177181 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.177103    2580 generic.go:356] "Generic (PLEG): container finished" podID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerID="5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d" exitCode=0
Sep 11 19:20:54.177337 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.177202    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.177337 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.177196    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerDied","Data":"5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d"}
Sep 11 19:20:54.177420 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.177402    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d85f4a20-e43f-4ce7-baba-9d269470e75d","Type":"ContainerDied","Data":"3714170c2bdf9e3a3e0ac3ac7a4332ee355ab3715d3ec2016a805ea86b063f96"}
Sep 11 19:20:54.177482 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.177469    2580 scope.go:117] "RemoveContainer" containerID="bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d"
Sep 11 19:20:54.185643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.185619    2580 scope.go:117] "RemoveContainer" containerID="638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e"
Sep 11 19:20:54.193960 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.193941    2580 scope.go:117] "RemoveContainer" containerID="9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7"
Sep 11 19:20:54.200096 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.200076    2580 scope.go:117] "RemoveContainer" containerID="5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d"
Sep 11 19:20:54.206314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.206276    2580 scope.go:117] "RemoveContainer" containerID="e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973"
Sep 11 19:20:54.206724 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.206706    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-out\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.206810 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.206749    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-main-db\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.206810 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.206776    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-tls-assets\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.206904 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.206818    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-web-config\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.206904 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.206884    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-volume\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.206977 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.206915    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-cluster-tls-config\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.206977 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.206945    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlm48\" (UniqueName: \"kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-kube-api-access-zlm48\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.207075 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.206976    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-main-tls\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.207075 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.207015    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-web\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.207075 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.207051    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-trusted-ca-bundle\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.207218 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.207074    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-metrics-client-ca\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.207218 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.207109    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.207407 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.207348    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:20:54.207835 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.207809    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy\") pod \"d85f4a20-e43f-4ce7-baba-9d269470e75d\" (UID: \"d85f4a20-e43f-4ce7-baba-9d269470e75d\") "
Sep 11 19:20:54.208096 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.208074    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-main-db\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.208328 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.208299    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:20:54.208538 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.208510    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:20:54.209966 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.209939    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-out" (OuterVolumeSpecName: "config-out") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:20:54.210270 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.210242    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:20:54.210640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.210601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:20:54.211091 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.211061    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-volume" (OuterVolumeSpecName: "config-volume") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:20:54.211183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.211155    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:20:54.211489 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.211460    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-kube-api-access-zlm48" (OuterVolumeSpecName: "kube-api-access-zlm48") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "kube-api-access-zlm48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:20:54.211876 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.211853    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:20:54.212148 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.212127    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:20:54.214141 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.214095    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:20:54.219973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.219948    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-web-config" (OuterVolumeSpecName: "web-config") pod "d85f4a20-e43f-4ce7-baba-9d269470e75d" (UID: "d85f4a20-e43f-4ce7-baba-9d269470e75d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:20:54.226891 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.226872    2580 scope.go:117] "RemoveContainer" containerID="917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f"
Sep 11 19:20:54.233450 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.233436    2580 scope.go:117] "RemoveContainer" containerID="d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6"
Sep 11 19:20:54.239830 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.239812    2580 scope.go:117] "RemoveContainer" containerID="bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d"
Sep 11 19:20:54.240103 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:20:54.240082    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d\": container with ID starting with bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d not found: ID does not exist" containerID="bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d"
Sep 11 19:20:54.240156 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.240112    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d"} err="failed to get container status \"bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d\": rpc error: code = NotFound desc = could not find container \"bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d\": container with ID starting with bd1d4904c6485afd75472831a9da17e9c0422eaa99b56838c64e7b0adf58151d not found: ID does not exist"
Sep 11 19:20:54.240156 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.240145    2580 scope.go:117] "RemoveContainer" containerID="638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e"
Sep 11 19:20:54.240428 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:20:54.240408    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e\": container with ID starting with 638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e not found: ID does not exist" containerID="638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e"
Sep 11 19:20:54.240508 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.240437    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e"} err="failed to get container status \"638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e\": rpc error: code = NotFound desc = could not find container \"638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e\": container with ID starting with 638b1bd3841026ca9788981735c5a948c40e9beba3e0a34828db202de744926e not found: ID does not exist"
Sep 11 19:20:54.240508 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.240460    2580 scope.go:117] "RemoveContainer" containerID="9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7"
Sep 11 19:20:54.240698 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:20:54.240684    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7\": container with ID starting with 9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7 not found: ID does not exist" containerID="9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7"
Sep 11 19:20:54.240733 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.240701    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7"} err="failed to get container status \"9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7\": rpc error: code = NotFound desc = could not find container \"9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7\": container with ID starting with 9b3921dcb143c7367802d99b69ddb1deae4ece4dacee686a88ff324220fa07e7 not found: ID does not exist"
Sep 11 19:20:54.240733 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.240713    2580 scope.go:117] "RemoveContainer" containerID="5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d"
Sep 11 19:20:54.240937 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:20:54.240921    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d\": container with ID starting with 5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d not found: ID does not exist" containerID="5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d"
Sep 11 19:20:54.240991 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.240942    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d"} err="failed to get container status \"5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d\": rpc error: code = NotFound desc = could not find container \"5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d\": container with ID starting with 5986cb0522bd192a4f424819def405d4c430d860a65f3ddb1408d3e82649782d not found: ID does not exist"
Sep 11 19:20:54.240991 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.240956    2580 scope.go:117] "RemoveContainer" containerID="e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973"
Sep 11 19:20:54.241169 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:20:54.241154    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973\": container with ID starting with e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973 not found: ID does not exist" containerID="e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973"
Sep 11 19:20:54.241211 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.241171    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973"} err="failed to get container status \"e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973\": rpc error: code = NotFound desc = could not find container \"e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973\": container with ID starting with e104a7f55a2d4eb7750a072a031cb7a376fe5a86032ca0c810f3fe86356ac973 not found: ID does not exist"
Sep 11 19:20:54.241211 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.241181    2580 scope.go:117] "RemoveContainer" containerID="917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f"
Sep 11 19:20:54.241441 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:20:54.241422    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f\": container with ID starting with 917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f not found: ID does not exist" containerID="917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f"
Sep 11 19:20:54.241512 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.241448    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f"} err="failed to get container status \"917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f\": rpc error: code = NotFound desc = could not find container \"917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f\": container with ID starting with 917e554e9a2fa2fafff5cecac0a34e11942708bd896e9cbed60185f12e77421f not found: ID does not exist"
Sep 11 19:20:54.241512 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.241468    2580 scope.go:117] "RemoveContainer" containerID="d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6"
Sep 11 19:20:54.241697 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:20:54.241677    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6\": container with ID starting with d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6 not found: ID does not exist" containerID="d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6"
Sep 11 19:20:54.241734 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.241701    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6"} err="failed to get container status \"d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6\": rpc error: code = NotFound desc = could not find container \"d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6\": container with ID starting with d5da128d79c4f0bb007e1bfa8ad9e1c7678c4a9937bc1759c4eae636fd52b5b6 not found: ID does not exist"
Sep 11 19:20:54.309043 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309008    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309043 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309036    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309043 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309047    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d85f4a20-e43f-4ce7-baba-9d269470e75d-metrics-client-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309058    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309067    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309076    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-out\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309083    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-tls-assets\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309091    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-web-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309098    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309106    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-cluster-tls-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309113    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlm48\" (UniqueName: \"kubernetes.io/projected/d85f4a20-e43f-4ce7-baba-9d269470e75d-kube-api-access-zlm48\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.309240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.309121    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d85f4a20-e43f-4ce7-baba-9d269470e75d-secret-alertmanager-main-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:20:54.497859 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.497815    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:20:54.501983 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.501960    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:20:54.527008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.526981    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:20:54.527212 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527198    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="init-config-reloader"
Sep 11 19:20:54.527212 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527211    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="init-config-reloader"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527220    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="alertmanager"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527225    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="alertmanager"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527234    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527239    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527248    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="config-reloader"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527253    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="config-reloader"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527263    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy-web"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527268    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy-web"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527274    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="prom-label-proxy"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527294    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="prom-label-proxy"
Sep 11 19:20:54.527308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527310    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy-metric"
Sep 11 19:20:54.527669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527318    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy-metric"
Sep 11 19:20:54.527669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527371    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy"
Sep 11 19:20:54.527669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527379    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="config-reloader"
Sep 11 19:20:54.527669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527385    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="prom-label-proxy"
Sep 11 19:20:54.527669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527391    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy-web"
Sep 11 19:20:54.527669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527398    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="alertmanager"
Sep 11 19:20:54.527669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.527403    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" containerName="kube-rbac-proxy-metric"
Sep 11 19:20:54.530622 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.530602    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.532783 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.532761    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 19:20:54.532872 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.532845    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 19:20:54.532872 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.532859    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fdrlf\""
Sep 11 19:20:54.532978 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.532845    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 19:20:54.532978 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.532895    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 19:20:54.533079 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.532976    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 19:20:54.533230 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.533211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 19:20:54.533230 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.533222    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 19:20:54.533381 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.533226    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 19:20:54.537953 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.537930    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 19:20:54.544388 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.544368    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:20:54.611981 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.611947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612161 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612161 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b61d33d-6794-4d34-8ef8-795585532be3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612161 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b61d33d-6794-4d34-8ef8-795585532be3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612161 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd9j4\" (UniqueName: \"kubernetes.io/projected/9b61d33d-6794-4d34-8ef8-795585532be3-kube-api-access-pd9j4\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612161 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612345 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612345 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b61d33d-6794-4d34-8ef8-795585532be3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612345 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b61d33d-6794-4d34-8ef8-795585532be3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612345 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b61d33d-6794-4d34-8ef8-795585532be3-config-out\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612345 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612489 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-web-config\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.612489 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.612403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.712940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.712868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.712940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.712910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b61d33d-6794-4d34-8ef8-795585532be3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.712944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b61d33d-6794-4d34-8ef8-795585532be3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.712968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd9j4\" (UniqueName: \"kubernetes.io/projected/9b61d33d-6794-4d34-8ef8-795585532be3-kube-api-access-pd9j4\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.713010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.713033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.713055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b61d33d-6794-4d34-8ef8-795585532be3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.713081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b61d33d-6794-4d34-8ef8-795585532be3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.713106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b61d33d-6794-4d34-8ef8-795585532be3-config-out\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.713132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.713158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-web-config\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.713188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.713224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.713695 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.713665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b61d33d-6794-4d34-8ef8-795585532be3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.715509 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.715480    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b61d33d-6794-4d34-8ef8-795585532be3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.716130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.716105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b61d33d-6794-4d34-8ef8-795585532be3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.716306 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.716269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.716387 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.716344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.716448 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.716412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b61d33d-6794-4d34-8ef8-795585532be3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.716448 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.716415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.716557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.716449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.716666 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.716642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b61d33d-6794-4d34-8ef8-795585532be3-config-out\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.716731 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.716714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.717708 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.717688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.717989 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.717975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b61d33d-6794-4d34-8ef8-795585532be3-web-config\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.721090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.721072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd9j4\" (UniqueName: \"kubernetes.io/projected/9b61d33d-6794-4d34-8ef8-795585532be3-kube-api-access-pd9j4\") pod \"alertmanager-main-0\" (UID: \"9b61d33d-6794-4d34-8ef8-795585532be3\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:54.840649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:54.840619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 19:20:55.113636 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:55.113603    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 19:20:55.115972 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:20:55.115942    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b61d33d_6794_4d34_8ef8_795585532be3.slice/crio-bfdd5c148f8363dbbaf1cf45cc1648ea26957414b452f4689c9f695ce52560ce WatchSource:0}: Error finding container bfdd5c148f8363dbbaf1cf45cc1648ea26957414b452f4689c9f695ce52560ce: Status 404 returned error can't find the container with id bfdd5c148f8363dbbaf1cf45cc1648ea26957414b452f4689c9f695ce52560ce
Sep 11 19:20:55.187674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:55.187635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b61d33d-6794-4d34-8ef8-795585532be3","Type":"ContainerStarted","Data":"89e37c567e83662c788edf2e71886041904820fcfbdfb6163e54da98aa2c8605"}
Sep 11 19:20:55.187842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:55.187756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b61d33d-6794-4d34-8ef8-795585532be3","Type":"ContainerStarted","Data":"bfdd5c148f8363dbbaf1cf45cc1648ea26957414b452f4689c9f695ce52560ce"}
Sep 11 19:20:56.193399 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.193364    2580 generic.go:356] "Generic (PLEG): container finished" podID="9b61d33d-6794-4d34-8ef8-795585532be3" containerID="89e37c567e83662c788edf2e71886041904820fcfbdfb6163e54da98aa2c8605" exitCode=0
Sep 11 19:20:56.193759 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.193451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b61d33d-6794-4d34-8ef8-795585532be3","Type":"ContainerDied","Data":"89e37c567e83662c788edf2e71886041904820fcfbdfb6163e54da98aa2c8605"}
Sep 11 19:20:56.448303 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.448261    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d85f4a20-e43f-4ce7-baba-9d269470e75d" path="/var/lib/kubelet/pods/d85f4a20-e43f-4ce7-baba-9d269470e75d/volumes"
Sep 11 19:20:56.879688 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.879594    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c7df65589-pvlq2"]
Sep 11 19:20:56.882031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.882008    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:56.886297 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.886260    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 19:20:56.886412 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.886360    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4pdtw\""
Sep 11 19:20:56.887046 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.887021    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 19:20:56.887484 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.887467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 19:20:56.891114 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.891095    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 19:20:56.891212 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.891130    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 19:20:56.903616 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.903597    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 19:20:56.938470 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:56.938438    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c7df65589-pvlq2"]
Sep 11 19:20:57.031085 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.031048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-secret-telemeter-client\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.031085 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.031086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.031335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.031114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-telemeter-client-tls\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.031335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.031134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.031335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.031189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-747xn\" (UniqueName: \"kubernetes.io/projected/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-kube-api-access-747xn\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.031335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.031230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-serving-certs-ca-bundle\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.031335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.031253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-metrics-client-ca\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.031335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.031307    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-federate-client-tls\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.131910 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.131822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-serving-certs-ca-bundle\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.131910 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.131859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-metrics-client-ca\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.131910 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.131883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-federate-client-tls\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.132162 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.131946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-secret-telemeter-client\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.132162 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.131970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.132162 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.131998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-telemeter-client-tls\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.132162 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.132021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.132162 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.132046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-747xn\" (UniqueName: \"kubernetes.io/projected/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-kube-api-access-747xn\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.133477 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.133445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-serving-certs-ca-bundle\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.134409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.133924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-metrics-client-ca\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.139332 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.134590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.139332 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.135062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-federate-client-tls\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.139332 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.135549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-secret-telemeter-client\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.140134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.140108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.140239 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.140142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-telemeter-client-tls\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.140321 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.140267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-747xn\" (UniqueName: \"kubernetes.io/projected/69ffd0ec-f29c-4cfa-968f-da59d1f403ad-kube-api-access-747xn\") pod \"telemeter-client-7c7df65589-pvlq2\" (UID: \"69ffd0ec-f29c-4cfa-968f-da59d1f403ad\") " pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.191631 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.191591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2"
Sep 11 19:20:57.203245 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.203221    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b61d33d-6794-4d34-8ef8-795585532be3","Type":"ContainerStarted","Data":"06dc243aab0865d1606e1d8364397465dbf15a8a8db786f719eb3fa46d3fc506"}
Sep 11 19:20:57.203557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.203337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b61d33d-6794-4d34-8ef8-795585532be3","Type":"ContainerStarted","Data":"619cfd5bb66ea036f02246642f6e967a63b7deb5cd86ea1f9348b7f7ddadb4ab"}
Sep 11 19:20:57.203557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.203383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b61d33d-6794-4d34-8ef8-795585532be3","Type":"ContainerStarted","Data":"ab0165a8fd967be6bac5c3eb76c6699453f23fec29e53de4ac3518d08d7f9dd6"}
Sep 11 19:20:57.203557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.203422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b61d33d-6794-4d34-8ef8-795585532be3","Type":"ContainerStarted","Data":"91ee9a5cfaa2dd4f005fcd306be1be2a9b04401f4b05217b7c82947ad9967ae8"}
Sep 11 19:20:57.203557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.203446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b61d33d-6794-4d34-8ef8-795585532be3","Type":"ContainerStarted","Data":"71bc69402a81d14d51ab4889608240759a4f82a2a6574550c08bbf35603e89c6"}
Sep 11 19:20:57.203557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.203469    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b61d33d-6794-4d34-8ef8-795585532be3","Type":"ContainerStarted","Data":"dfca32f92fa1fa12f466c559883807da31472ee34428eb985bd718f661d742e9"}
Sep 11 19:20:57.234726 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.234069    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.213498942 podStartE2EDuration="3.234046352s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.54741ms" isStatefulPod=false podCreationTimestamp="2026-09-11 19:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:20:57.231716632 +0000 UTC m=+157.252924801" watchObservedRunningTime="2026-09-11 19:20:57.234046352 +0000 UTC m=+157.255254504"
Sep 11 19:20:57.480809 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:57.480770    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c7df65589-pvlq2"]
Sep 11 19:20:57.484965 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:20:57.484918    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ffd0ec_f29c_4cfa_968f_da59d1f403ad.slice/crio-fd3f7a94a7569e8166c33f22b7c6a53dbf686115caef1bc9380de17878a89c38 WatchSource:0}: Error finding container fd3f7a94a7569e8166c33f22b7c6a53dbf686115caef1bc9380de17878a89c38: Status 404 returned error can't find the container with id fd3f7a94a7569e8166c33f22b7c6a53dbf686115caef1bc9380de17878a89c38
Sep 11 19:20:58.209804 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:20:58.209765    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2" event={"ID":"69ffd0ec-f29c-4cfa-968f-da59d1f403ad","Type":"ContainerStarted","Data":"fd3f7a94a7569e8166c33f22b7c6a53dbf686115caef1bc9380de17878a89c38"}
Sep 11 19:21:00.219138 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.219094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2" event={"ID":"69ffd0ec-f29c-4cfa-968f-da59d1f403ad","Type":"ContainerStarted","Data":"bfc0233bbcf160ad42bacec6a7dc14fe66f56ea91af826804a1d0917a10ab694"}
Sep 11 19:21:00.219595 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.219153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2" event={"ID":"69ffd0ec-f29c-4cfa-968f-da59d1f403ad","Type":"ContainerStarted","Data":"714df667847b8f9bfbd936bdafe3c6a0b88642a5af03ed55ce4b5edcda8ba27c"}
Sep 11 19:21:00.219595 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.219172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2" event={"ID":"69ffd0ec-f29c-4cfa-968f-da59d1f403ad","Type":"ContainerStarted","Data":"ae4c90f19a436363a3c80c32a2cf0461237d406b2b3237ef670415f4bee12606"}
Sep 11 19:21:00.242792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.242738    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c7df65589-pvlq2" podStartSLOduration=2.20395836 podStartE2EDuration="4.242721439s" totalImagesPullingTime="2.038763079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:21:00.241179133 +0000 UTC m=+160.262387282" watchObservedRunningTime="2026-09-11 19:21:00.242721439 +0000 UTC m=+160.263929588"
Sep 11 19:21:00.347959 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.347920    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77c8b94c78-wfclv"]
Sep 11 19:21:00.350095 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.350072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.371375 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.371348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c8b94c78-wfclv"]
Sep 11 19:21:00.460733 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.460700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-serving-cert\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.460733 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.460732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-service-ca\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.460938 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.460750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-oauth-serving-cert\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.460938 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.460767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-oauth-config\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.460938 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.460898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-config\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.461055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.460940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-trusted-ca-bundle\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.461055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.460957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djpl6\" (UniqueName: \"kubernetes.io/projected/6c5e189e-337c-487b-9b0b-3942efa4e3c2-kube-api-access-djpl6\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.561743 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.561640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-config\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.561743 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.561702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-trusted-ca-bundle\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.561743 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.561724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djpl6\" (UniqueName: \"kubernetes.io/projected/6c5e189e-337c-487b-9b0b-3942efa4e3c2-kube-api-access-djpl6\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.562028 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.561762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-serving-cert\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.562028 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.561782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-service-ca\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.562028 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.561805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-oauth-serving-cert\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.562028 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.561828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-oauth-config\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.562551 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.562520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-config\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.562687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.562617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-oauth-serving-cert\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.562687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.562628    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-service-ca\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.562687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.562647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-trusted-ca-bundle\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.564150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.564121    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-serving-cert\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.564270 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.564254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-oauth-config\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.569119 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.569097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djpl6\" (UniqueName: \"kubernetes.io/projected/6c5e189e-337c-487b-9b0b-3942efa4e3c2-kube-api-access-djpl6\") pod \"console-77c8b94c78-wfclv\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") " pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.659757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.659721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:00.930210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:00.930165    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c8b94c78-wfclv"]
Sep 11 19:21:00.933858 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:21:00.933827    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c5e189e_337c_487b_9b0b_3942efa4e3c2.slice/crio-4f0e8dc864ec84c0dbc123f1e73c6d805643bfa5472da907c0aac8ff4241f385 WatchSource:0}: Error finding container 4f0e8dc864ec84c0dbc123f1e73c6d805643bfa5472da907c0aac8ff4241f385: Status 404 returned error can't find the container with id 4f0e8dc864ec84c0dbc123f1e73c6d805643bfa5472da907c0aac8ff4241f385
Sep 11 19:21:01.224479 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:01.224388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c8b94c78-wfclv" event={"ID":"6c5e189e-337c-487b-9b0b-3942efa4e3c2","Type":"ContainerStarted","Data":"8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907"}
Sep 11 19:21:01.224479 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:01.224445    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c8b94c78-wfclv" event={"ID":"6c5e189e-337c-487b-9b0b-3942efa4e3c2","Type":"ContainerStarted","Data":"4f0e8dc864ec84c0dbc123f1e73c6d805643bfa5472da907c0aac8ff4241f385"}
Sep 11 19:21:01.246091 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:01.246037    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77c8b94c78-wfclv" podStartSLOduration=1.24601585 podStartE2EDuration="1.24601585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:21:01.24461163 +0000 UTC m=+161.265819781" watchObservedRunningTime="2026-09-11 19:21:01.24601585 +0000 UTC m=+161.267224001"
Sep 11 19:21:10.660370 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:10.660334    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:10.660758 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:10.660389    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:10.668986 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:10.665948    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:11.263405 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:11.263375    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:21:11.308425 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:11.308391    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd96bc9bd-vlsqc"]
Sep 11 19:21:36.331073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.331004    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cd96bc9bd-vlsqc" podUID="fa8bc628-f15e-4db2-9bdc-21cb46538313" containerName="console" containerID="cri-o://abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3" gracePeriod=15
Sep 11 19:21:36.566683 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.566658    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:21:36.633352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.633266    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-serving-cert\") pod \"fa8bc628-f15e-4db2-9bdc-21cb46538313\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") "
Sep 11 19:21:36.633352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.633332    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-467jp\" (UniqueName: \"kubernetes.io/projected/fa8bc628-f15e-4db2-9bdc-21cb46538313-kube-api-access-467jp\") pod \"fa8bc628-f15e-4db2-9bdc-21cb46538313\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") "
Sep 11 19:21:36.633352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.633350    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-trusted-ca-bundle\") pod \"fa8bc628-f15e-4db2-9bdc-21cb46538313\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") "
Sep 11 19:21:36.633603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.633369    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-oauth-serving-cert\") pod \"fa8bc628-f15e-4db2-9bdc-21cb46538313\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") "
Sep 11 19:21:36.633603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.633385    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-config\") pod \"fa8bc628-f15e-4db2-9bdc-21cb46538313\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") "
Sep 11 19:21:36.633603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.633418    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-oauth-config\") pod \"fa8bc628-f15e-4db2-9bdc-21cb46538313\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") "
Sep 11 19:21:36.633603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.633496    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-service-ca\") pod \"fa8bc628-f15e-4db2-9bdc-21cb46538313\" (UID: \"fa8bc628-f15e-4db2-9bdc-21cb46538313\") "
Sep 11 19:21:36.633851 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.633809    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fa8bc628-f15e-4db2-9bdc-21cb46538313" (UID: "fa8bc628-f15e-4db2-9bdc-21cb46538313"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:21:36.633851 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.633828    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-config" (OuterVolumeSpecName: "console-config") pod "fa8bc628-f15e-4db2-9bdc-21cb46538313" (UID: "fa8bc628-f15e-4db2-9bdc-21cb46538313"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:21:36.633954 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.633833    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fa8bc628-f15e-4db2-9bdc-21cb46538313" (UID: "fa8bc628-f15e-4db2-9bdc-21cb46538313"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:21:36.634089 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.634066    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-service-ca" (OuterVolumeSpecName: "service-ca") pod "fa8bc628-f15e-4db2-9bdc-21cb46538313" (UID: "fa8bc628-f15e-4db2-9bdc-21cb46538313"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:21:36.635496 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.635473    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fa8bc628-f15e-4db2-9bdc-21cb46538313" (UID: "fa8bc628-f15e-4db2-9bdc-21cb46538313"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:21:36.635574 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.635556    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fa8bc628-f15e-4db2-9bdc-21cb46538313" (UID: "fa8bc628-f15e-4db2-9bdc-21cb46538313"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:21:36.635634 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.635572    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8bc628-f15e-4db2-9bdc-21cb46538313-kube-api-access-467jp" (OuterVolumeSpecName: "kube-api-access-467jp") pod "fa8bc628-f15e-4db2-9bdc-21cb46538313" (UID: "fa8bc628-f15e-4db2-9bdc-21cb46538313"). InnerVolumeSpecName "kube-api-access-467jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:21:36.735089 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.735060    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-serving-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:21:36.735089 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.735084    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-467jp\" (UniqueName: \"kubernetes.io/projected/fa8bc628-f15e-4db2-9bdc-21cb46538313-kube-api-access-467jp\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:21:36.735089 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.735094    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-trusted-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:21:36.735272 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.735104    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-oauth-serving-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:21:36.735272 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.735112    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:21:36.735272 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.735120    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa8bc628-f15e-4db2-9bdc-21cb46538313-console-oauth-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:21:36.735272 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:36.735128    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8bc628-f15e-4db2-9bdc-21cb46538313-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:21:37.353071 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:37.353034    2580 generic.go:356] "Generic (PLEG): container finished" podID="fa8bc628-f15e-4db2-9bdc-21cb46538313" containerID="abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3" exitCode=0
Sep 11 19:21:37.353531 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:37.353076    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd96bc9bd-vlsqc"
Sep 11 19:21:37.353531 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:37.353126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd96bc9bd-vlsqc" event={"ID":"fa8bc628-f15e-4db2-9bdc-21cb46538313","Type":"ContainerDied","Data":"abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3"}
Sep 11 19:21:37.353531 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:37.353177    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd96bc9bd-vlsqc" event={"ID":"fa8bc628-f15e-4db2-9bdc-21cb46538313","Type":"ContainerDied","Data":"7da292acf2372ad066133ab8527c8fef6c7cebb72fb018fcf3324ae78cf7b5e2"}
Sep 11 19:21:37.353531 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:37.353203    2580 scope.go:117] "RemoveContainer" containerID="abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3"
Sep 11 19:21:37.361837 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:37.361819    2580 scope.go:117] "RemoveContainer" containerID="abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3"
Sep 11 19:21:37.362094 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:21:37.362076    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3\": container with ID starting with abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3 not found: ID does not exist" containerID="abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3"
Sep 11 19:21:37.362139 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:37.362102    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3"} err="failed to get container status \"abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3\": rpc error: code = NotFound desc = could not find container \"abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3\": container with ID starting with abf9e117a3ca2377c89ff0ff1b7c3703c80ab24280227ab05220aadd5cf938c3 not found: ID does not exist"
Sep 11 19:21:37.373382 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:37.373357    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd96bc9bd-vlsqc"]
Sep 11 19:21:37.376813 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:37.376792    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cd96bc9bd-vlsqc"]
Sep 11 19:21:38.447435 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:21:38.447402    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8bc628-f15e-4db2-9bdc-21cb46538313" path="/var/lib/kubelet/pods/fa8bc628-f15e-4db2-9bdc-21cb46538313/volumes"
Sep 11 19:22:08.994841 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:08.994808    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c686bd5f-t8pvk"]
Sep 11 19:22:08.995308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:08.995063    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8bc628-f15e-4db2-9bdc-21cb46538313" containerName="console"
Sep 11 19:22:08.995308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:08.995074    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8bc628-f15e-4db2-9bdc-21cb46538313" containerName="console"
Sep 11 19:22:08.995308 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:08.995129    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8bc628-f15e-4db2-9bdc-21cb46538313" containerName="console"
Sep 11 19:22:08.998014 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:08.997997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.011131 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.011107    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c686bd5f-t8pvk"]
Sep 11 19:22:09.098838 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.098802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-oauth-config\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.098982 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.098845    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-config\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.098982 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.098899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-oauth-serving-cert\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.098982 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.098966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-serving-cert\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.099102 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.098992    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-trusted-ca-bundle\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.099102 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.099007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cqjb\" (UniqueName: \"kubernetes.io/projected/d1f0eeea-258c-4502-94d9-f4282867ecb8-kube-api-access-8cqjb\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.099166 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.099105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-service-ca\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.199571 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.199537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-serving-cert\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.199571 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.199569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-trusted-ca-bundle\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.199776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.199585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cqjb\" (UniqueName: \"kubernetes.io/projected/d1f0eeea-258c-4502-94d9-f4282867ecb8-kube-api-access-8cqjb\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.199776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.199623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-service-ca\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.199776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.199653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-oauth-config\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.199776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.199666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-config\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.199776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.199686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-oauth-serving-cert\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.200459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.200430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-service-ca\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.200641 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.200466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-oauth-serving-cert\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.200641 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.200474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-config\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.200770 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.200533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-trusted-ca-bundle\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.202028 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.202008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-oauth-config\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.202165 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.202141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-serving-cert\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.207794 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.207767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cqjb\" (UniqueName: \"kubernetes.io/projected/d1f0eeea-258c-4502-94d9-f4282867ecb8-kube-api-access-8cqjb\") pod \"console-84c686bd5f-t8pvk\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") " pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.306813 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.306732    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:09.577119 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:09.576935    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c686bd5f-t8pvk"]
Sep 11 19:22:09.579658 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:22:09.579625    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f0eeea_258c_4502_94d9_f4282867ecb8.slice/crio-a3e3ad2194744605d265350e2c2f017d5b190f7650db3ed959b8d51bf1d84ee1 WatchSource:0}: Error finding container a3e3ad2194744605d265350e2c2f017d5b190f7650db3ed959b8d51bf1d84ee1: Status 404 returned error can't find the container with id a3e3ad2194744605d265350e2c2f017d5b190f7650db3ed959b8d51bf1d84ee1
Sep 11 19:22:10.475645 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:10.475605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c686bd5f-t8pvk" event={"ID":"d1f0eeea-258c-4502-94d9-f4282867ecb8","Type":"ContainerStarted","Data":"0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad"}
Sep 11 19:22:10.475645 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:10.475654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c686bd5f-t8pvk" event={"ID":"d1f0eeea-258c-4502-94d9-f4282867ecb8","Type":"ContainerStarted","Data":"a3e3ad2194744605d265350e2c2f017d5b190f7650db3ed959b8d51bf1d84ee1"}
Sep 11 19:22:10.494302 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:10.494246    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c686bd5f-t8pvk" podStartSLOduration=2.494231508 podStartE2EDuration="2.494231508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:22:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:22:10.493781107 +0000 UTC m=+230.514989295" watchObservedRunningTime="2026-09-11 19:22:10.494231508 +0000 UTC m=+230.515439658"
Sep 11 19:22:19.307297 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:19.307238    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:19.307704 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:19.307315    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:19.312034 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:19.312010    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:19.515641 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:19.515611    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:22:19.555908 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:19.555874    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c8b94c78-wfclv"]
Sep 11 19:22:44.575609 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.575504    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77c8b94c78-wfclv" podUID="6c5e189e-337c-487b-9b0b-3942efa4e3c2" containerName="console" containerID="cri-o://8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907" gracePeriod=15
Sep 11 19:22:44.811320 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.811270    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:22:44.855353 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.855255    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-oauth-config\") pod \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") "
Sep 11 19:22:44.855353 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.855329    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-service-ca\") pod \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") "
Sep 11 19:22:44.855557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.855356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-config\") pod \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") "
Sep 11 19:22:44.855557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.855386    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-trusted-ca-bundle\") pod \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") "
Sep 11 19:22:44.855557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.855440    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djpl6\" (UniqueName: \"kubernetes.io/projected/6c5e189e-337c-487b-9b0b-3942efa4e3c2-kube-api-access-djpl6\") pod \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") "
Sep 11 19:22:44.855557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.855468    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-serving-cert\") pod \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") "
Sep 11 19:22:44.855557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.855506    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-oauth-serving-cert\") pod \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\" (UID: \"6c5e189e-337c-487b-9b0b-3942efa4e3c2\") "
Sep 11 19:22:44.855785 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.855755    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "6c5e189e-337c-487b-9b0b-3942efa4e3c2" (UID: "6c5e189e-337c-487b-9b0b-3942efa4e3c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:22:44.856148 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.856114    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-config" (OuterVolumeSpecName: "console-config") pod "6c5e189e-337c-487b-9b0b-3942efa4e3c2" (UID: "6c5e189e-337c-487b-9b0b-3942efa4e3c2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:22:44.856401 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.856377    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6c5e189e-337c-487b-9b0b-3942efa4e3c2" (UID: "6c5e189e-337c-487b-9b0b-3942efa4e3c2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:22:44.856480 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.856411    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6c5e189e-337c-487b-9b0b-3942efa4e3c2" (UID: "6c5e189e-337c-487b-9b0b-3942efa4e3c2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:22:44.857695 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.857661    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6c5e189e-337c-487b-9b0b-3942efa4e3c2" (UID: "6c5e189e-337c-487b-9b0b-3942efa4e3c2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:22:44.857952 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.857926    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6c5e189e-337c-487b-9b0b-3942efa4e3c2" (UID: "6c5e189e-337c-487b-9b0b-3942efa4e3c2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:22:44.857952 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.857937    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c5e189e-337c-487b-9b0b-3942efa4e3c2-kube-api-access-djpl6" (OuterVolumeSpecName: "kube-api-access-djpl6") pod "6c5e189e-337c-487b-9b0b-3942efa4e3c2" (UID: "6c5e189e-337c-487b-9b0b-3942efa4e3c2"). InnerVolumeSpecName "kube-api-access-djpl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:22:44.956038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.956004    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djpl6\" (UniqueName: \"kubernetes.io/projected/6c5e189e-337c-487b-9b0b-3942efa4e3c2-kube-api-access-djpl6\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:22:44.956038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.956034    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-serving-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:22:44.956038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.956043    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-oauth-serving-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:22:44.956241 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.956051    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-oauth-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:22:44.956241 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.956060    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:22:44.956241 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.956069    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-console-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:22:44.956241 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:44.956076    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c5e189e-337c-487b-9b0b-3942efa4e3c2-trusted-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:22:45.600539 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:45.600502    2580 generic.go:356] "Generic (PLEG): container finished" podID="6c5e189e-337c-487b-9b0b-3942efa4e3c2" containerID="8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907" exitCode=0
Sep 11 19:22:45.600995 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:45.600555    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c8b94c78-wfclv"
Sep 11 19:22:45.600995 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:45.600600    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c8b94c78-wfclv" event={"ID":"6c5e189e-337c-487b-9b0b-3942efa4e3c2","Type":"ContainerDied","Data":"8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907"}
Sep 11 19:22:45.600995 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:45.600657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c8b94c78-wfclv" event={"ID":"6c5e189e-337c-487b-9b0b-3942efa4e3c2","Type":"ContainerDied","Data":"4f0e8dc864ec84c0dbc123f1e73c6d805643bfa5472da907c0aac8ff4241f385"}
Sep 11 19:22:45.600995 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:45.600689    2580 scope.go:117] "RemoveContainer" containerID="8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907"
Sep 11 19:22:45.611114 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:45.611099    2580 scope.go:117] "RemoveContainer" containerID="8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907"
Sep 11 19:22:45.611425 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:22:45.611407    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907\": container with ID starting with 8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907 not found: ID does not exist" containerID="8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907"
Sep 11 19:22:45.611494 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:45.611437    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907"} err="failed to get container status \"8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907\": rpc error: code = NotFound desc = could not find container \"8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907\": container with ID starting with 8340d1b8edc110c9202183738479b42b07764a15d33b3e105fa7589a83f9a907 not found: ID does not exist"
Sep 11 19:22:45.622693 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:45.622671    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c8b94c78-wfclv"]
Sep 11 19:22:45.626790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:45.626768    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77c8b94c78-wfclv"]
Sep 11 19:22:46.448299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:46.448250    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c5e189e-337c-487b-9b0b-3942efa4e3c2" path="/var/lib/kubelet/pods/6c5e189e-337c-487b-9b0b-3942efa4e3c2/volumes"
Sep 11 19:22:59.341438 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.341401    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"]
Sep 11 19:22:59.341823 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.341702    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c5e189e-337c-487b-9b0b-3942efa4e3c2" containerName="console"
Sep 11 19:22:59.341823 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.341713    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c5e189e-337c-487b-9b0b-3942efa4e3c2" containerName="console"
Sep 11 19:22:59.341823 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.341755    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c5e189e-337c-487b-9b0b-3942efa4e3c2" containerName="console"
Sep 11 19:22:59.346100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.346082    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.348580 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.348560    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 19:22:59.348753 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.348735    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jbdrn\""
Sep 11 19:22:59.349465 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.349446    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 19:22:59.354296 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.354265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"]
Sep 11 19:22:59.467063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.467005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7pw5\" (UniqueName: \"kubernetes.io/projected/191f7f61-057c-4218-b54b-5f8d01f536f8-kube-api-access-c7pw5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.467063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.467069    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.467326 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.467131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.568318 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.568266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7pw5\" (UniqueName: \"kubernetes.io/projected/191f7f61-057c-4218-b54b-5f8d01f536f8-kube-api-access-c7pw5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.568494 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.568325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.568494 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.568378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.568698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.568674    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.568698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.568689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.577492 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.577469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7pw5\" (UniqueName: \"kubernetes.io/projected/191f7f61-057c-4218-b54b-5f8d01f536f8-kube-api-access-c7pw5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.655871 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.655796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:22:59.925845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:22:59.925773    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"]
Sep 11 19:22:59.929632 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:22:59.929606    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191f7f61_057c_4218_b54b_5f8d01f536f8.slice/crio-3cf3dbacac6536b71861eb685f1578b67798e3c96905d0479ffc128ccde4701c WatchSource:0}: Error finding container 3cf3dbacac6536b71861eb685f1578b67798e3c96905d0479ffc128ccde4701c: Status 404 returned error can't find the container with id 3cf3dbacac6536b71861eb685f1578b67798e3c96905d0479ffc128ccde4701c
Sep 11 19:23:00.655532 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:00.655493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4" event={"ID":"191f7f61-057c-4218-b54b-5f8d01f536f8","Type":"ContainerStarted","Data":"3cf3dbacac6536b71861eb685f1578b67798e3c96905d0479ffc128ccde4701c"}
Sep 11 19:23:06.680487 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:06.680451    2580 generic.go:356] "Generic (PLEG): container finished" podID="191f7f61-057c-4218-b54b-5f8d01f536f8" containerID="8a33672c927e8fc65233abd43cd30869728f4f15ee60c3fd32694a5c326949c0" exitCode=0
Sep 11 19:23:06.680848 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:06.680541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4" event={"ID":"191f7f61-057c-4218-b54b-5f8d01f536f8","Type":"ContainerDied","Data":"8a33672c927e8fc65233abd43cd30869728f4f15ee60c3fd32694a5c326949c0"}
Sep 11 19:23:09.693121 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:09.693089    2580 generic.go:356] "Generic (PLEG): container finished" podID="191f7f61-057c-4218-b54b-5f8d01f536f8" containerID="47a30867e6aa93ee725a0a175049d0fc64cdbcb1b07720ee64f9929ce250f291" exitCode=0
Sep 11 19:23:09.693535 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:09.693160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4" event={"ID":"191f7f61-057c-4218-b54b-5f8d01f536f8","Type":"ContainerDied","Data":"47a30867e6aa93ee725a0a175049d0fc64cdbcb1b07720ee64f9929ce250f291"}
Sep 11 19:23:17.727069 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:17.727038    2580 generic.go:356] "Generic (PLEG): container finished" podID="191f7f61-057c-4218-b54b-5f8d01f536f8" containerID="f5a8793b01e3b81f1df947acf1bc6d7404486b9c1a5744d1cb43a0d996968625" exitCode=0
Sep 11 19:23:17.727445 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:17.727101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4" event={"ID":"191f7f61-057c-4218-b54b-5f8d01f536f8","Type":"ContainerDied","Data":"f5a8793b01e3b81f1df947acf1bc6d7404486b9c1a5744d1cb43a0d996968625"}
Sep 11 19:23:18.854228 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:18.854205    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:23:19.030842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.030754    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-bundle\") pod \"191f7f61-057c-4218-b54b-5f8d01f536f8\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") "
Sep 11 19:23:19.030842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.030797    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-util\") pod \"191f7f61-057c-4218-b54b-5f8d01f536f8\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") "
Sep 11 19:23:19.031061 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.030863    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7pw5\" (UniqueName: \"kubernetes.io/projected/191f7f61-057c-4218-b54b-5f8d01f536f8-kube-api-access-c7pw5\") pod \"191f7f61-057c-4218-b54b-5f8d01f536f8\" (UID: \"191f7f61-057c-4218-b54b-5f8d01f536f8\") "
Sep 11 19:23:19.031478 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.031450    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-bundle" (OuterVolumeSpecName: "bundle") pod "191f7f61-057c-4218-b54b-5f8d01f536f8" (UID: "191f7f61-057c-4218-b54b-5f8d01f536f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:23:19.033040 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.033013    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/191f7f61-057c-4218-b54b-5f8d01f536f8-kube-api-access-c7pw5" (OuterVolumeSpecName: "kube-api-access-c7pw5") pod "191f7f61-057c-4218-b54b-5f8d01f536f8" (UID: "191f7f61-057c-4218-b54b-5f8d01f536f8"). InnerVolumeSpecName "kube-api-access-c7pw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:23:19.035191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.035164    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-util" (OuterVolumeSpecName: "util") pod "191f7f61-057c-4218-b54b-5f8d01f536f8" (UID: "191f7f61-057c-4218-b54b-5f8d01f536f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:23:19.132048 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.132005    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:23:19.132048 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.132042    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/191f7f61-057c-4218-b54b-5f8d01f536f8-util\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:23:19.132048 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.132052    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7pw5\" (UniqueName: \"kubernetes.io/projected/191f7f61-057c-4218-b54b-5f8d01f536f8-kube-api-access-c7pw5\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:23:19.735741 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.735712    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4"
Sep 11 19:23:19.735741 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.735723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w2hf4" event={"ID":"191f7f61-057c-4218-b54b-5f8d01f536f8","Type":"ContainerDied","Data":"3cf3dbacac6536b71861eb685f1578b67798e3c96905d0479ffc128ccde4701c"}
Sep 11 19:23:19.735933 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:19.735764    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cf3dbacac6536b71861eb685f1578b67798e3c96905d0479ffc128ccde4701c"
Sep 11 19:23:20.332089 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:20.332061    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:23:20.334299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:20.334263    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:23:20.338861 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:20.338844    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 19:23:27.441567 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.441532    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"]
Sep 11 19:23:27.443154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.441822    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="191f7f61-057c-4218-b54b-5f8d01f536f8" containerName="util"
Sep 11 19:23:27.443154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.441835    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="191f7f61-057c-4218-b54b-5f8d01f536f8" containerName="util"
Sep 11 19:23:27.443154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.441850    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="191f7f61-057c-4218-b54b-5f8d01f536f8" containerName="extract"
Sep 11 19:23:27.443154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.441855    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="191f7f61-057c-4218-b54b-5f8d01f536f8" containerName="extract"
Sep 11 19:23:27.443154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.441867    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="191f7f61-057c-4218-b54b-5f8d01f536f8" containerName="pull"
Sep 11 19:23:27.443154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.441873    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="191f7f61-057c-4218-b54b-5f8d01f536f8" containerName="pull"
Sep 11 19:23:27.443154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.441921    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="191f7f61-057c-4218-b54b-5f8d01f536f8" containerName="extract"
Sep 11 19:23:27.443531 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.443515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"
Sep 11 19:23:27.446003 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.445982    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5r8nx\""
Sep 11 19:23:27.446127 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.446022    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 19:23:27.446127 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.446036    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:23:27.459275 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.459253    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"]
Sep 11 19:23:27.479887 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.479859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt2vw\" (UniqueName: \"kubernetes.io/projected/a55a0307-ee4e-49f4-a39f-1d1dc4c4585b-kube-api-access-wt2vw\") pod \"cert-manager-operator-controller-manager-55c444bf86-m6ln8\" (UID: \"a55a0307-ee4e-49f4-a39f-1d1dc4c4585b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"
Sep 11 19:23:27.479990 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.479895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a55a0307-ee4e-49f4-a39f-1d1dc4c4585b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m6ln8\" (UID: \"a55a0307-ee4e-49f4-a39f-1d1dc4c4585b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"
Sep 11 19:23:27.580259 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.580226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt2vw\" (UniqueName: \"kubernetes.io/projected/a55a0307-ee4e-49f4-a39f-1d1dc4c4585b-kube-api-access-wt2vw\") pod \"cert-manager-operator-controller-manager-55c444bf86-m6ln8\" (UID: \"a55a0307-ee4e-49f4-a39f-1d1dc4c4585b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"
Sep 11 19:23:27.580259 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.580267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a55a0307-ee4e-49f4-a39f-1d1dc4c4585b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m6ln8\" (UID: \"a55a0307-ee4e-49f4-a39f-1d1dc4c4585b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"
Sep 11 19:23:27.580692 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.580673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a55a0307-ee4e-49f4-a39f-1d1dc4c4585b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m6ln8\" (UID: \"a55a0307-ee4e-49f4-a39f-1d1dc4c4585b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"
Sep 11 19:23:27.593495 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.593464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt2vw\" (UniqueName: \"kubernetes.io/projected/a55a0307-ee4e-49f4-a39f-1d1dc4c4585b-kube-api-access-wt2vw\") pod \"cert-manager-operator-controller-manager-55c444bf86-m6ln8\" (UID: \"a55a0307-ee4e-49f4-a39f-1d1dc4c4585b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"
Sep 11 19:23:27.753891 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:27.753798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"
Sep 11 19:23:28.034684 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:28.034658    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8"]
Sep 11 19:23:28.037538 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:23:28.037512    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55a0307_ee4e_49f4_a39f_1d1dc4c4585b.slice/crio-6214397752fe7f8d4b46526ea8e56ec83c2113ae451d70b5ca1d162d4b58a56e WatchSource:0}: Error finding container 6214397752fe7f8d4b46526ea8e56ec83c2113ae451d70b5ca1d162d4b58a56e: Status 404 returned error can't find the container with id 6214397752fe7f8d4b46526ea8e56ec83c2113ae451d70b5ca1d162d4b58a56e
Sep 11 19:23:28.039908 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:28.039891    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:23:28.770368 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:28.770334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8" event={"ID":"a55a0307-ee4e-49f4-a39f-1d1dc4c4585b","Type":"ContainerStarted","Data":"6214397752fe7f8d4b46526ea8e56ec83c2113ae451d70b5ca1d162d4b58a56e"}
Sep 11 19:23:30.781241 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:30.781192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8" event={"ID":"a55a0307-ee4e-49f4-a39f-1d1dc4c4585b","Type":"ContainerStarted","Data":"223654b97317620f2353e0f3e021b68fa06c99288161f2b702c6d481c786c8aa"}
Sep 11 19:23:30.802434 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:30.802386    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m6ln8" podStartSLOduration=1.7489661619999999 podStartE2EDuration="3.802366413s" totalImagesPullingTime="2.053400251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:23:30.800664575 +0000 UTC m=+310.821872735" watchObservedRunningTime="2026-09-11 19:23:30.802366413 +0000 UTC m=+310.823574563"
Sep 11 19:23:31.882300 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:31.882250    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"]
Sep 11 19:23:31.884439 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:31.884421    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:31.886906 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:31.886884    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 19:23:31.887023 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:31.886937    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jbdrn\""
Sep 11 19:23:31.887818 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:31.887803    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 19:23:31.895110 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:31.895089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"]
Sep 11 19:23:31.907186 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:31.907164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:31.907312 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:31.907208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfwnl\" (UniqueName: \"kubernetes.io/projected/586b8e2b-00d8-45ed-b10b-4dd27b331d44-kube-api-access-zfwnl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:31.907312 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:31.907239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:32.008269 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.008228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:32.008459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.008314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfwnl\" (UniqueName: \"kubernetes.io/projected/586b8e2b-00d8-45ed-b10b-4dd27b331d44-kube-api-access-zfwnl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:32.008459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.008342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:32.008680 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.008652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:32.008792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.008702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:32.022935 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.022908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfwnl\" (UniqueName: \"kubernetes.io/projected/586b8e2b-00d8-45ed-b10b-4dd27b331d44-kube-api-access-zfwnl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:32.193618 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.193584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:32.461536 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.461466    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"]
Sep 11 19:23:32.465002 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:23:32.464978    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586b8e2b_00d8_45ed_b10b_4dd27b331d44.slice/crio-6462eb9297a619a5a83dcc65abaf4a3617a72b2426a7e0b7b1d0f97ca9e70e9a WatchSource:0}: Error finding container 6462eb9297a619a5a83dcc65abaf4a3617a72b2426a7e0b7b1d0f97ca9e70e9a: Status 404 returned error can't find the container with id 6462eb9297a619a5a83dcc65abaf4a3617a72b2426a7e0b7b1d0f97ca9e70e9a
Sep 11 19:23:32.796209 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.796109    2580 generic.go:356] "Generic (PLEG): container finished" podID="586b8e2b-00d8-45ed-b10b-4dd27b331d44" containerID="9938f2968a413ebb1e3ed3596429a2cf5674022baa75628233170f13da14885f" exitCode=0
Sep 11 19:23:32.796209 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.796193    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6" event={"ID":"586b8e2b-00d8-45ed-b10b-4dd27b331d44","Type":"ContainerDied","Data":"9938f2968a413ebb1e3ed3596429a2cf5674022baa75628233170f13da14885f"}
Sep 11 19:23:32.796502 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:32.796242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6" event={"ID":"586b8e2b-00d8-45ed-b10b-4dd27b331d44","Type":"ContainerStarted","Data":"6462eb9297a619a5a83dcc65abaf4a3617a72b2426a7e0b7b1d0f97ca9e70e9a"}
Sep 11 19:23:33.559229 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.559190    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"]
Sep 11 19:23:33.561546 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.561525    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"
Sep 11 19:23:33.568001 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.567980    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 19:23:33.569029 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.568752    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 19:23:33.569029 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.568885    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5rz9b\""
Sep 11 19:23:33.581442 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.581418    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"]
Sep 11 19:23:33.619244 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.619216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ceb5ec98-71d0-4b1a-a94d-aa74decd3661-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4qnsh\" (UID: \"ceb5ec98-71d0-4b1a-a94d-aa74decd3661\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"
Sep 11 19:23:33.619412 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.619253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th22f\" (UniqueName: \"kubernetes.io/projected/ceb5ec98-71d0-4b1a-a94d-aa74decd3661-kube-api-access-th22f\") pod \"cert-manager-cainjector-559cdd8c87-4qnsh\" (UID: \"ceb5ec98-71d0-4b1a-a94d-aa74decd3661\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"
Sep 11 19:23:33.720180 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.720143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ceb5ec98-71d0-4b1a-a94d-aa74decd3661-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4qnsh\" (UID: \"ceb5ec98-71d0-4b1a-a94d-aa74decd3661\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"
Sep 11 19:23:33.720391 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.720198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th22f\" (UniqueName: \"kubernetes.io/projected/ceb5ec98-71d0-4b1a-a94d-aa74decd3661-kube-api-access-th22f\") pod \"cert-manager-cainjector-559cdd8c87-4qnsh\" (UID: \"ceb5ec98-71d0-4b1a-a94d-aa74decd3661\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"
Sep 11 19:23:33.729584 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.729550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ceb5ec98-71d0-4b1a-a94d-aa74decd3661-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4qnsh\" (UID: \"ceb5ec98-71d0-4b1a-a94d-aa74decd3661\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"
Sep 11 19:23:33.729732 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.729711    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th22f\" (UniqueName: \"kubernetes.io/projected/ceb5ec98-71d0-4b1a-a94d-aa74decd3661-kube-api-access-th22f\") pod \"cert-manager-cainjector-559cdd8c87-4qnsh\" (UID: \"ceb5ec98-71d0-4b1a-a94d-aa74decd3661\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"
Sep 11 19:23:33.883621 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:33.883538    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"
Sep 11 19:23:34.162976 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:34.162944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh"]
Sep 11 19:23:34.685948 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:23:34.685917    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podceb5ec98_71d0_4b1a_a94d_aa74decd3661.slice/crio-52ffc1fca1dfdee2acb8df44f6049025ba6cb9701af87b269de1b89c1c51202a WatchSource:0}: Error finding container 52ffc1fca1dfdee2acb8df44f6049025ba6cb9701af87b269de1b89c1c51202a: Status 404 returned error can't find the container with id 52ffc1fca1dfdee2acb8df44f6049025ba6cb9701af87b269de1b89c1c51202a
Sep 11 19:23:34.806206 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:34.806171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh" event={"ID":"ceb5ec98-71d0-4b1a-a94d-aa74decd3661","Type":"ContainerStarted","Data":"52ffc1fca1dfdee2acb8df44f6049025ba6cb9701af87b269de1b89c1c51202a"}
Sep 11 19:23:34.808151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:34.808127    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6" event={"ID":"586b8e2b-00d8-45ed-b10b-4dd27b331d44","Type":"ContainerStarted","Data":"9fc3fa5c4f3086a39d7010e5f107581a3112c0915f7a5cca0c6c5b9a53ef10e7"}
Sep 11 19:23:35.815341 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:35.815303    2580 generic.go:356] "Generic (PLEG): container finished" podID="586b8e2b-00d8-45ed-b10b-4dd27b331d44" containerID="9fc3fa5c4f3086a39d7010e5f107581a3112c0915f7a5cca0c6c5b9a53ef10e7" exitCode=0
Sep 11 19:23:35.815784 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:35.815386    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6" event={"ID":"586b8e2b-00d8-45ed-b10b-4dd27b331d44","Type":"ContainerDied","Data":"9fc3fa5c4f3086a39d7010e5f107581a3112c0915f7a5cca0c6c5b9a53ef10e7"}
Sep 11 19:23:36.823090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:36.823015    2580 generic.go:356] "Generic (PLEG): container finished" podID="586b8e2b-00d8-45ed-b10b-4dd27b331d44" containerID="283f4ea9fd2f992339cc549b716093f94a82a5ebfa1d652ce7e6728b4f99f8ce" exitCode=0
Sep 11 19:23:36.823090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:36.823060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6" event={"ID":"586b8e2b-00d8-45ed-b10b-4dd27b331d44","Type":"ContainerDied","Data":"283f4ea9fd2f992339cc549b716093f94a82a5ebfa1d652ce7e6728b4f99f8ce"}
Sep 11 19:23:37.828810 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:37.828773    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh" event={"ID":"ceb5ec98-71d0-4b1a-a94d-aa74decd3661","Type":"ContainerStarted","Data":"e7df737546e98bffa7629e1b87168d9b338c7254efdaf3b723c61d4a2b66872c"}
Sep 11 19:23:37.845392 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:37.845342    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4qnsh" podStartSLOduration=2.284902921 podStartE2EDuration="4.84532557s" totalImagesPullingTime="2.560422649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:23:37.844055085 +0000 UTC m=+317.865263237" watchObservedRunningTime="2026-09-11 19:23:37.84532557 +0000 UTC m=+317.866533719"
Sep 11 19:23:37.951603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:37.951579    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:38.054824 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.054794    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-util\") pod \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") "
Sep 11 19:23:38.054984 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.054861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-bundle\") pod \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") "
Sep 11 19:23:38.054984 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.054895    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfwnl\" (UniqueName: \"kubernetes.io/projected/586b8e2b-00d8-45ed-b10b-4dd27b331d44-kube-api-access-zfwnl\") pod \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\" (UID: \"586b8e2b-00d8-45ed-b10b-4dd27b331d44\") "
Sep 11 19:23:38.055240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.055218    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-bundle" (OuterVolumeSpecName: "bundle") pod "586b8e2b-00d8-45ed-b10b-4dd27b331d44" (UID: "586b8e2b-00d8-45ed-b10b-4dd27b331d44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:23:38.056906 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.056885    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/586b8e2b-00d8-45ed-b10b-4dd27b331d44-kube-api-access-zfwnl" (OuterVolumeSpecName: "kube-api-access-zfwnl") pod "586b8e2b-00d8-45ed-b10b-4dd27b331d44" (UID: "586b8e2b-00d8-45ed-b10b-4dd27b331d44"). InnerVolumeSpecName "kube-api-access-zfwnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:23:38.110816 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.110752    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-util" (OuterVolumeSpecName: "util") pod "586b8e2b-00d8-45ed-b10b-4dd27b331d44" (UID: "586b8e2b-00d8-45ed-b10b-4dd27b331d44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:23:38.155452 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.155416    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:23:38.155452 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.155452    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfwnl\" (UniqueName: \"kubernetes.io/projected/586b8e2b-00d8-45ed-b10b-4dd27b331d44-kube-api-access-zfwnl\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:23:38.155452 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.155462    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/586b8e2b-00d8-45ed-b10b-4dd27b331d44-util\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:23:38.834913 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.834829    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6"
Sep 11 19:23:38.834913 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.834843    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtxn6" event={"ID":"586b8e2b-00d8-45ed-b10b-4dd27b331d44","Type":"ContainerDied","Data":"6462eb9297a619a5a83dcc65abaf4a3617a72b2426a7e0b7b1d0f97ca9e70e9a"}
Sep 11 19:23:38.834913 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:38.834885    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6462eb9297a619a5a83dcc65abaf4a3617a72b2426a7e0b7b1d0f97ca9e70e9a"
Sep 11 19:23:41.361791 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.361757    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dzd65"]
Sep 11 19:23:41.362134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.362023    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586b8e2b-00d8-45ed-b10b-4dd27b331d44" containerName="pull"
Sep 11 19:23:41.362134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.362033    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="586b8e2b-00d8-45ed-b10b-4dd27b331d44" containerName="pull"
Sep 11 19:23:41.362134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.362050    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586b8e2b-00d8-45ed-b10b-4dd27b331d44" containerName="util"
Sep 11 19:23:41.362134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.362056    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="586b8e2b-00d8-45ed-b10b-4dd27b331d44" containerName="util"
Sep 11 19:23:41.362134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.362063    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586b8e2b-00d8-45ed-b10b-4dd27b331d44" containerName="extract"
Sep 11 19:23:41.362134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.362068    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="586b8e2b-00d8-45ed-b10b-4dd27b331d44" containerName="extract"
Sep 11 19:23:41.362134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.362111    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="586b8e2b-00d8-45ed-b10b-4dd27b331d44" containerName="extract"
Sep 11 19:23:41.367027 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.367011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dzd65"
Sep 11 19:23:41.369626 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.369607    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jz8js\""
Sep 11 19:23:41.374483 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.374459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dzd65"]
Sep 11 19:23:41.384514 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.384487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b3a6296-2341-4b2e-abc9-badaedb0c10f-bound-sa-token\") pod \"cert-manager-55b4d954d5-dzd65\" (UID: \"6b3a6296-2341-4b2e-abc9-badaedb0c10f\") " pod="cert-manager/cert-manager-55b4d954d5-dzd65"
Sep 11 19:23:41.384626 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.384538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzcrt\" (UniqueName: \"kubernetes.io/projected/6b3a6296-2341-4b2e-abc9-badaedb0c10f-kube-api-access-hzcrt\") pod \"cert-manager-55b4d954d5-dzd65\" (UID: \"6b3a6296-2341-4b2e-abc9-badaedb0c10f\") " pod="cert-manager/cert-manager-55b4d954d5-dzd65"
Sep 11 19:23:41.485040 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.484991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzcrt\" (UniqueName: \"kubernetes.io/projected/6b3a6296-2341-4b2e-abc9-badaedb0c10f-kube-api-access-hzcrt\") pod \"cert-manager-55b4d954d5-dzd65\" (UID: \"6b3a6296-2341-4b2e-abc9-badaedb0c10f\") " pod="cert-manager/cert-manager-55b4d954d5-dzd65"
Sep 11 19:23:41.485217 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.485082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b3a6296-2341-4b2e-abc9-badaedb0c10f-bound-sa-token\") pod \"cert-manager-55b4d954d5-dzd65\" (UID: \"6b3a6296-2341-4b2e-abc9-badaedb0c10f\") " pod="cert-manager/cert-manager-55b4d954d5-dzd65"
Sep 11 19:23:41.492924 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.492897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b3a6296-2341-4b2e-abc9-badaedb0c10f-bound-sa-token\") pod \"cert-manager-55b4d954d5-dzd65\" (UID: \"6b3a6296-2341-4b2e-abc9-badaedb0c10f\") " pod="cert-manager/cert-manager-55b4d954d5-dzd65"
Sep 11 19:23:41.493099 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.493079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzcrt\" (UniqueName: \"kubernetes.io/projected/6b3a6296-2341-4b2e-abc9-badaedb0c10f-kube-api-access-hzcrt\") pod \"cert-manager-55b4d954d5-dzd65\" (UID: \"6b3a6296-2341-4b2e-abc9-badaedb0c10f\") " pod="cert-manager/cert-manager-55b4d954d5-dzd65"
Sep 11 19:23:41.675870 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.675791    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dzd65"
Sep 11 19:23:41.945538 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:41.945507    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dzd65"]
Sep 11 19:23:41.948775 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:23:41.948750    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b3a6296_2341_4b2e_abc9_badaedb0c10f.slice/crio-3efe74b6a99cf260b46cba56682fedbe3a00e06a9f0ea30809474d59b99336d8 WatchSource:0}: Error finding container 3efe74b6a99cf260b46cba56682fedbe3a00e06a9f0ea30809474d59b99336d8: Status 404 returned error can't find the container with id 3efe74b6a99cf260b46cba56682fedbe3a00e06a9f0ea30809474d59b99336d8
Sep 11 19:23:42.853244 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:42.853209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dzd65" event={"ID":"6b3a6296-2341-4b2e-abc9-badaedb0c10f","Type":"ContainerStarted","Data":"dd67fe5a1e80494baf430ea28945576d07b57c75b82c0c20fa1d9c29b281d87e"}
Sep 11 19:23:42.853244 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:42.853249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dzd65" event={"ID":"6b3a6296-2341-4b2e-abc9-badaedb0c10f","Type":"ContainerStarted","Data":"3efe74b6a99cf260b46cba56682fedbe3a00e06a9f0ea30809474d59b99336d8"}
Sep 11 19:23:42.869936 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:42.869893    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dzd65" podStartSLOduration=1.869877601 podStartE2EDuration="1.869877601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:23:42.868683393 +0000 UTC m=+322.889891525" watchObservedRunningTime="2026-09-11 19:23:42.869877601 +0000 UTC m=+322.891085750"
Sep 11 19:23:50.819958 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:50.819921    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"]
Sep 11 19:23:50.841614 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:50.841583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"]
Sep 11 19:23:50.841743 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:50.841696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:50.844214 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:50.844192    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jbdrn\""
Sep 11 19:23:50.844343 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:50.844231    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 19:23:50.844343 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:50.844306    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 19:23:50.957644 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:50.957609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87kmn\" (UniqueName: \"kubernetes.io/projected/c7b61644-7339-4b66-b655-558364b85ccd-kube-api-access-87kmn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:50.957819 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:50.957650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:50.957819 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:50.957719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:51.058941 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.058900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87kmn\" (UniqueName: \"kubernetes.io/projected/c7b61644-7339-4b66-b655-558364b85ccd-kube-api-access-87kmn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:51.058941 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.058940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:51.059205 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.058969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:51.059373 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.059352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:51.059441 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.059410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:51.067745 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.067721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87kmn\" (UniqueName: \"kubernetes.io/projected/c7b61644-7339-4b66-b655-558364b85ccd-kube-api-access-87kmn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:51.151612 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.151528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:51.435664 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.435636    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"]
Sep 11 19:23:51.437355 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:23:51.437330    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b61644_7339_4b66_b655_558364b85ccd.slice/crio-345d359244cb59ef54cb6916a5d23885c0265d00d7b6b5cc2313d4edb19ffb35 WatchSource:0}: Error finding container 345d359244cb59ef54cb6916a5d23885c0265d00d7b6b5cc2313d4edb19ffb35: Status 404 returned error can't find the container with id 345d359244cb59ef54cb6916a5d23885c0265d00d7b6b5cc2313d4edb19ffb35
Sep 11 19:23:51.891080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.890985    2580 generic.go:356] "Generic (PLEG): container finished" podID="c7b61644-7339-4b66-b655-558364b85ccd" containerID="868d94639d3fa3c1011081589b77b0262fc36e225e3c5780cb39b34e72f05291" exitCode=0
Sep 11 19:23:51.891465 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.891075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml" event={"ID":"c7b61644-7339-4b66-b655-558364b85ccd","Type":"ContainerDied","Data":"868d94639d3fa3c1011081589b77b0262fc36e225e3c5780cb39b34e72f05291"}
Sep 11 19:23:51.891465 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:51.891140    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml" event={"ID":"c7b61644-7339-4b66-b655-558364b85ccd","Type":"ContainerStarted","Data":"345d359244cb59ef54cb6916a5d23885c0265d00d7b6b5cc2313d4edb19ffb35"}
Sep 11 19:23:52.897625 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:52.897587    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml" event={"ID":"c7b61644-7339-4b66-b655-558364b85ccd","Type":"ContainerStarted","Data":"1c46463fbc9985332d8b2e0d09e27e30044572f0dd57540a70d3562ca98792b2"}
Sep 11 19:23:53.904002 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:53.903967    2580 generic.go:356] "Generic (PLEG): container finished" podID="c7b61644-7339-4b66-b655-558364b85ccd" containerID="1c46463fbc9985332d8b2e0d09e27e30044572f0dd57540a70d3562ca98792b2" exitCode=0
Sep 11 19:23:53.904589 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:53.904049    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml" event={"ID":"c7b61644-7339-4b66-b655-558364b85ccd","Type":"ContainerDied","Data":"1c46463fbc9985332d8b2e0d09e27e30044572f0dd57540a70d3562ca98792b2"}
Sep 11 19:23:54.910616 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:54.910585    2580 generic.go:356] "Generic (PLEG): container finished" podID="c7b61644-7339-4b66-b655-558364b85ccd" containerID="e491be3af77308afbcc7c571536a32a3d9e872ab2efa3184fffbcc2ca4184370" exitCode=0
Sep 11 19:23:54.910991 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:54.910650    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml" event={"ID":"c7b61644-7339-4b66-b655-558364b85ccd","Type":"ContainerDied","Data":"e491be3af77308afbcc7c571536a32a3d9e872ab2efa3184fffbcc2ca4184370"}
Sep 11 19:23:56.034521 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.034494    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:56.097209 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.097184    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-bundle\") pod \"c7b61644-7339-4b66-b655-558364b85ccd\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") "
Sep 11 19:23:56.097372 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.097215    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87kmn\" (UniqueName: \"kubernetes.io/projected/c7b61644-7339-4b66-b655-558364b85ccd-kube-api-access-87kmn\") pod \"c7b61644-7339-4b66-b655-558364b85ccd\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") "
Sep 11 19:23:56.097372 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.097239    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-util\") pod \"c7b61644-7339-4b66-b655-558364b85ccd\" (UID: \"c7b61644-7339-4b66-b655-558364b85ccd\") "
Sep 11 19:23:56.097908 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.097885    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-bundle" (OuterVolumeSpecName: "bundle") pod "c7b61644-7339-4b66-b655-558364b85ccd" (UID: "c7b61644-7339-4b66-b655-558364b85ccd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:23:56.099304 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.099268    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b61644-7339-4b66-b655-558364b85ccd-kube-api-access-87kmn" (OuterVolumeSpecName: "kube-api-access-87kmn") pod "c7b61644-7339-4b66-b655-558364b85ccd" (UID: "c7b61644-7339-4b66-b655-558364b85ccd"). InnerVolumeSpecName "kube-api-access-87kmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:23:56.102801 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.102781    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-util" (OuterVolumeSpecName: "util") pod "c7b61644-7339-4b66-b655-558364b85ccd" (UID: "c7b61644-7339-4b66-b655-558364b85ccd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:23:56.198041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.198010    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:23:56.198041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.198036    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87kmn\" (UniqueName: \"kubernetes.io/projected/c7b61644-7339-4b66-b655-558364b85ccd-kube-api-access-87kmn\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:23:56.198041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.198045    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b61644-7339-4b66-b655-558364b85ccd-util\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:23:56.920699 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.920621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml" event={"ID":"c7b61644-7339-4b66-b655-558364b85ccd","Type":"ContainerDied","Data":"345d359244cb59ef54cb6916a5d23885c0265d00d7b6b5cc2313d4edb19ffb35"}
Sep 11 19:23:56.920699 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.920658    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkf4ml"
Sep 11 19:23:56.920874 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:23:56.920664    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="345d359244cb59ef54cb6916a5d23885c0265d00d7b6b5cc2313d4edb19ffb35"
Sep 11 19:24:03.441413 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.441363    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"]
Sep 11 19:24:03.441792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.441686    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b61644-7339-4b66-b655-558364b85ccd" containerName="pull"
Sep 11 19:24:03.441792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.441697    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b61644-7339-4b66-b655-558364b85ccd" containerName="pull"
Sep 11 19:24:03.441792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.441706    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b61644-7339-4b66-b655-558364b85ccd" containerName="util"
Sep 11 19:24:03.441792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.441711    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b61644-7339-4b66-b655-558364b85ccd" containerName="util"
Sep 11 19:24:03.441792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.441725    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b61644-7339-4b66-b655-558364b85ccd" containerName="extract"
Sep 11 19:24:03.441792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.441731    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b61644-7339-4b66-b655-558364b85ccd" containerName="extract"
Sep 11 19:24:03.441792 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.441778    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7b61644-7339-4b66-b655-558364b85ccd" containerName="extract"
Sep 11 19:24:03.444461 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.444436    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:03.446681 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.446654    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 19:24:03.447508 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.447488    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 19:24:03.447603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.447492    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jbdrn\""
Sep 11 19:24:03.454173 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.454148    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"]
Sep 11 19:24:03.560359 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.560321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwxhn\" (UniqueName: \"kubernetes.io/projected/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-kube-api-access-rwxhn\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:03.560558 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.560390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:03.560558 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.560434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:03.661762 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.661719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwxhn\" (UniqueName: \"kubernetes.io/projected/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-kube-api-access-rwxhn\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:03.661959 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.661783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:03.661959 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.661821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:03.662195 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.662173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:03.662267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.662184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:03.673074 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.673044    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwxhn\" (UniqueName: \"kubernetes.io/projected/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-kube-api-access-rwxhn\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:03.753773 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:03.753702    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:04.030622 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:04.030597    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"]
Sep 11 19:24:04.032758 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:24:04.032721    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4c9e0b_0464_4f9b_95b5_0db7ac024f45.slice/crio-3f8a535bfb19afff18991c020056a6662dd0847844e1b786e072db1208120cdf WatchSource:0}: Error finding container 3f8a535bfb19afff18991c020056a6662dd0847844e1b786e072db1208120cdf: Status 404 returned error can't find the container with id 3f8a535bfb19afff18991c020056a6662dd0847844e1b786e072db1208120cdf
Sep 11 19:24:04.957611 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:04.957580    2580 generic.go:356] "Generic (PLEG): container finished" podID="5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" containerID="a163476b6272bdfaacf23b4b22135859f7b4c0b87a6e58bdd41da6817d93c751" exitCode=0
Sep 11 19:24:04.958082 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:04.957642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6" event={"ID":"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45","Type":"ContainerDied","Data":"a163476b6272bdfaacf23b4b22135859f7b4c0b87a6e58bdd41da6817d93c751"}
Sep 11 19:24:04.958082 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:04.957674    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6" event={"ID":"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45","Type":"ContainerStarted","Data":"3f8a535bfb19afff18991c020056a6662dd0847844e1b786e072db1208120cdf"}
Sep 11 19:24:05.935401 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:05.935364    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"]
Sep 11 19:24:05.937659 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:05.937642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:05.940097 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:05.940076    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xtpql\""
Sep 11 19:24:05.940191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:05.940080    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 19:24:05.940191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:05.940081    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 19:24:05.940509 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:05.940494    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 19:24:05.941355 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:05.941338    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 19:24:05.958959 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:05.958931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"]
Sep 11 19:24:05.963706 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:05.963686    2580 generic.go:356] "Generic (PLEG): container finished" podID="5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" containerID="f896d03c2ca0e1bd32e31bf5ff48838e901ce133ca73e4fe701e9cf58b29d3dc" exitCode=0
Sep 11 19:24:05.963803 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:05.963733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6" event={"ID":"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45","Type":"ContainerDied","Data":"f896d03c2ca0e1bd32e31bf5ff48838e901ce133ca73e4fe701e9cf58b29d3dc"}
Sep 11 19:24:06.082984 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.082943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76gt8\" (UniqueName: \"kubernetes.io/projected/345ea90b-6123-47cd-9990-ac482ab3a475-kube-api-access-76gt8\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.082984 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.082987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/345ea90b-6123-47cd-9990-ac482ab3a475-tmp\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.083183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.083016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/345ea90b-6123-47cd-9990-ac482ab3a475-manifests\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.083183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.083096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345ea90b-6123-47cd-9990-ac482ab3a475-webhook-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.083183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.083135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/345ea90b-6123-47cd-9990-ac482ab3a475-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.184073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.184038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76gt8\" (UniqueName: \"kubernetes.io/projected/345ea90b-6123-47cd-9990-ac482ab3a475-kube-api-access-76gt8\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.184237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.184081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/345ea90b-6123-47cd-9990-ac482ab3a475-tmp\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.184237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.184114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/345ea90b-6123-47cd-9990-ac482ab3a475-manifests\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.184237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.184144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345ea90b-6123-47cd-9990-ac482ab3a475-webhook-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.184237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.184164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/345ea90b-6123-47cd-9990-ac482ab3a475-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.184665 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.184636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/345ea90b-6123-47cd-9990-ac482ab3a475-manifests\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.186544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.186492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/345ea90b-6123-47cd-9990-ac482ab3a475-tmp\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.186730 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.186706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/345ea90b-6123-47cd-9990-ac482ab3a475-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.186777 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.186712    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/345ea90b-6123-47cd-9990-ac482ab3a475-webhook-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.200293 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.200258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76gt8\" (UniqueName: \"kubernetes.io/projected/345ea90b-6123-47cd-9990-ac482ab3a475-kube-api-access-76gt8\") pod \"opendatahub-operator-controller-manager-6474799d6-bd7rk\" (UID: \"345ea90b-6123-47cd-9990-ac482ab3a475\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.248333 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.248300    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:06.524222 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.524196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"]
Sep 11 19:24:06.526194 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:24:06.526168    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345ea90b_6123_47cd_9990_ac482ab3a475.slice/crio-5b93a10d611b9d82796887fe8dca1cbc8b426fdc621c516ea08196c689bc1912 WatchSource:0}: Error finding container 5b93a10d611b9d82796887fe8dca1cbc8b426fdc621c516ea08196c689bc1912: Status 404 returned error can't find the container with id 5b93a10d611b9d82796887fe8dca1cbc8b426fdc621c516ea08196c689bc1912
Sep 11 19:24:06.969745 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.969706    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk" event={"ID":"345ea90b-6123-47cd-9990-ac482ab3a475","Type":"ContainerStarted","Data":"5b93a10d611b9d82796887fe8dca1cbc8b426fdc621c516ea08196c689bc1912"}
Sep 11 19:24:06.971759 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.971735    2580 generic.go:356] "Generic (PLEG): container finished" podID="5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" containerID="ffa4e827e4f7271be41aa01def10adf5aaf38d0adc3b2ecf61aeaa3580d4c050" exitCode=0
Sep 11 19:24:06.971865 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:06.971787    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6" event={"ID":"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45","Type":"ContainerDied","Data":"ffa4e827e4f7271be41aa01def10adf5aaf38d0adc3b2ecf61aeaa3580d4c050"}
Sep 11 19:24:09.406164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.406139    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:09.520408 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.520385    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-bundle\") pod \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") "
Sep 11 19:24:09.520499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.520443    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-util\") pod \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") "
Sep 11 19:24:09.520499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.520478    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwxhn\" (UniqueName: \"kubernetes.io/projected/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-kube-api-access-rwxhn\") pod \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\" (UID: \"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45\") "
Sep 11 19:24:09.521059 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.521016    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-bundle" (OuterVolumeSpecName: "bundle") pod "5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" (UID: "5e4c9e0b-0464-4f9b-95b5-0db7ac024f45"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:24:09.522401 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.522381    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-kube-api-access-rwxhn" (OuterVolumeSpecName: "kube-api-access-rwxhn") pod "5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" (UID: "5e4c9e0b-0464-4f9b-95b5-0db7ac024f45"). InnerVolumeSpecName "kube-api-access-rwxhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:24:09.525783 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.525758    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-util" (OuterVolumeSpecName: "util") pod "5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" (UID: "5e4c9e0b-0464-4f9b-95b5-0db7ac024f45"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:24:09.621819 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.621791    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:24:09.621819 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.621816    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-util\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:24:09.621819 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.621825    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwxhn\" (UniqueName: \"kubernetes.io/projected/5e4c9e0b-0464-4f9b-95b5-0db7ac024f45-kube-api-access-rwxhn\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:24:09.987922 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.987882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk" event={"ID":"345ea90b-6123-47cd-9990-ac482ab3a475","Type":"ContainerStarted","Data":"081099a93ad26a00a7d24ea91b8bf854ea15fe2ba40ba94b8262d5ee4d01d7e5"}
Sep 11 19:24:09.990883 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.990849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6" event={"ID":"5e4c9e0b-0464-4f9b-95b5-0db7ac024f45","Type":"ContainerDied","Data":"3f8a535bfb19afff18991c020056a6662dd0847844e1b786e072db1208120cdf"}
Sep 11 19:24:09.991015 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.990900    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f8a535bfb19afff18991c020056a6662dd0847844e1b786e072db1208120cdf"
Sep 11 19:24:09.991015 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:09.990864    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xrmq6"
Sep 11 19:24:10.023310 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:24:10.023269    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4c9e0b_0464_4f9b_95b5_0db7ac024f45.slice\": RecentStats: unable to find data in memory cache]"
Sep 11 19:24:10.996613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:10.996577    2580 generic.go:356] "Generic (PLEG): container finished" podID="345ea90b-6123-47cd-9990-ac482ab3a475" containerID="081099a93ad26a00a7d24ea91b8bf854ea15fe2ba40ba94b8262d5ee4d01d7e5" exitCode=0
Sep 11 19:24:10.997082 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:10.996634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk" event={"ID":"345ea90b-6123-47cd-9990-ac482ab3a475","Type":"ContainerDied","Data":"081099a93ad26a00a7d24ea91b8bf854ea15fe2ba40ba94b8262d5ee4d01d7e5"}
Sep 11 19:24:12.002713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:12.002674    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk" event={"ID":"345ea90b-6123-47cd-9990-ac482ab3a475","Type":"ContainerStarted","Data":"557a9d3c047f6418e3a8afbbf81293acad03b63405ea9eeb4b7a5582a0a59d4b"}
Sep 11 19:24:12.003157 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:12.002754    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:12.027673 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:12.027622    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk" podStartSLOduration=2.529627776 podStartE2EDuration="7.027607562s" totalImagesPullingTime="3.449889393s" totalInitContainerRuntime="1.048090393s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:12.025539017 +0000 UTC m=+352.046747184" watchObservedRunningTime="2026-09-11 19:24:12.027607562 +0000 UTC m=+352.048815712"
Sep 11 19:24:23.009692 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.009608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-bd7rk"
Sep 11 19:24:23.391307 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.391208    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"]
Sep 11 19:24:23.391511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.391498    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" containerName="util"
Sep 11 19:24:23.391511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.391512    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" containerName="util"
Sep 11 19:24:23.391593 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.391531    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" containerName="pull"
Sep 11 19:24:23.391593 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.391537    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" containerName="pull"
Sep 11 19:24:23.391593 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.391547    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" containerName="extract"
Sep 11 19:24:23.391593 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.391554    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" containerName="extract"
Sep 11 19:24:23.391714 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.391602    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4c9e0b-0464-4f9b-95b5-0db7ac024f45" containerName="extract"
Sep 11 19:24:23.399698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.399672    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.403387 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.403210    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9flmd\""
Sep 11 19:24:23.405366 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.405338    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 19:24:23.406216 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.405421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:24:23.406531 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.405607    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 19:24:23.406802 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.405669    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 19:24:23.407054 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.405815    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 19:24:23.408917 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.408891    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"]
Sep 11 19:24:23.540373 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.540338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfdsk\" (UniqueName: \"kubernetes.io/projected/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-kube-api-access-cfdsk\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.540534 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.540399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-metrics-cert\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.540534 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.540467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-cert\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.540606 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.540532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-manager-config\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.641736 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.641664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdsk\" (UniqueName: \"kubernetes.io/projected/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-kube-api-access-cfdsk\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.641736 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.641723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-metrics-cert\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.641880 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.641749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-cert\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.641880 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.641779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-manager-config\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.642426 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.642396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-manager-config\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.644186 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.644165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-cert\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.644306 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.644210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-metrics-cert\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.650910 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.650883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfdsk\" (UniqueName: \"kubernetes.io/projected/3c6394c2-5a51-4d41-b6c4-8d539bc22b50-kube-api-access-cfdsk\") pod \"lws-controller-manager-6df94f489d-g5l5g\" (UID: \"3c6394c2-5a51-4d41-b6c4-8d539bc22b50\") " pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.715456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.715431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:23.988993 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:23.988960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"]
Sep 11 19:24:23.992056 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:24:23.992030    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6394c2_5a51_4d41_b6c4_8d539bc22b50.slice/crio-84ee5016785506d0dae0eb2daa3eda26437d036552857b90bb0c7e0412146757 WatchSource:0}: Error finding container 84ee5016785506d0dae0eb2daa3eda26437d036552857b90bb0c7e0412146757: Status 404 returned error can't find the container with id 84ee5016785506d0dae0eb2daa3eda26437d036552857b90bb0c7e0412146757
Sep 11 19:24:24.057170 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.057133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g" event={"ID":"3c6394c2-5a51-4d41-b6c4-8d539bc22b50","Type":"ContainerStarted","Data":"84ee5016785506d0dae0eb2daa3eda26437d036552857b90bb0c7e0412146757"}
Sep 11 19:24:24.334993 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.334909    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57b47bdb7c-sczv4"]
Sep 11 19:24:24.339762 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.339743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.350488 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.350462    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b47bdb7c-sczv4"]
Sep 11 19:24:24.448817 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.448790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-service-ca\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.448950 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.448827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9142187c-d4a9-4bce-afd7-a3490a08f2dc-console-serving-cert\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.448950 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.448852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9142187c-d4a9-4bce-afd7-a3490a08f2dc-console-oauth-config\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.448950 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.448932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-trusted-ca-bundle\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.449055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.448961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-oauth-serving-cert\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.449055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.448983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-console-config\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.449055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.449007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69xnj\" (UniqueName: \"kubernetes.io/projected/9142187c-d4a9-4bce-afd7-a3490a08f2dc-kube-api-access-69xnj\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.550312 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.550261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-service-ca\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.550429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.550326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9142187c-d4a9-4bce-afd7-a3490a08f2dc-console-serving-cert\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.550429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.550353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9142187c-d4a9-4bce-afd7-a3490a08f2dc-console-oauth-config\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.550429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.550384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-trusted-ca-bundle\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.550429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.550400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-oauth-serving-cert\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.550429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.550422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-console-config\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.550670 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.550632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69xnj\" (UniqueName: \"kubernetes.io/projected/9142187c-d4a9-4bce-afd7-a3490a08f2dc-kube-api-access-69xnj\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.551142 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.551116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-console-config\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.551266 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.551120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-service-ca\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.551266 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.551200    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-oauth-serving-cert\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.551439 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.551397    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9142187c-d4a9-4bce-afd7-a3490a08f2dc-trusted-ca-bundle\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.552866 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.552845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9142187c-d4a9-4bce-afd7-a3490a08f2dc-console-serving-cert\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.552866 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.552855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9142187c-d4a9-4bce-afd7-a3490a08f2dc-console-oauth-config\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.574096 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.574067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69xnj\" (UniqueName: \"kubernetes.io/projected/9142187c-d4a9-4bce-afd7-a3490a08f2dc-kube-api-access-69xnj\") pod \"console-57b47bdb7c-sczv4\" (UID: \"9142187c-d4a9-4bce-afd7-a3490a08f2dc\") " pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.649191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.649123    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:24.971893 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:24.971867    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b47bdb7c-sczv4"]
Sep 11 19:24:24.974471 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:24:24.974438    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9142187c_d4a9_4bce_afd7_a3490a08f2dc.slice/crio-b46f849ac7f7c84e08ea5480ad0d4eaa4a711bd5968f01e24f10117bffb6461f WatchSource:0}: Error finding container b46f849ac7f7c84e08ea5480ad0d4eaa4a711bd5968f01e24f10117bffb6461f: Status 404 returned error can't find the container with id b46f849ac7f7c84e08ea5480ad0d4eaa4a711bd5968f01e24f10117bffb6461f
Sep 11 19:24:25.068847 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:25.068762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b47bdb7c-sczv4" event={"ID":"9142187c-d4a9-4bce-afd7-a3490a08f2dc","Type":"ContainerStarted","Data":"552745b1b107d47f08aa232a01e198bae3fcc790eb8a06a2b970f6ed3a9b05c8"}
Sep 11 19:24:25.068847 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:25.068819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b47bdb7c-sczv4" event={"ID":"9142187c-d4a9-4bce-afd7-a3490a08f2dc","Type":"ContainerStarted","Data":"b46f849ac7f7c84e08ea5480ad0d4eaa4a711bd5968f01e24f10117bffb6461f"}
Sep 11 19:24:25.097994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:25.097929    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57b47bdb7c-sczv4" podStartSLOduration=1.097908429 podStartE2EDuration="1.097908429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:25.095856035 +0000 UTC m=+365.117064214" watchObservedRunningTime="2026-09-11 19:24:25.097908429 +0000 UTC m=+365.119116580"
Sep 11 19:24:26.076642 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:26.076589    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g" event={"ID":"3c6394c2-5a51-4d41-b6c4-8d539bc22b50","Type":"ContainerStarted","Data":"8a7d0251da18a44bd5d6400954a82452abe5232bc2899f70215ba67c0c20a4ee"}
Sep 11 19:24:26.077020 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:26.076666    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:26.176235 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:26.176183    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g" podStartSLOduration=1.620672595 podStartE2EDuration="3.176169169s" totalImagesPullingTime="1.555496574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:26.170199969 +0000 UTC m=+366.191408139" watchObservedRunningTime="2026-09-11 19:24:26.176169169 +0000 UTC m=+366.197377318"
Sep 11 19:24:34.649905 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:34.649866    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:34.650375 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:34.649920    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:34.654743 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:34.654720    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:35.121527 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:35.121495    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57b47bdb7c-sczv4"
Sep 11 19:24:35.164488 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:35.164457    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c686bd5f-t8pvk"]
Sep 11 19:24:37.083145 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.083112    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6df94f489d-g5l5g"
Sep 11 19:24:37.506736 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.506697    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4s49q"]
Sep 11 19:24:37.511464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.511448    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4s49q"
Sep 11 19:24:37.515311 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.515276    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 19:24:37.515420 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.515400    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7rcdd\""
Sep 11 19:24:37.525657 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.525634    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4s49q"]
Sep 11 19:24:37.554015 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.553959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfcrw\" (UniqueName: \"kubernetes.io/projected/e04ee1d2-005c-460d-858e-2a2ab1e52798-kube-api-access-nfcrw\") pod \"odh-model-controller-7998c67dc4-4s49q\" (UID: \"e04ee1d2-005c-460d-858e-2a2ab1e52798\") " pod="opendatahub/odh-model-controller-7998c67dc4-4s49q"
Sep 11 19:24:37.554362 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.554338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e04ee1d2-005c-460d-858e-2a2ab1e52798-cert\") pod \"odh-model-controller-7998c67dc4-4s49q\" (UID: \"e04ee1d2-005c-460d-858e-2a2ab1e52798\") " pod="opendatahub/odh-model-controller-7998c67dc4-4s49q"
Sep 11 19:24:37.655396 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.655365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfcrw\" (UniqueName: \"kubernetes.io/projected/e04ee1d2-005c-460d-858e-2a2ab1e52798-kube-api-access-nfcrw\") pod \"odh-model-controller-7998c67dc4-4s49q\" (UID: \"e04ee1d2-005c-460d-858e-2a2ab1e52798\") " pod="opendatahub/odh-model-controller-7998c67dc4-4s49q"
Sep 11 19:24:37.655547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.655442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e04ee1d2-005c-460d-858e-2a2ab1e52798-cert\") pod \"odh-model-controller-7998c67dc4-4s49q\" (UID: \"e04ee1d2-005c-460d-858e-2a2ab1e52798\") " pod="opendatahub/odh-model-controller-7998c67dc4-4s49q"
Sep 11 19:24:37.657597 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.657571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e04ee1d2-005c-460d-858e-2a2ab1e52798-cert\") pod \"odh-model-controller-7998c67dc4-4s49q\" (UID: \"e04ee1d2-005c-460d-858e-2a2ab1e52798\") " pod="opendatahub/odh-model-controller-7998c67dc4-4s49q"
Sep 11 19:24:37.669002 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.668976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfcrw\" (UniqueName: \"kubernetes.io/projected/e04ee1d2-005c-460d-858e-2a2ab1e52798-kube-api-access-nfcrw\") pod \"odh-model-controller-7998c67dc4-4s49q\" (UID: \"e04ee1d2-005c-460d-858e-2a2ab1e52798\") " pod="opendatahub/odh-model-controller-7998c67dc4-4s49q"
Sep 11 19:24:37.822021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:37.821938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4s49q"
Sep 11 19:24:38.101506 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.101479    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4s49q"]
Sep 11 19:24:38.104019 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:24:38.103993    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04ee1d2_005c_460d_858e_2a2ab1e52798.slice/crio-40f85eedc28b01ca85b7879d6f0cd6e653afc99dcbc8408d701c687e35abc2a8 WatchSource:0}: Error finding container 40f85eedc28b01ca85b7879d6f0cd6e653afc99dcbc8408d701c687e35abc2a8: Status 404 returned error can't find the container with id 40f85eedc28b01ca85b7879d6f0cd6e653afc99dcbc8408d701c687e35abc2a8
Sep 11 19:24:38.133027 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.133000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4s49q" event={"ID":"e04ee1d2-005c-460d-858e-2a2ab1e52798","Type":"ContainerStarted","Data":"40f85eedc28b01ca85b7879d6f0cd6e653afc99dcbc8408d701c687e35abc2a8"}
Sep 11 19:24:38.371739 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.371645    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j9dd6"]
Sep 11 19:24:38.376203 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.376181    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6"
Sep 11 19:24:38.380077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.380055    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 19:24:38.380356 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.380335    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-96v48\""
Sep 11 19:24:38.392762 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.392737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j9dd6"]
Sep 11 19:24:38.463825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.463793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a393ac47-2f3c-4851-9026-8c2e09f13ea5-tls-certs\") pod \"model-serving-api-54d89bd5fc-j9dd6\" (UID: \"a393ac47-2f3c-4851-9026-8c2e09f13ea5\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6"
Sep 11 19:24:38.463956 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.463906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdgtw\" (UniqueName: \"kubernetes.io/projected/a393ac47-2f3c-4851-9026-8c2e09f13ea5-kube-api-access-zdgtw\") pod \"model-serving-api-54d89bd5fc-j9dd6\" (UID: \"a393ac47-2f3c-4851-9026-8c2e09f13ea5\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6"
Sep 11 19:24:38.564264 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.564230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdgtw\" (UniqueName: \"kubernetes.io/projected/a393ac47-2f3c-4851-9026-8c2e09f13ea5-kube-api-access-zdgtw\") pod \"model-serving-api-54d89bd5fc-j9dd6\" (UID: \"a393ac47-2f3c-4851-9026-8c2e09f13ea5\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6"
Sep 11 19:24:38.564465 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.564274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a393ac47-2f3c-4851-9026-8c2e09f13ea5-tls-certs\") pod \"model-serving-api-54d89bd5fc-j9dd6\" (UID: \"a393ac47-2f3c-4851-9026-8c2e09f13ea5\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6"
Sep 11 19:24:38.566660 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.566641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a393ac47-2f3c-4851-9026-8c2e09f13ea5-tls-certs\") pod \"model-serving-api-54d89bd5fc-j9dd6\" (UID: \"a393ac47-2f3c-4851-9026-8c2e09f13ea5\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6"
Sep 11 19:24:38.571721 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.571696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdgtw\" (UniqueName: \"kubernetes.io/projected/a393ac47-2f3c-4851-9026-8c2e09f13ea5-kube-api-access-zdgtw\") pod \"model-serving-api-54d89bd5fc-j9dd6\" (UID: \"a393ac47-2f3c-4851-9026-8c2e09f13ea5\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6"
Sep 11 19:24:38.687039 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.687011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6"
Sep 11 19:24:38.970428 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.970123    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j9dd6"]
Sep 11 19:24:38.973043 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:24:38.973018    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda393ac47_2f3c_4851_9026_8c2e09f13ea5.slice/crio-0f34f1f2a4607b6334544ceb79a3ee7fb2764a9a55d9a788537f02296573d4ad WatchSource:0}: Error finding container 0f34f1f2a4607b6334544ceb79a3ee7fb2764a9a55d9a788537f02296573d4ad: Status 404 returned error can't find the container with id 0f34f1f2a4607b6334544ceb79a3ee7fb2764a9a55d9a788537f02296573d4ad
Sep 11 19:24:38.984842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.984816    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"]
Sep 11 19:24:38.989384 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.989356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:38.992730 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.992708    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dzjsq\""
Sep 11 19:24:38.992906 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.992890    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 19:24:38.992981 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.992964    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 19:24:38.993101 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:38.993085    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 19:24:39.011921 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.011899    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"]
Sep 11 19:24:39.068398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.068365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.068517 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.068404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.068517 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.068423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.068641 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.068550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.068641 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.068581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.068641 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.068613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.068787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.068652    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.068787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.068686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2hrs\" (UniqueName: \"kubernetes.io/projected/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-kube-api-access-k2hrs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.068787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.068716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.141334 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.141232    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6" event={"ID":"a393ac47-2f3c-4851-9026-8c2e09f13ea5","Type":"ContainerStarted","Data":"0f34f1f2a4607b6334544ceb79a3ee7fb2764a9a55d9a788537f02296573d4ad"}
Sep 11 19:24:39.170164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.170127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2hrs\" (UniqueName: \"kubernetes.io/projected/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-kube-api-access-k2hrs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.170353 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.170180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.170353 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.170234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.170353 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.170256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.170353 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.170275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.170565 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.170377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.170565 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.170402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.170565 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.170438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.170565 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.170479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.171640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.171068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.171640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.171171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.171640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.171364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.171640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.171449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.171640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.171605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.173423 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.173399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.174073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.174052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.185367 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.185343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.186600 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.186578    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2hrs\" (UniqueName: \"kubernetes.io/projected/e4c7eb7f-60ca-437c-80ab-0bb748c0c87d-kube-api-access-k2hrs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5\" (UID: \"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.299370 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.299263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:39.601655 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:39.601627    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"]
Sep 11 19:24:39.610671 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:24:39.610642    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c7eb7f_60ca_437c_80ab_0bb748c0c87d.slice/crio-9542a539157bda2b27ce633a4b9a82960fb085d03848e5bd4f4c877a9c3d8cb6 WatchSource:0}: Error finding container 9542a539157bda2b27ce633a4b9a82960fb085d03848e5bd4f4c877a9c3d8cb6: Status 404 returned error can't find the container with id 9542a539157bda2b27ce633a4b9a82960fb085d03848e5bd4f4c877a9c3d8cb6
Sep 11 19:24:40.149812 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:40.149746    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5" event={"ID":"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d","Type":"ContainerStarted","Data":"9542a539157bda2b27ce633a4b9a82960fb085d03848e5bd4f4c877a9c3d8cb6"}
Sep 11 19:24:43.829150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:43.829113    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:24:43.829485 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:43.829185    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:24:43.829485 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:43.829215    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:24:44.127271 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.127193    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"]
Sep 11 19:24:44.129887 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.129864    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.132163 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.132140    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 19:24:44.132313 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.132214    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 19:24:44.132686 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.132668    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n8dnt\""
Sep 11 19:24:44.132801 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.132782    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 19:24:44.141658 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.141636    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"]
Sep 11 19:24:44.185002 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.184963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6" event={"ID":"a393ac47-2f3c-4851-9026-8c2e09f13ea5","Type":"ContainerStarted","Data":"f73ea213fef3b145925c61419135bbc68ec3d979abc687fe3c6830401fd1ac1d"}
Sep 11 19:24:44.185174 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.185127    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6"
Sep 11 19:24:44.186667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.186623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5" event={"ID":"e4c7eb7f-60ca-437c-80ab-0bb748c0c87d","Type":"ContainerStarted","Data":"49496dfc27fa6f65b18f47c34cc41fc8de4121a774576dcc9fa5fc8d05973fbe"}
Sep 11 19:24:44.188081 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.188058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4s49q" event={"ID":"e04ee1d2-005c-460d-858e-2a2ab1e52798","Type":"ContainerStarted","Data":"e3ee54ef7b116aa8049018af3a096953351f604190651af477194290f5b79c70"}
Sep 11 19:24:44.188214 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.188201    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4s49q"
Sep 11 19:24:44.206604 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.206549    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6" podStartSLOduration=1.359208861 podStartE2EDuration="6.206535954s" totalImagesPullingTime="4.847327093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:44.204957988 +0000 UTC m=+384.226166161" watchObservedRunningTime="2026-09-11 19:24:44.206535954 +0000 UTC m=+384.227744112"
Sep 11 19:24:44.225790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.225757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.225908 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.225795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.225972 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.225929    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.226069 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.225988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.226069 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.226011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.226237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.226107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zc9q\" (UniqueName: \"kubernetes.io/projected/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-kube-api-access-6zc9q\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.226237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.226211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.233510 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.233468    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5" podStartSLOduration=2.018587578 podStartE2EDuration="6.233454962s" totalImagesPullingTime="4.214867384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:44.232247935 +0000 UTC m=+384.253456112" watchObservedRunningTime="2026-09-11 19:24:44.233454962 +0000 UTC m=+384.254663111"
Sep 11 19:24:44.251692 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.251642    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4s49q" podStartSLOduration=1.567824115 podStartE2EDuration="7.25162254s" totalImagesPullingTime="5.683798425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:44.251299051 +0000 UTC m=+384.272507225" watchObservedRunningTime="2026-09-11 19:24:44.25162254 +0000 UTC m=+384.272830693"
Sep 11 19:24:44.300369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.300322    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:44.305550 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.305508    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:44.327373 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.327338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.327373 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.327375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.327560 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.327408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zc9q\" (UniqueName: \"kubernetes.io/projected/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-kube-api-access-6zc9q\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.327560 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.327483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.327659 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.327564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.327659 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.327593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.327659 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.327625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.328229 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.328198    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.330224 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.330205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.330362 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.330339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.330492 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.330470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.330539 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.330476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.340968 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.340940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.341051 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.340999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zc9q\" (UniqueName: \"kubernetes.io/projected/04363e6c-d7f8-49b9-b8b8-8ff9a52cad96-kube-api-access-6zc9q\") pod \"istiod-openshift-gateway-5677ccb49b-682g5\" (UID: \"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.439100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.439071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:44.713309 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:44.713208    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"]
Sep 11 19:24:44.716501 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:24:44.716474    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04363e6c_d7f8_49b9_b8b8_8ff9a52cad96.slice/crio-be86ef2411dd241a8c7506fde399728ec7374f363fa171ef1a9d243e5b6ecad0 WatchSource:0}: Error finding container be86ef2411dd241a8c7506fde399728ec7374f363fa171ef1a9d243e5b6ecad0: Status 404 returned error can't find the container with id be86ef2411dd241a8c7506fde399728ec7374f363fa171ef1a9d243e5b6ecad0
Sep 11 19:24:45.194053 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:45.194016    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5" event={"ID":"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96","Type":"ContainerStarted","Data":"be86ef2411dd241a8c7506fde399728ec7374f363fa171ef1a9d243e5b6ecad0"}
Sep 11 19:24:45.194479 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:45.194460    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:45.195378 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:45.195359    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5"
Sep 11 19:24:46.948366 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:46.948327    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:24:46.948631 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:46.948399    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:24:47.207150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:47.207069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5" event={"ID":"04363e6c-d7f8-49b9-b8b8-8ff9a52cad96","Type":"ContainerStarted","Data":"5a72efddf70901341360945dee32153139595f200206e410a151c9590a5b9db6"}
Sep 11 19:24:47.207327 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:47.207240    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:47.265991 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:47.265929    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5" podStartSLOduration=1.036544329 podStartE2EDuration="3.265906417s" totalImagesPullingTime="2.229362088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:47.263270087 +0000 UTC m=+387.284478298" watchObservedRunningTime="2026-09-11 19:24:47.265906417 +0000 UTC m=+387.287114570"
Sep 11 19:24:48.214028 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:48.213996    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-682g5"
Sep 11 19:24:55.196369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:55.196334    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4s49q"
Sep 11 19:24:55.198437 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:24:55.198414    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-j9dd6"
Sep 11 19:25:00.189585 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.189542    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84c686bd5f-t8pvk" podUID="d1f0eeea-258c-4502-94d9-f4282867ecb8" containerName="console" containerID="cri-o://0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad" gracePeriod=15
Sep 11 19:25:00.435778 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.435754    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:25:00.585906 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.585812    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-oauth-serving-cert\") pod \"d1f0eeea-258c-4502-94d9-f4282867ecb8\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") "
Sep 11 19:25:00.585906 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.585853    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-serving-cert\") pod \"d1f0eeea-258c-4502-94d9-f4282867ecb8\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") "
Sep 11 19:25:00.585906 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.585878    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cqjb\" (UniqueName: \"kubernetes.io/projected/d1f0eeea-258c-4502-94d9-f4282867ecb8-kube-api-access-8cqjb\") pod \"d1f0eeea-258c-4502-94d9-f4282867ecb8\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") "
Sep 11 19:25:00.586183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.585949    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-trusted-ca-bundle\") pod \"d1f0eeea-258c-4502-94d9-f4282867ecb8\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") "
Sep 11 19:25:00.586183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.585972    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-oauth-config\") pod \"d1f0eeea-258c-4502-94d9-f4282867ecb8\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") "
Sep 11 19:25:00.586183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.586111    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-service-ca\") pod \"d1f0eeea-258c-4502-94d9-f4282867ecb8\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") "
Sep 11 19:25:00.586183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.586154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-config\") pod \"d1f0eeea-258c-4502-94d9-f4282867ecb8\" (UID: \"d1f0eeea-258c-4502-94d9-f4282867ecb8\") "
Sep 11 19:25:00.586433 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.586267    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d1f0eeea-258c-4502-94d9-f4282867ecb8" (UID: "d1f0eeea-258c-4502-94d9-f4282867ecb8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:25:00.586541 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.586516    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d1f0eeea-258c-4502-94d9-f4282867ecb8" (UID: "d1f0eeea-258c-4502-94d9-f4282867ecb8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:25:00.586598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.586555    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-service-ca" (OuterVolumeSpecName: "service-ca") pod "d1f0eeea-258c-4502-94d9-f4282867ecb8" (UID: "d1f0eeea-258c-4502-94d9-f4282867ecb8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:25:00.586598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.586583    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-oauth-serving-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:00.586598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.586591    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-config" (OuterVolumeSpecName: "console-config") pod "d1f0eeea-258c-4502-94d9-f4282867ecb8" (UID: "d1f0eeea-258c-4502-94d9-f4282867ecb8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:25:00.588146 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.588123    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d1f0eeea-258c-4502-94d9-f4282867ecb8" (UID: "d1f0eeea-258c-4502-94d9-f4282867ecb8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:25:00.588634 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.588606    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1f0eeea-258c-4502-94d9-f4282867ecb8-kube-api-access-8cqjb" (OuterVolumeSpecName: "kube-api-access-8cqjb") pod "d1f0eeea-258c-4502-94d9-f4282867ecb8" (UID: "d1f0eeea-258c-4502-94d9-f4282867ecb8"). InnerVolumeSpecName "kube-api-access-8cqjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:25:00.588726 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.588609    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d1f0eeea-258c-4502-94d9-f4282867ecb8" (UID: "d1f0eeea-258c-4502-94d9-f4282867ecb8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:25:00.687038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.687000    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-trusted-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:00.687038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.687031    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-oauth-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:00.687038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.687041    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:00.687252 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.687050    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:00.687252 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.687058    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f0eeea-258c-4502-94d9-f4282867ecb8-console-serving-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:00.687252 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:00.687066    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cqjb\" (UniqueName: \"kubernetes.io/projected/d1f0eeea-258c-4502-94d9-f4282867ecb8-kube-api-access-8cqjb\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:01.274968 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:01.274935    2580 generic.go:356] "Generic (PLEG): container finished" podID="d1f0eeea-258c-4502-94d9-f4282867ecb8" containerID="0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad" exitCode=0
Sep 11 19:25:01.275406 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:01.274978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c686bd5f-t8pvk" event={"ID":"d1f0eeea-258c-4502-94d9-f4282867ecb8","Type":"ContainerDied","Data":"0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad"}
Sep 11 19:25:01.275406 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:01.274982    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c686bd5f-t8pvk"
Sep 11 19:25:01.275406 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:01.275013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c686bd5f-t8pvk" event={"ID":"d1f0eeea-258c-4502-94d9-f4282867ecb8","Type":"ContainerDied","Data":"a3e3ad2194744605d265350e2c2f017d5b190f7650db3ed959b8d51bf1d84ee1"}
Sep 11 19:25:01.275406 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:01.275035    2580 scope.go:117] "RemoveContainer" containerID="0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad"
Sep 11 19:25:01.283843 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:01.283819    2580 scope.go:117] "RemoveContainer" containerID="0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad"
Sep 11 19:25:01.284123 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:25:01.284102    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad\": container with ID starting with 0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad not found: ID does not exist" containerID="0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad"
Sep 11 19:25:01.284173 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:01.284133    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad"} err="failed to get container status \"0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad\": rpc error: code = NotFound desc = could not find container \"0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad\": container with ID starting with 0f688f5dea8d8a08f960c29c3ec6af0f7b27985e873dd2600bc2a207643292ad not found: ID does not exist"
Sep 11 19:25:01.296393 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:01.296364    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c686bd5f-t8pvk"]
Sep 11 19:25:01.300247 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:01.300224    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84c686bd5f-t8pvk"]
Sep 11 19:25:02.449026 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:02.448984    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1f0eeea-258c-4502-94d9-f4282867ecb8" path="/var/lib/kubelet/pods/d1f0eeea-258c-4502-94d9-f4282867ecb8/volumes"
Sep 11 19:25:42.329101 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.329063    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"]
Sep 11 19:25:42.329571 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.329452    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f0eeea-258c-4502-94d9-f4282867ecb8" containerName="console"
Sep 11 19:25:42.329571 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.329467    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f0eeea-258c-4502-94d9-f4282867ecb8" containerName="console"
Sep 11 19:25:42.329571 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.329520    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1f0eeea-258c-4502-94d9-f4282867ecb8" containerName="console"
Sep 11 19:25:42.340798 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.340775    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"]
Sep 11 19:25:42.340934 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.340868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.343274 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.343248    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 19:25:42.343456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.343251    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 19:25:42.343456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.343389    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jbdrn\""
Sep 11 19:25:42.428191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.428162    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"]
Sep 11 19:25:42.430630 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.430612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.439051 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.439025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.439151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.439057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xsws\" (UniqueName: \"kubernetes.io/projected/4cc18b85-6019-4735-ba80-bc6f66037d03-kube-api-access-5xsws\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.439151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.439081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.442207 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.442182    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"]
Sep 11 19:25:42.528249 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.528214    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"]
Sep 11 19:25:42.530697 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.530679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.539885 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.539849    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"]
Sep 11 19:25:42.540152 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.540125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llfr4\" (UniqueName: \"kubernetes.io/projected/5afd132f-d730-4cb3-8f10-481aecb2126f-kube-api-access-llfr4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.540309 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.540169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.540309 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.540212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.540434 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.540303    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xsws\" (UniqueName: \"kubernetes.io/projected/4cc18b85-6019-4735-ba80-bc6f66037d03-kube-api-access-5xsws\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.540434 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.540353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.540434 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.540399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.540612 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.540594    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.540725 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.540705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.548176 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.548147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xsws\" (UniqueName: \"kubernetes.io/projected/4cc18b85-6019-4735-ba80-bc6f66037d03-kube-api-access-5xsws\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.630189 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.630114    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"]
Sep 11 19:25:42.632499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.632482    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:42.641275 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.641246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njdx8\" (UniqueName: \"kubernetes.io/projected/9bd3133a-9d98-434a-a32a-ba3407635eb0-kube-api-access-njdx8\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.641420 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.641330    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.641498 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.641410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llfr4\" (UniqueName: \"kubernetes.io/projected/5afd132f-d730-4cb3-8f10-481aecb2126f-kube-api-access-llfr4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.641498 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.641481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.641599 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.641548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.641646 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.641594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.641928 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.641906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.642001 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.641921    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"]
Sep 11 19:25:42.642001 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.641923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.650451 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.650427    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llfr4\" (UniqueName: \"kubernetes.io/projected/5afd132f-d730-4cb3-8f10-481aecb2126f-kube-api-access-llfr4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.650550 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.650536    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:42.739168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.739129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:42.742354 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.742329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njdx8\" (UniqueName: \"kubernetes.io/projected/9bd3133a-9d98-434a-a32a-ba3407635eb0-kube-api-access-njdx8\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.742463 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.742368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.742463 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.742411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:42.742463 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.742438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:42.742625 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.742468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.742625 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.742502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7d7f\" (UniqueName: \"kubernetes.io/projected/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-kube-api-access-s7d7f\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:42.742768 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.742746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.742818 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.742777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.750910 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.750884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njdx8\" (UniqueName: \"kubernetes.io/projected/9bd3133a-9d98-434a-a32a-ba3407635eb0-kube-api-access-njdx8\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.840787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.840753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:42.843302 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.843129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:42.843302 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.843167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:42.843302 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.843210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7d7f\" (UniqueName: \"kubernetes.io/projected/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-kube-api-access-s7d7f\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:42.843557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.843514    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:42.843633 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.843608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:42.852328 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.852307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7d7f\" (UniqueName: \"kubernetes.io/projected/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-kube-api-access-s7d7f\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:42.924569 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.924543    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"]
Sep 11 19:25:42.925906 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:25:42.925874    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc18b85_6019_4735_ba80_bc6f66037d03.slice/crio-240bbe70936a832f4a329648290b9c2c7db678ad9138b9886fa7328d942d7180 WatchSource:0}: Error finding container 240bbe70936a832f4a329648290b9c2c7db678ad9138b9886fa7328d942d7180: Status 404 returned error can't find the container with id 240bbe70936a832f4a329648290b9c2c7db678ad9138b9886fa7328d942d7180
Sep 11 19:25:42.941958 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:42.941938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:43.010335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.010301    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"]
Sep 11 19:25:43.011860 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:25:43.011824    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afd132f_d730_4cb3_8f10_481aecb2126f.slice/crio-bac73a046522d7ef224ab59a705fe2d5f8a25a382835a20710a9394a9dabd9aa WatchSource:0}: Error finding container bac73a046522d7ef224ab59a705fe2d5f8a25a382835a20710a9394a9dabd9aa: Status 404 returned error can't find the container with id bac73a046522d7ef224ab59a705fe2d5f8a25a382835a20710a9394a9dabd9aa
Sep 11 19:25:43.108736 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.108711    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"]
Sep 11 19:25:43.115846 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:25:43.115815    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd3133a_9d98_434a_a32a_ba3407635eb0.slice/crio-ffa450161918038fc0cd129f1b975e61a78f278204f037597d2545f24a1e88a3 WatchSource:0}: Error finding container ffa450161918038fc0cd129f1b975e61a78f278204f037597d2545f24a1e88a3: Status 404 returned error can't find the container with id ffa450161918038fc0cd129f1b975e61a78f278204f037597d2545f24a1e88a3
Sep 11 19:25:43.214271 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.214246    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"]
Sep 11 19:25:43.266062 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:25:43.266031    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e64dce_d603_4c1f_a2b3_6e1132be9e9b.slice/crio-02b29847786d9d645a0da886661743ef90d749cdae204f7ce8c5683b679cc6cb WatchSource:0}: Error finding container 02b29847786d9d645a0da886661743ef90d749cdae204f7ce8c5683b679cc6cb: Status 404 returned error can't find the container with id 02b29847786d9d645a0da886661743ef90d749cdae204f7ce8c5683b679cc6cb
Sep 11 19:25:43.475744 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.475685    2580 generic.go:356] "Generic (PLEG): container finished" podID="5afd132f-d730-4cb3-8f10-481aecb2126f" containerID="b657e9e378490d10579acc74902f1252cd012d4bbe9097bfbcedbeae6dec12c7" exitCode=0
Sep 11 19:25:43.476145 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.475744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76" event={"ID":"5afd132f-d730-4cb3-8f10-481aecb2126f","Type":"ContainerDied","Data":"b657e9e378490d10579acc74902f1252cd012d4bbe9097bfbcedbeae6dec12c7"}
Sep 11 19:25:43.476145 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.475800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76" event={"ID":"5afd132f-d730-4cb3-8f10-481aecb2126f","Type":"ContainerStarted","Data":"bac73a046522d7ef224ab59a705fe2d5f8a25a382835a20710a9394a9dabd9aa"}
Sep 11 19:25:43.477500 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.477480    2580 generic.go:356] "Generic (PLEG): container finished" podID="4cc18b85-6019-4735-ba80-bc6f66037d03" containerID="cd2900bdcd3dc15ad6b8e5fea4775c7f457d8516cf9c7a7fefe1c9627fd4125d" exitCode=0
Sep 11 19:25:43.477601 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.477575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f" event={"ID":"4cc18b85-6019-4735-ba80-bc6f66037d03","Type":"ContainerDied","Data":"cd2900bdcd3dc15ad6b8e5fea4775c7f457d8516cf9c7a7fefe1c9627fd4125d"}
Sep 11 19:25:43.477718 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.477630    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f" event={"ID":"4cc18b85-6019-4735-ba80-bc6f66037d03","Type":"ContainerStarted","Data":"240bbe70936a832f4a329648290b9c2c7db678ad9138b9886fa7328d942d7180"}
Sep 11 19:25:43.479225 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.479205    2580 generic.go:356] "Generic (PLEG): container finished" podID="e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" containerID="3a3f90192011d0709a8a3bd03c7a96503d67644895aec355a3af94a8e7167fc2" exitCode=0
Sep 11 19:25:43.479329 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.479268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc" event={"ID":"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b","Type":"ContainerDied","Data":"3a3f90192011d0709a8a3bd03c7a96503d67644895aec355a3af94a8e7167fc2"}
Sep 11 19:25:43.479387 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.479337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc" event={"ID":"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b","Type":"ContainerStarted","Data":"02b29847786d9d645a0da886661743ef90d749cdae204f7ce8c5683b679cc6cb"}
Sep 11 19:25:43.481457 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.481438    2580 generic.go:356] "Generic (PLEG): container finished" podID="9bd3133a-9d98-434a-a32a-ba3407635eb0" containerID="d22fc26e6f3c87850c4e775755242059a9c0beeaf2194805fdf50f3c2792e2d6" exitCode=0
Sep 11 19:25:43.481519 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.481475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l" event={"ID":"9bd3133a-9d98-434a-a32a-ba3407635eb0","Type":"ContainerDied","Data":"d22fc26e6f3c87850c4e775755242059a9c0beeaf2194805fdf50f3c2792e2d6"}
Sep 11 19:25:43.481519 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:43.481512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l" event={"ID":"9bd3133a-9d98-434a-a32a-ba3407635eb0","Type":"ContainerStarted","Data":"ffa450161918038fc0cd129f1b975e61a78f278204f037597d2545f24a1e88a3"}
Sep 11 19:25:44.489911 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:44.489880    2580 generic.go:356] "Generic (PLEG): container finished" podID="e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" containerID="bcde55a069076bb63d1ffde593fa92ed09763818d442f94b75c50ad331468f17" exitCode=0
Sep 11 19:25:44.490242 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:44.489957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc" event={"ID":"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b","Type":"ContainerDied","Data":"bcde55a069076bb63d1ffde593fa92ed09763818d442f94b75c50ad331468f17"}
Sep 11 19:25:44.492236 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:44.492214    2580 generic.go:356] "Generic (PLEG): container finished" podID="5afd132f-d730-4cb3-8f10-481aecb2126f" containerID="a62e6f8ec2afd18293c9d4963a6a122684a96eaec56435215597569fceac5a94" exitCode=0
Sep 11 19:25:44.492340 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:44.492306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76" event={"ID":"5afd132f-d730-4cb3-8f10-481aecb2126f","Type":"ContainerDied","Data":"a62e6f8ec2afd18293c9d4963a6a122684a96eaec56435215597569fceac5a94"}
Sep 11 19:25:45.500575 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:45.500550    2580 generic.go:356] "Generic (PLEG): container finished" podID="5afd132f-d730-4cb3-8f10-481aecb2126f" containerID="75c827a4a124a5d6db4bb260030c5bab032bea0db20bd329e14ae17a3e4701af" exitCode=0
Sep 11 19:25:45.500867 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:45.500641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76" event={"ID":"5afd132f-d730-4cb3-8f10-481aecb2126f","Type":"ContainerDied","Data":"75c827a4a124a5d6db4bb260030c5bab032bea0db20bd329e14ae17a3e4701af"}
Sep 11 19:25:45.502911 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:45.502892    2580 generic.go:356] "Generic (PLEG): container finished" podID="e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" containerID="d35ef5a9ceda4b678ddba4e5b598d03f0f3e9a08a84d9d63878b94540419e08b" exitCode=0
Sep 11 19:25:45.503031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:45.502951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc" event={"ID":"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b","Type":"ContainerDied","Data":"d35ef5a9ceda4b678ddba4e5b598d03f0f3e9a08a84d9d63878b94540419e08b"}
Sep 11 19:25:45.504688 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:45.504667    2580 generic.go:356] "Generic (PLEG): container finished" podID="9bd3133a-9d98-434a-a32a-ba3407635eb0" containerID="235c357098cc6a8e0e515b37a157d21da50b0c8c7245a902de259a12a726695c" exitCode=0
Sep 11 19:25:45.504779 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:45.504729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l" event={"ID":"9bd3133a-9d98-434a-a32a-ba3407635eb0","Type":"ContainerDied","Data":"235c357098cc6a8e0e515b37a157d21da50b0c8c7245a902de259a12a726695c"}
Sep 11 19:25:46.511821 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.511784    2580 generic.go:356] "Generic (PLEG): container finished" podID="4cc18b85-6019-4735-ba80-bc6f66037d03" containerID="58b7e54204cc8a42dbbe6792e59adea1fc2a762f5945bbdb490ba191c58a761a" exitCode=0
Sep 11 19:25:46.512212 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.511869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f" event={"ID":"4cc18b85-6019-4735-ba80-bc6f66037d03","Type":"ContainerDied","Data":"58b7e54204cc8a42dbbe6792e59adea1fc2a762f5945bbdb490ba191c58a761a"}
Sep 11 19:25:46.514334 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.514313    2580 generic.go:356] "Generic (PLEG): container finished" podID="9bd3133a-9d98-434a-a32a-ba3407635eb0" containerID="e89e872a1cbc2cb0811d33a7e7db06955af31e6532dc8e987b1c456c65ecb60e" exitCode=0
Sep 11 19:25:46.514441 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.514400    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l" event={"ID":"9bd3133a-9d98-434a-a32a-ba3407635eb0","Type":"ContainerDied","Data":"e89e872a1cbc2cb0811d33a7e7db06955af31e6532dc8e987b1c456c65ecb60e"}
Sep 11 19:25:46.651909 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.651880    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:46.687576 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.687553    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:46.781832 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.781745    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-bundle\") pod \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") "
Sep 11 19:25:46.781832 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.781779    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-util\") pod \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") "
Sep 11 19:25:46.781832 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.781813    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llfr4\" (UniqueName: \"kubernetes.io/projected/5afd132f-d730-4cb3-8f10-481aecb2126f-kube-api-access-llfr4\") pod \"5afd132f-d730-4cb3-8f10-481aecb2126f\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") "
Sep 11 19:25:46.782103 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.781847    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7d7f\" (UniqueName: \"kubernetes.io/projected/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-kube-api-access-s7d7f\") pod \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\" (UID: \"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b\") "
Sep 11 19:25:46.782103 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.781882    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-bundle\") pod \"5afd132f-d730-4cb3-8f10-481aecb2126f\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") "
Sep 11 19:25:46.782103 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.781906    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-util\") pod \"5afd132f-d730-4cb3-8f10-481aecb2126f\" (UID: \"5afd132f-d730-4cb3-8f10-481aecb2126f\") "
Sep 11 19:25:46.782447 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.782402    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-bundle" (OuterVolumeSpecName: "bundle") pod "5afd132f-d730-4cb3-8f10-481aecb2126f" (UID: "5afd132f-d730-4cb3-8f10-481aecb2126f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:25:46.782597 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.782458    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-bundle" (OuterVolumeSpecName: "bundle") pod "e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" (UID: "e1e64dce-d603-4c1f-a2b3-6e1132be9e9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:25:46.783941 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.783915    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-kube-api-access-s7d7f" (OuterVolumeSpecName: "kube-api-access-s7d7f") pod "e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" (UID: "e1e64dce-d603-4c1f-a2b3-6e1132be9e9b"). InnerVolumeSpecName "kube-api-access-s7d7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:25:46.784235 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.784214    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5afd132f-d730-4cb3-8f10-481aecb2126f-kube-api-access-llfr4" (OuterVolumeSpecName: "kube-api-access-llfr4") pod "5afd132f-d730-4cb3-8f10-481aecb2126f" (UID: "5afd132f-d730-4cb3-8f10-481aecb2126f"). InnerVolumeSpecName "kube-api-access-llfr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:25:46.787417 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.787395    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-util" (OuterVolumeSpecName: "util") pod "e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" (UID: "e1e64dce-d603-4c1f-a2b3-6e1132be9e9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:25:46.787740 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.787719    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-util" (OuterVolumeSpecName: "util") pod "5afd132f-d730-4cb3-8f10-481aecb2126f" (UID: "5afd132f-d730-4cb3-8f10-481aecb2126f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:25:46.883398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.883358    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:46.883398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.883390    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-util\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:46.883398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.883401    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llfr4\" (UniqueName: \"kubernetes.io/projected/5afd132f-d730-4cb3-8f10-481aecb2126f-kube-api-access-llfr4\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:46.883624 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.883412    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7d7f\" (UniqueName: \"kubernetes.io/projected/e1e64dce-d603-4c1f-a2b3-6e1132be9e9b-kube-api-access-s7d7f\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:46.883624 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.883422    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:46.883624 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:46.883430    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5afd132f-d730-4cb3-8f10-481aecb2126f-util\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:47.521338 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.521300    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc"
Sep 11 19:25:47.521338 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.521314    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbv7lc" event={"ID":"e1e64dce-d603-4c1f-a2b3-6e1132be9e9b","Type":"ContainerDied","Data":"02b29847786d9d645a0da886661743ef90d749cdae204f7ce8c5683b679cc6cb"}
Sep 11 19:25:47.521876 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.521363    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02b29847786d9d645a0da886661743ef90d749cdae204f7ce8c5683b679cc6cb"
Sep 11 19:25:47.523440 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.523416    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76"
Sep 11 19:25:47.523440 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.523432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qnd76" event={"ID":"5afd132f-d730-4cb3-8f10-481aecb2126f","Type":"ContainerDied","Data":"bac73a046522d7ef224ab59a705fe2d5f8a25a382835a20710a9394a9dabd9aa"}
Sep 11 19:25:47.523587 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.523473    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bac73a046522d7ef224ab59a705fe2d5f8a25a382835a20710a9394a9dabd9aa"
Sep 11 19:25:47.525862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.525836    2580 generic.go:356] "Generic (PLEG): container finished" podID="4cc18b85-6019-4735-ba80-bc6f66037d03" containerID="7c57bed4bc2340fc42440b1e9d30c0ad3347d23efc4b3f5b65d280a09c529fb0" exitCode=0
Sep 11 19:25:47.525977 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.525914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f" event={"ID":"4cc18b85-6019-4735-ba80-bc6f66037d03","Type":"ContainerDied","Data":"7c57bed4bc2340fc42440b1e9d30c0ad3347d23efc4b3f5b65d280a09c529fb0"}
Sep 11 19:25:47.650677 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.650655    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:47.790256 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.790171    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-bundle\") pod \"9bd3133a-9d98-434a-a32a-ba3407635eb0\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") "
Sep 11 19:25:47.790256 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.790208    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-util\") pod \"9bd3133a-9d98-434a-a32a-ba3407635eb0\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") "
Sep 11 19:25:47.790256 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.790258    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njdx8\" (UniqueName: \"kubernetes.io/projected/9bd3133a-9d98-434a-a32a-ba3407635eb0-kube-api-access-njdx8\") pod \"9bd3133a-9d98-434a-a32a-ba3407635eb0\" (UID: \"9bd3133a-9d98-434a-a32a-ba3407635eb0\") "
Sep 11 19:25:47.790702 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.790668    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-bundle" (OuterVolumeSpecName: "bundle") pod "9bd3133a-9d98-434a-a32a-ba3407635eb0" (UID: "9bd3133a-9d98-434a-a32a-ba3407635eb0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:25:47.792460 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.792434    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd3133a-9d98-434a-a32a-ba3407635eb0-kube-api-access-njdx8" (OuterVolumeSpecName: "kube-api-access-njdx8") pod "9bd3133a-9d98-434a-a32a-ba3407635eb0" (UID: "9bd3133a-9d98-434a-a32a-ba3407635eb0"). InnerVolumeSpecName "kube-api-access-njdx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:25:47.796063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.796025    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-util" (OuterVolumeSpecName: "util") pod "9bd3133a-9d98-434a-a32a-ba3407635eb0" (UID: "9bd3133a-9d98-434a-a32a-ba3407635eb0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:25:47.891140 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.891099    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:47.891140 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.891133    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bd3133a-9d98-434a-a32a-ba3407635eb0-util\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:47.891140 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:47.891142    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njdx8\" (UniqueName: \"kubernetes.io/projected/9bd3133a-9d98-434a-a32a-ba3407635eb0-kube-api-access-njdx8\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:48.532643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.532611    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l"
Sep 11 19:25:48.533063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.532646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62t68l" event={"ID":"9bd3133a-9d98-434a-a32a-ba3407635eb0","Type":"ContainerDied","Data":"ffa450161918038fc0cd129f1b975e61a78f278204f037597d2545f24a1e88a3"}
Sep 11 19:25:48.533063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.532696    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffa450161918038fc0cd129f1b975e61a78f278204f037597d2545f24a1e88a3"
Sep 11 19:25:48.656853 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.656831    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:48.798223 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.798125    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-util\") pod \"4cc18b85-6019-4735-ba80-bc6f66037d03\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") "
Sep 11 19:25:48.798223 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.798224    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-bundle\") pod \"4cc18b85-6019-4735-ba80-bc6f66037d03\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") "
Sep 11 19:25:48.798437 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.798310    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xsws\" (UniqueName: \"kubernetes.io/projected/4cc18b85-6019-4735-ba80-bc6f66037d03-kube-api-access-5xsws\") pod \"4cc18b85-6019-4735-ba80-bc6f66037d03\" (UID: \"4cc18b85-6019-4735-ba80-bc6f66037d03\") "
Sep 11 19:25:48.798965 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.798928    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-bundle" (OuterVolumeSpecName: "bundle") pod "4cc18b85-6019-4735-ba80-bc6f66037d03" (UID: "4cc18b85-6019-4735-ba80-bc6f66037d03"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:25:48.800454 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.800428    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc18b85-6019-4735-ba80-bc6f66037d03-kube-api-access-5xsws" (OuterVolumeSpecName: "kube-api-access-5xsws") pod "4cc18b85-6019-4735-ba80-bc6f66037d03" (UID: "4cc18b85-6019-4735-ba80-bc6f66037d03"). InnerVolumeSpecName "kube-api-access-5xsws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:25:48.803273 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.803237    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-util" (OuterVolumeSpecName: "util") pod "4cc18b85-6019-4735-ba80-bc6f66037d03" (UID: "4cc18b85-6019-4735-ba80-bc6f66037d03"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:25:48.899625 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.899578    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:48.899625 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.899623    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xsws\" (UniqueName: \"kubernetes.io/projected/4cc18b85-6019-4735-ba80-bc6f66037d03-kube-api-access-5xsws\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:48.899625 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:48.899637    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc18b85-6019-4735-ba80-bc6f66037d03-util\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:25:49.540000 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:49.539972    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f"
Sep 11 19:25:49.540426 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:49.539972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agdm8f" event={"ID":"4cc18b85-6019-4735-ba80-bc6f66037d03","Type":"ContainerDied","Data":"240bbe70936a832f4a329648290b9c2c7db678ad9138b9886fa7328d942d7180"}
Sep 11 19:25:49.540426 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:25:49.540091    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="240bbe70936a832f4a329648290b9c2c7db678ad9138b9886fa7328d942d7180"
Sep 11 19:26:49.609571 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609531    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"]
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609876    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" containerName="pull"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609888    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" containerName="pull"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609902    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc18b85-6019-4735-ba80-bc6f66037d03" containerName="util"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609912    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc18b85-6019-4735-ba80-bc6f66037d03" containerName="util"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609923    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd3133a-9d98-434a-a32a-ba3407635eb0" containerName="pull"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609929    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd3133a-9d98-434a-a32a-ba3407635eb0" containerName="pull"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609937    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd3133a-9d98-434a-a32a-ba3407635eb0" containerName="util"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609942    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd3133a-9d98-434a-a32a-ba3407635eb0" containerName="util"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609949    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" containerName="extract"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609954    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" containerName="extract"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609962    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc18b85-6019-4735-ba80-bc6f66037d03" containerName="pull"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609968    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc18b85-6019-4735-ba80-bc6f66037d03" containerName="pull"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609974    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc18b85-6019-4735-ba80-bc6f66037d03" containerName="extract"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609979    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc18b85-6019-4735-ba80-bc6f66037d03" containerName="extract"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609992    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5afd132f-d730-4cb3-8f10-481aecb2126f" containerName="util"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.609998    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afd132f-d730-4cb3-8f10-481aecb2126f" containerName="util"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610004    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5afd132f-d730-4cb3-8f10-481aecb2126f" containerName="extract"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610010    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afd132f-d730-4cb3-8f10-481aecb2126f" containerName="extract"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610017    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" containerName="util"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610022    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" containerName="util"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610032    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd3133a-9d98-434a-a32a-ba3407635eb0" containerName="extract"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610037    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd3133a-9d98-434a-a32a-ba3407635eb0" containerName="extract"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610043    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5afd132f-d730-4cb3-8f10-481aecb2126f" containerName="pull"
Sep 11 19:26:49.610062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610048    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afd132f-d730-4cb3-8f10-481aecb2126f" containerName="pull"
Sep 11 19:26:49.610871 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610102    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cc18b85-6019-4735-ba80-bc6f66037d03" containerName="extract"
Sep 11 19:26:49.610871 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610110    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5afd132f-d730-4cb3-8f10-481aecb2126f" containerName="extract"
Sep 11 19:26:49.610871 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610119    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bd3133a-9d98-434a-a32a-ba3407635eb0" containerName="extract"
Sep 11 19:26:49.610871 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.610126    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1e64dce-d603-4c1f-a2b3-6e1132be9e9b" containerName="extract"
Sep 11 19:26:49.613062 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.613041    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.615711 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.615686    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v74bn\""
Sep 11 19:26:49.624430 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.624405    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"]
Sep 11 19:26:49.631841 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.631815    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.631934 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.631850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.631934 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.631868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s7q5\" (UniqueName: \"kubernetes.io/projected/cf82a5cc-f061-40d4-b53d-4a846340e52a-kube-api-access-6s7q5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.631934 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.631891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.632058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.631945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.632058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.631973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.632058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.631998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.632058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.632038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf82a5cc-f061-40d4-b53d-4a846340e52a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.632227 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.632104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.732869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.732827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.732869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.732870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.732888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s7q5\" (UniqueName: \"kubernetes.io/projected/cf82a5cc-f061-40d4-b53d-4a846340e52a-kube-api-access-6s7q5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.732913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.732948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.732974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.733009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.733069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf82a5cc-f061-40d4-b53d-4a846340e52a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733433 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.733100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733433 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.733416    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733574 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.733546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.733576    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.733698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.733556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.734063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.734042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf82a5cc-f061-40d4-b53d-4a846340e52a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.735207 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.735187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.735363 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.735345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.748394 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.748369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s7q5\" (UniqueName: \"kubernetes.io/projected/cf82a5cc-f061-40d4-b53d-4a846340e52a-kube-api-access-6s7q5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.748640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.748623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf82a5cc-f061-40d4-b53d-4a846340e52a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p95bv\" (UID: \"cf82a5cc-f061-40d4-b53d-4a846340e52a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:49.925822 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:49.925730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:50.208318 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:50.208273    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"]
Sep 11 19:26:50.210012 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:26:50.209982    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf82a5cc_f061_40d4_b53d_4a846340e52a.slice/crio-ea201b2f00b2f618544b8cc95e648eff3b2250f9c8fa5fc1f1ea283a2865dcbb WatchSource:0}: Error finding container ea201b2f00b2f618544b8cc95e648eff3b2250f9c8fa5fc1f1ea283a2865dcbb: Status 404 returned error can't find the container with id ea201b2f00b2f618544b8cc95e648eff3b2250f9c8fa5fc1f1ea283a2865dcbb
Sep 11 19:26:50.212182 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:50.212146    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:26:50.212253 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:50.212217    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:26:50.212253 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:50.212245    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:26:50.843751 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:50.843711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv" event={"ID":"cf82a5cc-f061-40d4-b53d-4a846340e52a","Type":"ContainerStarted","Data":"21f7b8e74504452f82a3d02c4517add41de12e75d1eb3da344c7f499ba61e200"}
Sep 11 19:26:50.844136 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:50.843766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv" event={"ID":"cf82a5cc-f061-40d4-b53d-4a846340e52a","Type":"ContainerStarted","Data":"ea201b2f00b2f618544b8cc95e648eff3b2250f9c8fa5fc1f1ea283a2865dcbb"}
Sep 11 19:26:50.865064 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:50.865014    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv" podStartSLOduration=1.864998661 podStartE2EDuration="1.864998661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:50.863342297 +0000 UTC m=+510.884550468" watchObservedRunningTime="2026-09-11 19:26:50.864998661 +0000 UTC m=+510.886206811"
Sep 11 19:26:50.926390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:50.926355    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:51.931538 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:51.931506    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:52.854734 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:52.854696    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:26:52.855764 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:26:52.855742    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:27:24.666108 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.666024    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c686889bc-r4rmz"]
Sep 11 19:27:24.669719 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.669697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:24.672678 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.672657    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pchrp\""
Sep 11 19:27:24.673188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.673166    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 19:27:24.673314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.673227    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 19:27:24.678853 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.678838    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 19:27:24.710173 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.710134    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c686889bc-r4rmz"]
Sep 11 19:27:24.834661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.834620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjzbg\" (UniqueName: \"kubernetes.io/projected/b226f73e-2d0e-4cb8-9618-55febb2f2334-kube-api-access-fjzbg\") pod \"maas-controller-7c686889bc-r4rmz\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") " pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:24.834829 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.834726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-webhook-cert\") pod \"maas-controller-7c686889bc-r4rmz\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") " pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:24.834829 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.834760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-metrics-certs\") pod \"maas-controller-7c686889bc-r4rmz\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") " pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:24.936179 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.936138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-webhook-cert\") pod \"maas-controller-7c686889bc-r4rmz\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") " pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:24.936409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.936188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-metrics-certs\") pod \"maas-controller-7c686889bc-r4rmz\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") " pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:24.936409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.936225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjzbg\" (UniqueName: \"kubernetes.io/projected/b226f73e-2d0e-4cb8-9618-55febb2f2334-kube-api-access-fjzbg\") pod \"maas-controller-7c686889bc-r4rmz\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") " pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:24.936409 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:27:24.936338    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 11 19:27:24.936647 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:27:24.936414    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-metrics-certs podName:b226f73e-2d0e-4cb8-9618-55febb2f2334 nodeName:}" failed. No retries permitted until 2026-09-11 19:27:25.436396766 +0000 UTC m=+545.457604899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-metrics-certs") pod "maas-controller-7c686889bc-r4rmz" (UID: "b226f73e-2d0e-4cb8-9618-55febb2f2334") : secret "maas-controller-metrics-tls" not found
Sep 11 19:27:24.938734 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.938702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-webhook-cert\") pod \"maas-controller-7c686889bc-r4rmz\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") " pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:24.947365 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:24.947344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjzbg\" (UniqueName: \"kubernetes.io/projected/b226f73e-2d0e-4cb8-9618-55febb2f2334-kube-api-access-fjzbg\") pod \"maas-controller-7c686889bc-r4rmz\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") " pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:25.440896 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:25.440859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-metrics-certs\") pod \"maas-controller-7c686889bc-r4rmz\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") " pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:25.443375 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:25.443345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-metrics-certs\") pod \"maas-controller-7c686889bc-r4rmz\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") " pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:25.581458 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:25.581425    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:25.854129 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:25.854104    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c686889bc-r4rmz"]
Sep 11 19:27:25.855673 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:27:25.855642    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb226f73e_2d0e_4cb8_9618_55febb2f2334.slice/crio-8669691ec3c0ba3ac800086a078f258ac08c4f85317c57762db825aeb4d5f61d WatchSource:0}: Error finding container 8669691ec3c0ba3ac800086a078f258ac08c4f85317c57762db825aeb4d5f61d: Status 404 returned error can't find the container with id 8669691ec3c0ba3ac800086a078f258ac08c4f85317c57762db825aeb4d5f61d
Sep 11 19:27:26.027984 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:26.027944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c686889bc-r4rmz" event={"ID":"b226f73e-2d0e-4cb8-9618-55febb2f2334","Type":"ContainerStarted","Data":"8669691ec3c0ba3ac800086a078f258ac08c4f85317c57762db825aeb4d5f61d"}
Sep 11 19:27:29.049001 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:29.048963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c686889bc-r4rmz" event={"ID":"b226f73e-2d0e-4cb8-9618-55febb2f2334","Type":"ContainerStarted","Data":"da413098c90d73de1156bdc41b24da09c98badc9382c45a4455c18774abde1f8"}
Sep 11 19:27:29.049407 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:29.049031    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:29.066321 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:29.066256    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c686889bc-r4rmz" podStartSLOduration=2.708541009 podStartE2EDuration="5.066242217s" totalImagesPullingTime="2.357701208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:27:29.064733135 +0000 UTC m=+549.085941305" watchObservedRunningTime="2026-09-11 19:27:29.066242217 +0000 UTC m=+549.087450400"
Sep 11 19:27:39.959538 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:39.959496    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c686889bc-r4rmz"]
Sep 11 19:27:39.960090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:39.959787    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7c686889bc-r4rmz" podUID="b226f73e-2d0e-4cb8-9618-55febb2f2334" containerName="manager" containerID="cri-o://da413098c90d73de1156bdc41b24da09c98badc9382c45a4455c18774abde1f8" gracePeriod=30
Sep 11 19:27:39.961441 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:39.961414    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:40.108738 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.108705    2580 generic.go:356] "Generic (PLEG): container finished" podID="b226f73e-2d0e-4cb8-9618-55febb2f2334" containerID="da413098c90d73de1156bdc41b24da09c98badc9382c45a4455c18774abde1f8" exitCode=0
Sep 11 19:27:40.108901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.108785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c686889bc-r4rmz" event={"ID":"b226f73e-2d0e-4cb8-9618-55febb2f2334","Type":"ContainerDied","Data":"da413098c90d73de1156bdc41b24da09c98badc9382c45a4455c18774abde1f8"}
Sep 11 19:27:40.211502 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.211440    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:40.275594 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.275561    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-webhook-cert\") pod \"b226f73e-2d0e-4cb8-9618-55febb2f2334\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") "
Sep 11 19:27:40.275769 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.275610    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjzbg\" (UniqueName: \"kubernetes.io/projected/b226f73e-2d0e-4cb8-9618-55febb2f2334-kube-api-access-fjzbg\") pod \"b226f73e-2d0e-4cb8-9618-55febb2f2334\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") "
Sep 11 19:27:40.275769 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.275667    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-metrics-certs\") pod \"b226f73e-2d0e-4cb8-9618-55febb2f2334\" (UID: \"b226f73e-2d0e-4cb8-9618-55febb2f2334\") "
Sep 11 19:27:40.277765 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.277729    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b226f73e-2d0e-4cb8-9618-55febb2f2334" (UID: "b226f73e-2d0e-4cb8-9618-55febb2f2334"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:27:40.277891 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.277786    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b226f73e-2d0e-4cb8-9618-55febb2f2334" (UID: "b226f73e-2d0e-4cb8-9618-55febb2f2334"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:27:40.277946 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.277905    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b226f73e-2d0e-4cb8-9618-55febb2f2334-kube-api-access-fjzbg" (OuterVolumeSpecName: "kube-api-access-fjzbg") pod "b226f73e-2d0e-4cb8-9618-55febb2f2334" (UID: "b226f73e-2d0e-4cb8-9618-55febb2f2334"). InnerVolumeSpecName "kube-api-access-fjzbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:27:40.376758 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.376722    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjzbg\" (UniqueName: \"kubernetes.io/projected/b226f73e-2d0e-4cb8-9618-55febb2f2334-kube-api-access-fjzbg\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:27:40.376758 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.376751    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-metrics-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:27:40.376758 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:40.376760    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b226f73e-2d0e-4cb8-9618-55febb2f2334-webhook-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:27:41.115581 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:41.115547    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c686889bc-r4rmz"
Sep 11 19:27:41.116031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:41.115558    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c686889bc-r4rmz" event={"ID":"b226f73e-2d0e-4cb8-9618-55febb2f2334","Type":"ContainerDied","Data":"8669691ec3c0ba3ac800086a078f258ac08c4f85317c57762db825aeb4d5f61d"}
Sep 11 19:27:41.116031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:41.115679    2580 scope.go:117] "RemoveContainer" containerID="da413098c90d73de1156bdc41b24da09c98badc9382c45a4455c18774abde1f8"
Sep 11 19:27:41.131729 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:41.131695    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c686889bc-r4rmz"]
Sep 11 19:27:41.135411 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:41.135385    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c686889bc-r4rmz"]
Sep 11 19:27:42.449002 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:27:42.448966    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b226f73e-2d0e-4cb8-9618-55febb2f2334" path="/var/lib/kubelet/pods/b226f73e-2d0e-4cb8-9618-55febb2f2334/volumes"
Sep 11 19:28:02.235298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.235242    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"]
Sep 11 19:28:02.235715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.235585    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b226f73e-2d0e-4cb8-9618-55febb2f2334" containerName="manager"
Sep 11 19:28:02.235715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.235597    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b226f73e-2d0e-4cb8-9618-55febb2f2334" containerName="manager"
Sep 11 19:28:02.235715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.235652    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b226f73e-2d0e-4cb8-9618-55febb2f2334" containerName="manager"
Sep 11 19:28:02.239987 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.239970    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"
Sep 11 19:28:02.242843 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.242818    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 19:28:02.250263 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.250235    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"]
Sep 11 19:28:02.374850 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.374804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/185f142d-d0e8-48a5-acc4-0ed64d45f8f4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wwdmv\" (UID: \"185f142d-d0e8-48a5-acc4-0ed64d45f8f4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"
Sep 11 19:28:02.375001 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.374878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht8fr\" (UniqueName: \"kubernetes.io/projected/185f142d-d0e8-48a5-acc4-0ed64d45f8f4-kube-api-access-ht8fr\") pod \"payload-pre-processing-59fbc47bf8-wwdmv\" (UID: \"185f142d-d0e8-48a5-acc4-0ed64d45f8f4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"
Sep 11 19:28:02.475379 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.475341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/185f142d-d0e8-48a5-acc4-0ed64d45f8f4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wwdmv\" (UID: \"185f142d-d0e8-48a5-acc4-0ed64d45f8f4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"
Sep 11 19:28:02.475548 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.475392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht8fr\" (UniqueName: \"kubernetes.io/projected/185f142d-d0e8-48a5-acc4-0ed64d45f8f4-kube-api-access-ht8fr\") pod \"payload-pre-processing-59fbc47bf8-wwdmv\" (UID: \"185f142d-d0e8-48a5-acc4-0ed64d45f8f4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"
Sep 11 19:28:02.476150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.476127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/185f142d-d0e8-48a5-acc4-0ed64d45f8f4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-wwdmv\" (UID: \"185f142d-d0e8-48a5-acc4-0ed64d45f8f4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"
Sep 11 19:28:02.484159 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.484119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht8fr\" (UniqueName: \"kubernetes.io/projected/185f142d-d0e8-48a5-acc4-0ed64d45f8f4-kube-api-access-ht8fr\") pod \"payload-pre-processing-59fbc47bf8-wwdmv\" (UID: \"185f142d-d0e8-48a5-acc4-0ed64d45f8f4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"
Sep 11 19:28:02.551219 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.551130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"
Sep 11 19:28:02.824447 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:02.824351    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"]
Sep 11 19:28:02.829784 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:28:02.829757    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185f142d_d0e8_48a5_acc4_0ed64d45f8f4.slice/crio-14eb8005e981dd4a1c7e1adfaea2b0d8ad8d63a0483d7c3664c08f15019ed530 WatchSource:0}: Error finding container 14eb8005e981dd4a1c7e1adfaea2b0d8ad8d63a0483d7c3664c08f15019ed530: Status 404 returned error can't find the container with id 14eb8005e981dd4a1c7e1adfaea2b0d8ad8d63a0483d7c3664c08f15019ed530
Sep 11 19:28:03.226616 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:03.226579    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv" event={"ID":"185f142d-d0e8-48a5-acc4-0ed64d45f8f4","Type":"ContainerStarted","Data":"14eb8005e981dd4a1c7e1adfaea2b0d8ad8d63a0483d7c3664c08f15019ed530"}
Sep 11 19:28:05.240897 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:05.240861    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv" event={"ID":"185f142d-d0e8-48a5-acc4-0ed64d45f8f4","Type":"ContainerStarted","Data":"e60ef2437b5a7c96c23fc8cf1247406cac6a2a424bd5751b48f26dcf94f8cc0d"}
Sep 11 19:28:05.241428 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:05.240948    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"
Sep 11 19:28:05.257866 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:05.257794    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv" podStartSLOduration=1.759553673 podStartE2EDuration="3.257780862s" totalImagesPullingTime="1.498227189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:28:05.257352529 +0000 UTC m=+585.278560707" watchObservedRunningTime="2026-09-11 19:28:05.257780862 +0000 UTC m=+585.278989012"
Sep 11 19:28:12.278687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:12.278654    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf82a5cc-f061-40d4-b53d-4a846340e52a" containerID="21f7b8e74504452f82a3d02c4517add41de12e75d1eb3da344c7f499ba61e200" exitCode=0
Sep 11 19:28:12.279088 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:12.278726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv" event={"ID":"cf82a5cc-f061-40d4-b53d-4a846340e52a","Type":"ContainerDied","Data":"21f7b8e74504452f82a3d02c4517add41de12e75d1eb3da344c7f499ba61e200"}
Sep 11 19:28:12.279129 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:12.279087    2580 scope.go:117] "RemoveContainer" containerID="21f7b8e74504452f82a3d02c4517add41de12e75d1eb3da344c7f499ba61e200"
Sep 11 19:28:12.280105 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:12.280075    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:28:12.280204 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:12.280141    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:28:12.280204 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:12.280169    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:28:13.285298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:13.285246    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv" event={"ID":"cf82a5cc-f061-40d4-b53d-4a846340e52a","Type":"ContainerStarted","Data":"ad7c0b2df1876c38d685b91ebd313fd86711a53bd8228dc80db25308e9dbc1b7"}
Sep 11 19:28:13.926877 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:13.926839    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:28:13.927104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:13.927077    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p95bv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 11 19:28:13.927163 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:13.927135    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv" podUID="cf82a5cc-f061-40d4-b53d-4a846340e52a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 11 19:28:14.926922 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:14.926883    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p95bv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 11 19:28:14.927344 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:14.926949    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv" podUID="cf82a5cc-f061-40d4-b53d-4a846340e52a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 11 19:28:15.927096 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:15.927062    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p95bv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 11 19:28:15.927602 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:15.927137    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv" podUID="cf82a5cc-f061-40d4-b53d-4a846340e52a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 11 19:28:16.248384 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:16.248355    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-wwdmv"
Sep 11 19:28:16.926978 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:16.926938    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p95bv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 11 19:28:16.927180 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:16.926997    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv" podUID="cf82a5cc-f061-40d4-b53d-4a846340e52a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 11 19:28:17.927018 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:17.926979    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p95bv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 11 19:28:17.927201 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:17.927045    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv" podUID="cf82a5cc-f061-40d4-b53d-4a846340e52a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 11 19:28:18.930390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:18.930360    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:28:18.930745 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:18.930640    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:28:18.931305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:18.931273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p95bv"
Sep 11 19:28:20.372399 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:20.372364    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:28:20.375158 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:20.375136    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:28:55.609025 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.608991    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"]
Sep 11 19:28:55.612267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.612251    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.614662 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.614638    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 19:28:55.614790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.614638    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 19:28:55.614790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.614642    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-phcxt\""
Sep 11 19:28:55.614909 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.614847    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 19:28:55.622011 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.621988    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"]
Sep 11 19:28:55.773573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.773538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.773573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.773575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.773773 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.773618    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klxtl\" (UniqueName: \"kubernetes.io/projected/46b898a2-5406-46a6-a91c-3157f2f6f74c-kube-api-access-klxtl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.773773 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.773650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.773773 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.773671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.773873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.773764    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46b898a2-5406-46a6-a91c-3157f2f6f74c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.875213 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.875114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46b898a2-5406-46a6-a91c-3157f2f6f74c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.875213 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.875183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.875213 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.875199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.875489 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.875228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klxtl\" (UniqueName: \"kubernetes.io/projected/46b898a2-5406-46a6-a91c-3157f2f6f74c-kube-api-access-klxtl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.875489 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.875259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.875489 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.875349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.875712 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.875687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.875790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.875741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.875845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.875793    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.877573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.877555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46b898a2-5406-46a6-a91c-3157f2f6f74c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.877804 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.877788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46b898a2-5406-46a6-a91c-3157f2f6f74c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.882752 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.882716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klxtl\" (UniqueName: \"kubernetes.io/projected/46b898a2-5406-46a6-a91c-3157f2f6f74c-kube-api-access-klxtl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hjmjn\" (UID: \"46b898a2-5406-46a6-a91c-3157f2f6f74c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:55.923715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:55.923686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:28:56.193906 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:56.193873    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"]
Sep 11 19:28:56.195273 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:28:56.195249    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b898a2_5406_46a6_a91c_3157f2f6f74c.slice/crio-ffb2f0b560fcc7c2a11c434084253a304e13e2074614fd14f24eee0d42154d85 WatchSource:0}: Error finding container ffb2f0b560fcc7c2a11c434084253a304e13e2074614fd14f24eee0d42154d85: Status 404 returned error can't find the container with id ffb2f0b560fcc7c2a11c434084253a304e13e2074614fd14f24eee0d42154d85
Sep 11 19:28:56.197141 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:56.197121    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:28:56.536824 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:56.536724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn" event={"ID":"46b898a2-5406-46a6-a91c-3157f2f6f74c","Type":"ContainerStarted","Data":"ffb2f0b560fcc7c2a11c434084253a304e13e2074614fd14f24eee0d42154d85"}
Sep 11 19:28:57.544063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:57.543961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn" event={"ID":"46b898a2-5406-46a6-a91c-3157f2f6f74c","Type":"ContainerStarted","Data":"da6cca1b416a4323221153f0d0bf5b06dcf42b1c7118db6b50571eabfe9e8c54"}
Sep 11 19:28:57.560503 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:28:57.560447    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn" podStartSLOduration=1.5339079899999999 podStartE2EDuration="2.560430118s" totalImagesPullingTime="1.026522128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:28:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:28:57.559857017 +0000 UTC m=+637.581065197" watchObservedRunningTime="2026-09-11 19:28:57.560430118 +0000 UTC m=+637.581638268"
Sep 11 19:29:05.924227 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:05.924183    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:29:05.924661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:05.924256    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:29:05.936809 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:05.936783    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:29:06.600846 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:06.600819    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hjmjn"
Sep 11 19:29:33.305159 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.305118    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"]
Sep 11 19:29:33.309667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.309648    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.311838 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.311815    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 19:29:33.319743 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.319720    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"]
Sep 11 19:29:33.417848 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.417813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nf7s\" (UniqueName: \"kubernetes.io/projected/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-kube-api-access-6nf7s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.417848 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.417855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.418130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.417874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.418130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.418011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.418130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.418090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.418130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.418124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.519472 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.519434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.519472 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.519473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.519715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.519556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nf7s\" (UniqueName: \"kubernetes.io/projected/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-kube-api-access-6nf7s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.519715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.519590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.519715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.519614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.519715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.519670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.519955 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.519928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.520017 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.519981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.520100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.520084    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.522035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.522009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.522238 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.522221    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.527268 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.527240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nf7s\" (UniqueName: \"kubernetes.io/projected/8ba52405-bbed-4fb6-9dc5-1ecb701a75b6-kube-api-access-6nf7s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k\" (UID: \"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.620627 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.620526    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:33.894451 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:33.894425    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"]
Sep 11 19:29:33.895953 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:29:33.895924    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba52405_bbed_4fb6_9dc5_1ecb701a75b6.slice/crio-fd69520275dfdf3bd5b2b8df34e622f2471b33949fe102ebc32165ed2234ef08 WatchSource:0}: Error finding container fd69520275dfdf3bd5b2b8df34e622f2471b33949fe102ebc32165ed2234ef08: Status 404 returned error can't find the container with id fd69520275dfdf3bd5b2b8df34e622f2471b33949fe102ebc32165ed2234ef08
Sep 11 19:29:34.739901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:34.739866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k" event={"ID":"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6","Type":"ContainerStarted","Data":"7a0872bc2217bb7f5360514412e35ddbd0ded0d226bd95f6f5d0ec735312084c"}
Sep 11 19:29:34.740395 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:34.739918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k" event={"ID":"8ba52405-bbed-4fb6-9dc5-1ecb701a75b6","Type":"ContainerStarted","Data":"fd69520275dfdf3bd5b2b8df34e622f2471b33949fe102ebc32165ed2234ef08"}
Sep 11 19:29:34.757317 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:34.757253    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k" podStartSLOduration=1.571722944 podStartE2EDuration="1.757238644s" totalImagesPullingTime="185.5157ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:29:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:34.756087294 +0000 UTC m=+674.777295434" watchObservedRunningTime="2026-09-11 19:29:34.757238644 +0000 UTC m=+674.778446828"
Sep 11 19:29:43.621300 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:43.621240    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:43.621679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:43.621334    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:43.633653 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:43.633626    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:29:43.797361 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:29:43.797334    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k"
Sep 11 19:30:00.141613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:00.141577    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819250-k96th"]
Sep 11 19:30:00.145094 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:00.145072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819250-k96th"
Sep 11 19:30:00.147430 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:00.147405    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:30:00.152186 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:00.152157    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819250-k96th"]
Sep 11 19:30:00.156315 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:00.156275    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819250-k96th"
Sep 11 19:30:00.427048 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:00.427019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819250-k96th"]
Sep 11 19:30:00.429202 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:30:00.429168    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525a974f_6f74_4712_95c9_6e5adda26523.slice/crio-ee40dafc5424a815e636309a270f42efd2c7e2571102e060efb180be0de2a01a WatchSource:0}: Error finding container ee40dafc5424a815e636309a270f42efd2c7e2571102e060efb180be0de2a01a: Status 404 returned error can't find the container with id ee40dafc5424a815e636309a270f42efd2c7e2571102e060efb180be0de2a01a
Sep 11 19:30:00.880386 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:00.880306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819250-k96th" event={"ID":"525a974f-6f74-4712-95c9-6e5adda26523","Type":"ContainerStarted","Data":"ee40dafc5424a815e636309a270f42efd2c7e2571102e060efb180be0de2a01a"}
Sep 11 19:30:09.933015 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:09.932982    2580 generic.go:356] "Generic (PLEG): container finished" podID="525a974f-6f74-4712-95c9-6e5adda26523" containerID="800f832dc0cc9ea1290f19f52fcb2bf539602f434f034184177bcb58404723e9" exitCode=0
Sep 11 19:30:09.933444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:09.933061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819250-k96th" event={"ID":"525a974f-6f74-4712-95c9-6e5adda26523","Type":"ContainerDied","Data":"800f832dc0cc9ea1290f19f52fcb2bf539602f434f034184177bcb58404723e9"}
Sep 11 19:30:11.067169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:11.067137    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819250-k96th"
Sep 11 19:30:11.946041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:11.946014    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819250-k96th"
Sep 11 19:30:11.946209 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:11.946013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819250-k96th" event={"ID":"525a974f-6f74-4712-95c9-6e5adda26523","Type":"ContainerDied","Data":"ee40dafc5424a815e636309a270f42efd2c7e2571102e060efb180be0de2a01a"}
Sep 11 19:30:11.946209 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:11.946136    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee40dafc5424a815e636309a270f42efd2c7e2571102e060efb180be0de2a01a"
Sep 11 19:30:50.767080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.767042    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"]
Sep 11 19:30:50.767572 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.767450    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="525a974f-6f74-4712-95c9-6e5adda26523" containerName="cleanup"
Sep 11 19:30:50.767572 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.767464    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="525a974f-6f74-4712-95c9-6e5adda26523" containerName="cleanup"
Sep 11 19:30:50.767572 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.767536    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="525a974f-6f74-4712-95c9-6e5adda26523" containerName="cleanup"
Sep 11 19:30:50.770780 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.770758    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.773116 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.773097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a0610b-openshift-default-dockercfg-bj5cs\""
Sep 11 19:30:50.784262 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.784237    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"]
Sep 11 19:30:50.819529 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.819498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-certs\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.819961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.819551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-data\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.819961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.819607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-envoy\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.819961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.819623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e84b3895-dc08-4831-923b-9000c7935d7a-istiod-ca-cert\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.819961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.819685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-socket\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.819961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.819703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-credential-socket\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.819961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.819742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-istio-token\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.819961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.819846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e84b3895-dc08-4831-923b-9000c7935d7a-istio-podinfo\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.819961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.819891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttws9\" (UniqueName: \"kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-kube-api-access-ttws9\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.834245 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.834217    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"]
Sep 11 19:30:50.837736 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.837714    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:50.839859 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.839834    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-8fbb58-openshift-default-dockercfg-ckqhf\""
Sep 11 19:30:50.854853 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.854825    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"]
Sep 11 19:30:50.920677 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.920640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-envoy\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.920926 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.920904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e84b3895-dc08-4831-923b-9000c7935d7a-istiod-ca-cert\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.921514 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.921129    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-credential-socket\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:50.921767 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.921747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-socket\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.921901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.921877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-credential-socket\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.922039 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.921914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-podinfo\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:50.922039 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.921940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-socket\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:50.922039 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.921962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-envoy\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:50.922039 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.921981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istiod-ca-cert\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:50.922039 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-data\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:50.922039 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e84b3895-dc08-4831-923b-9000c7935d7a-istiod-ca-cert\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.922039 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-istio-token\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.922458 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-certs\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:50.922458 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-socket\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.922458 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e84b3895-dc08-4831-923b-9000c7935d7a-istio-podinfo\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.922458 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922217    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"]
Sep 11 19:30:50.922458 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-credential-socket\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.922776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttws9\" (UniqueName: \"kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-kube-api-access-ttws9\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.922919 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-certs\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.922919 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922866    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-676kb\" (UniqueName: \"kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-kube-api-access-676kb\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:50.922919 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-data\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.923113 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.922928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-token\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:50.923113 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.923091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-certs\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.923644 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.923614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-envoy\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.923874 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.923847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-data\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.925468 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.925446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e84b3895-dc08-4831-923b-9000c7935d7a-istio-podinfo\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.926551 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.926534    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:50.929515 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.929497    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-1fc808-openshift-default-dockercfg-lwxfw\""
Sep 11 19:30:50.941390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.941359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttws9\" (UniqueName: \"kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-kube-api-access-ttws9\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.948718 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.948695    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-istio-token\") pod \"e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") " pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:50.953204 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:50.953178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"]
Sep 11 19:30:51.023485 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-podinfo\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.023485 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-data\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.023485 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-envoy\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.023709 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-credential-socket\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.023709 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-socket\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.023812 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-data\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.023812 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-socket\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.023812 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-credential-socket\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.024017 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-certs\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.024017 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-676kb\" (UniqueName: \"kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-kube-api-access-676kb\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.024017 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-credential-socket\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.024017 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.023968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-token\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.024017 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-envoy\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.024255 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-socket\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.024255 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istiod-ca-cert\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.024255 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-data\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.024255 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-podinfo\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.024255 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-certs\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.024255 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-token\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.024255 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-certs\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.024255 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pksp2\" (UniqueName: \"kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-kube-api-access-pksp2\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.024685 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/651e7ec9-b53b-4291-9520-555c3b4e1a97-istiod-ca-cert\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.024914 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.024888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istiod-ca-cert\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.026411 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.026388    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-envoy\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.026785 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.026767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-podinfo\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.035830 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.035802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-676kb\" (UniqueName: \"kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-kube-api-access-676kb\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.041390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.041368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-token\") pod \"e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") " pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.082025 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.081978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:51.124947 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.124910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-socket\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.124947 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.124950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-credential-socket\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-certs\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-token\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125322 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pksp2\" (UniqueName: \"kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-kube-api-access-pksp2\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125322 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/651e7ec9-b53b-4291-9520-555c3b4e1a97-istiod-ca-cert\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125322 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-podinfo\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125495 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-data\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125495 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-envoy\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125495 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-socket\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125664 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-credential-socket\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125664 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-certs\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.125891 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.125803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-data\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.126163 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.126143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/651e7ec9-b53b-4291-9520-555c3b4e1a97-istiod-ca-cert\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.127715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.127679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-envoy\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.128314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.127899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-podinfo\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.133761 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.133672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pksp2\" (UniqueName: \"kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-kube-api-access-pksp2\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.137639 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.137406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-token\") pod \"e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") " pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.152185 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.151881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:51.263392 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.263361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:51.362719 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.362690    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"]
Sep 11 19:30:51.363862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:30:51.363836    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode84b3895_dc08_4831_923b_9000c7935d7a.slice/crio-ed7ae93da49cad27c93ee6eb7f1ea661b8b3893855495b331659112fcb186bb0 WatchSource:0}: Error finding container ed7ae93da49cad27c93ee6eb7f1ea661b8b3893855495b331659112fcb186bb0: Status 404 returned error can't find the container with id ed7ae93da49cad27c93ee6eb7f1ea661b8b3893855495b331659112fcb186bb0
Sep 11 19:30:51.365913 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.365880    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:30:51.365994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.365949    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:30:51.365994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.365980    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:30:51.430060 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.430036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"]
Sep 11 19:30:51.431368 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:30:51.431344    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e4efef_a9a7_4a05_8c2a_6572d5a97569.slice/crio-27fa2bf9bba4a84cc1c929947bb2241605c838e79b673a3f85882a8f6131af79 WatchSource:0}: Error finding container 27fa2bf9bba4a84cc1c929947bb2241605c838e79b673a3f85882a8f6131af79: Status 404 returned error can't find the container with id 27fa2bf9bba4a84cc1c929947bb2241605c838e79b673a3f85882a8f6131af79
Sep 11 19:30:51.433624 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.433587    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:30:51.433700 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.433658    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:30:51.433700 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.433689    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:30:51.547916 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.547824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"]
Sep 11 19:30:51.554919 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:30:51.554889    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651e7ec9_b53b_4291_9520_555c3b4e1a97.slice/crio-c7e1669bf4c3028055dad883d20aba6ca1904c9cfd2bddd98a0e2a6be2f5fbcb WatchSource:0}: Error finding container c7e1669bf4c3028055dad883d20aba6ca1904c9cfd2bddd98a0e2a6be2f5fbcb: Status 404 returned error can't find the container with id c7e1669bf4c3028055dad883d20aba6ca1904c9cfd2bddd98a0e2a6be2f5fbcb
Sep 11 19:30:51.557453 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.557408    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:30:51.557539 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.557504    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:30:51.557584 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:51.557550    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:30:52.159824 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.159788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" event={"ID":"e84b3895-dc08-4831-923b-9000c7935d7a","Type":"ContainerStarted","Data":"9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed"}
Sep 11 19:30:52.160249 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.159839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" event={"ID":"e84b3895-dc08-4831-923b-9000c7935d7a","Type":"ContainerStarted","Data":"ed7ae93da49cad27c93ee6eb7f1ea661b8b3893855495b331659112fcb186bb0"}
Sep 11 19:30:52.161531 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.161504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" event={"ID":"651e7ec9-b53b-4291-9520-555c3b4e1a97","Type":"ContainerStarted","Data":"0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76"}
Sep 11 19:30:52.161620 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.161556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" event={"ID":"651e7ec9-b53b-4291-9520-555c3b4e1a97","Type":"ContainerStarted","Data":"c7e1669bf4c3028055dad883d20aba6ca1904c9cfd2bddd98a0e2a6be2f5fbcb"}
Sep 11 19:30:52.163053 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.163028    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" event={"ID":"a5e4efef-a9a7-4a05-8c2a-6572d5a97569","Type":"ContainerStarted","Data":"bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7"}
Sep 11 19:30:52.163172 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.163079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" event={"ID":"a5e4efef-a9a7-4a05-8c2a-6572d5a97569","Type":"ContainerStarted","Data":"27fa2bf9bba4a84cc1c929947bb2241605c838e79b673a3f85882a8f6131af79"}
Sep 11 19:30:52.184720 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.184668    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" podStartSLOduration=2.184654859 podStartE2EDuration="2.184654859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:52.181822028 +0000 UTC m=+752.203030204" watchObservedRunningTime="2026-09-11 19:30:52.184654859 +0000 UTC m=+752.205863009"
Sep 11 19:30:52.201026 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.200982    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" podStartSLOduration=2.200969416 podStartE2EDuration="2.200969416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:52.199128467 +0000 UTC m=+752.220336637" watchObservedRunningTime="2026-09-11 19:30:52.200969416 +0000 UTC m=+752.222177565"
Sep 11 19:30:52.217020 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.216980    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" podStartSLOduration=2.216967579 podStartE2EDuration="2.216967579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:52.216495204 +0000 UTC m=+752.237703394" watchObservedRunningTime="2026-09-11 19:30:52.216967579 +0000 UTC m=+752.238175729"
Sep 11 19:30:52.263836 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.263804    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:52.268740 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:52.268713    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:53.082779 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:53.082742    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:53.087641 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:53.087613    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:53.152559 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:53.152521    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:53.157571 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:53.157543    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:53.168552 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:53.168522    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:53.168947 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:53.168579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:53.169133 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:53.169111    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:30:53.169291 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:53.169250    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:30:53.169372 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:53.169316    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:53.169889 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:53.169872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:30:57.323402 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.323362    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"]
Sep 11 19:30:57.327196 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.327179    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:30:57.329463 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.329446    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-8fbb58-dockercfg-h6qt7\""
Sep 11 19:30:57.329569 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.329544    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-8fbb58\""
Sep 11 19:30:57.339134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.339105    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"]
Sep 11 19:30:57.391196 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.391162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww8c5\" (UniqueName: \"kubernetes.io/projected/86cb66cf-179f-4131-a132-bfe5ce6e3278-kube-api-access-ww8c5\") pod \"payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx\" (UID: \"86cb66cf-179f-4131-a132-bfe5ce6e3278\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:30:57.391382 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.391234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86cb66cf-179f-4131-a132-bfe5ce6e3278-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx\" (UID: \"86cb66cf-179f-4131-a132-bfe5ce6e3278\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:30:57.492071 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.492029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww8c5\" (UniqueName: \"kubernetes.io/projected/86cb66cf-179f-4131-a132-bfe5ce6e3278-kube-api-access-ww8c5\") pod \"payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx\" (UID: \"86cb66cf-179f-4131-a132-bfe5ce6e3278\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:30:57.492262 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.492120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86cb66cf-179f-4131-a132-bfe5ce6e3278-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx\" (UID: \"86cb66cf-179f-4131-a132-bfe5ce6e3278\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:30:57.492875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.492851    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86cb66cf-179f-4131-a132-bfe5ce6e3278-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx\" (UID: \"86cb66cf-179f-4131-a132-bfe5ce6e3278\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:30:57.499688 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.499669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww8c5\" (UniqueName: \"kubernetes.io/projected/86cb66cf-179f-4131-a132-bfe5ce6e3278-kube-api-access-ww8c5\") pod \"payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx\" (UID: \"86cb66cf-179f-4131-a132-bfe5ce6e3278\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:30:57.639671 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.639588    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:30:57.920318 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:57.920271    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"]
Sep 11 19:30:57.922014 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:30:57.921989    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86cb66cf_179f_4131_a132_bfe5ce6e3278.slice/crio-72881b8b0661c03477312a1662784988752c691ce2bffb965965b59955e3131d WatchSource:0}: Error finding container 72881b8b0661c03477312a1662784988752c691ce2bffb965965b59955e3131d: Status 404 returned error can't find the container with id 72881b8b0661c03477312a1662784988752c691ce2bffb965965b59955e3131d
Sep 11 19:30:58.200820 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.200786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx" event={"ID":"86cb66cf-179f-4131-a132-bfe5ce6e3278","Type":"ContainerStarted","Data":"110558543e8688e3d4ea8f54b9506db13a30f50012e28d51eb97fc4009fde163"}
Sep 11 19:30:58.200976 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.200839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx" event={"ID":"86cb66cf-179f-4131-a132-bfe5ce6e3278","Type":"ContainerStarted","Data":"72881b8b0661c03477312a1662784988752c691ce2bffb965965b59955e3131d"}
Sep 11 19:30:58.200976 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.200889    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:30:58.219498 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.219452    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx" podStartSLOduration=1.219437519 podStartE2EDuration="1.219437519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:58.217170053 +0000 UTC m=+758.238378217" watchObservedRunningTime="2026-09-11 19:30:58.219437519 +0000 UTC m=+758.240645686"
Sep 11 19:30:58.257609 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.257579    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"]
Sep 11 19:30:58.261048 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.261028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:30:58.263165 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.263146    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-1fc808\""
Sep 11 19:30:58.273429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.273405    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"]
Sep 11 19:30:58.294915 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.294885    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"]
Sep 11 19:30:58.298518 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.298498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:30:58.302218 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.302193    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-1fc808-dockercfg-jlnjv\""
Sep 11 19:30:58.311559 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.311536    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"]
Sep 11 19:30:58.402021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.401982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8stxk\" (UniqueName: \"kubernetes.io/projected/b0db72d7-d781-411e-9b96-7ad2a3bae024-kube-api-access-8stxk\") pod \"payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x\" (UID: \"b0db72d7-d781-411e-9b96-7ad2a3bae024\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:30:58.402021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.402034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8805746f-0407-416b-96fc-97dd53ecc444-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626\" (UID: \"8805746f-0407-416b-96fc-97dd53ecc444\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:30:58.402539 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.402141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frw64\" (UniqueName: \"kubernetes.io/projected/8805746f-0407-416b-96fc-97dd53ecc444-kube-api-access-frw64\") pod \"payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626\" (UID: \"8805746f-0407-416b-96fc-97dd53ecc444\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:30:58.402539 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.402201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0db72d7-d781-411e-9b96-7ad2a3bae024-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x\" (UID: \"b0db72d7-d781-411e-9b96-7ad2a3bae024\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:30:58.502855 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.502759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frw64\" (UniqueName: \"kubernetes.io/projected/8805746f-0407-416b-96fc-97dd53ecc444-kube-api-access-frw64\") pod \"payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626\" (UID: \"8805746f-0407-416b-96fc-97dd53ecc444\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:30:58.502855 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.502820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0db72d7-d781-411e-9b96-7ad2a3bae024-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x\" (UID: \"b0db72d7-d781-411e-9b96-7ad2a3bae024\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:30:58.503104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.502912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8stxk\" (UniqueName: \"kubernetes.io/projected/b0db72d7-d781-411e-9b96-7ad2a3bae024-kube-api-access-8stxk\") pod \"payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x\" (UID: \"b0db72d7-d781-411e-9b96-7ad2a3bae024\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:30:58.503104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.502937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8805746f-0407-416b-96fc-97dd53ecc444-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626\" (UID: \"8805746f-0407-416b-96fc-97dd53ecc444\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:30:58.503661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.503633    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0db72d7-d781-411e-9b96-7ad2a3bae024-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x\" (UID: \"b0db72d7-d781-411e-9b96-7ad2a3bae024\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:30:58.503758 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.503694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8805746f-0407-416b-96fc-97dd53ecc444-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626\" (UID: \"8805746f-0407-416b-96fc-97dd53ecc444\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:30:58.511234 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.511202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frw64\" (UniqueName: \"kubernetes.io/projected/8805746f-0407-416b-96fc-97dd53ecc444-kube-api-access-frw64\") pod \"payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626\" (UID: \"8805746f-0407-416b-96fc-97dd53ecc444\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:30:58.511437 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.511415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8stxk\" (UniqueName: \"kubernetes.io/projected/b0db72d7-d781-411e-9b96-7ad2a3bae024-kube-api-access-8stxk\") pod \"payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x\" (UID: \"b0db72d7-d781-411e-9b96-7ad2a3bae024\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:30:58.572251 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.572222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:30:58.610548 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.610512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:30:58.849513 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.849484    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"]
Sep 11 19:30:58.851026 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:30:58.850999    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0db72d7_d781_411e_9b96_7ad2a3bae024.slice/crio-60ade4672e79aa5882ef9b85faf2b1be20ae8cb18aa51a4a25e0c404ea691f60 WatchSource:0}: Error finding container 60ade4672e79aa5882ef9b85faf2b1be20ae8cb18aa51a4a25e0c404ea691f60: Status 404 returned error can't find the container with id 60ade4672e79aa5882ef9b85faf2b1be20ae8cb18aa51a4a25e0c404ea691f60
Sep 11 19:30:58.902433 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:58.902406    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"]
Sep 11 19:30:58.903202 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:30:58.903174    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8805746f_0407_416b_96fc_97dd53ecc444.slice/crio-6801c85493057bddecfc15f4adb97a5b779ed9b74c10e0250e36f42207c4d552 WatchSource:0}: Error finding container 6801c85493057bddecfc15f4adb97a5b779ed9b74c10e0250e36f42207c4d552: Status 404 returned error can't find the container with id 6801c85493057bddecfc15f4adb97a5b779ed9b74c10e0250e36f42207c4d552
Sep 11 19:30:59.210073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.210035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626" event={"ID":"8805746f-0407-416b-96fc-97dd53ecc444","Type":"ContainerStarted","Data":"b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53"}
Sep 11 19:30:59.210479 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.210436    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:30:59.210583 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.210497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626" event={"ID":"8805746f-0407-416b-96fc-97dd53ecc444","Type":"ContainerStarted","Data":"6801c85493057bddecfc15f4adb97a5b779ed9b74c10e0250e36f42207c4d552"}
Sep 11 19:30:59.212702 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.212220    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x" event={"ID":"b0db72d7-d781-411e-9b96-7ad2a3bae024","Type":"ContainerStarted","Data":"fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb"}
Sep 11 19:30:59.212702 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.212347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x" event={"ID":"b0db72d7-d781-411e-9b96-7ad2a3bae024","Type":"ContainerStarted","Data":"60ade4672e79aa5882ef9b85faf2b1be20ae8cb18aa51a4a25e0c404ea691f60"}
Sep 11 19:30:59.212702 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.212466    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:30:59.225754 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.225699    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626" podStartSLOduration=1.225642696 podStartE2EDuration="1.225642696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:59.224790868 +0000 UTC m=+759.245999045" watchObservedRunningTime="2026-09-11 19:30:59.225642696 +0000 UTC m=+759.246850848"
Sep 11 19:30:59.243011 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.242958    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x" podStartSLOduration=1.242940143 podStartE2EDuration="1.242940143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:59.240023239 +0000 UTC m=+759.261231411" watchObservedRunningTime="2026-09-11 19:30:59.242940143 +0000 UTC m=+759.264148293"
Sep 11 19:30:59.886682 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.886646    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"]
Sep 11 19:30:59.890808 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.890782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:30:59.892962 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.892939    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cac5b9bc-openshift-default-dockercfg-s999b\""
Sep 11 19:30:59.901994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:30:59.901967    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"]
Sep 11 19:31:00.018194 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.018138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c20bca-37d9-4455-8ad6-9e31db65b248-istiod-ca-cert\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.018415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.018245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-token\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.018415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.018296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-certs\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.018415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.018366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-podinfo\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.018415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.018397    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-credential-socket\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.018626 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.018427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-socket\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.018626 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.018499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59ghh\" (UniqueName: \"kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-kube-api-access-59ghh\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.018626 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.018529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-envoy\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.018626 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.018552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-data\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.119360 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.119321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-credential-socket\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.119539 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.119365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-socket\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.119539 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.119439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59ghh\" (UniqueName: \"kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-kube-api-access-59ghh\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.119539 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.119471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-envoy\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.119539 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.119515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-data\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.119758 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.119591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c20bca-37d9-4455-8ad6-9e31db65b248-istiod-ca-cert\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.119758 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.119661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-token\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.119948 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.119893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-socket\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.120090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.119949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-data\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.120090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.119999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-certs\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.120199 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.120087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-podinfo\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.120379 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.120355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c20bca-37d9-4455-8ad6-9e31db65b248-istiod-ca-cert\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.120435 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.120356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-certs\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.120435 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.120423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-credential-socket\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.121911 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.121889    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-envoy\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.122588 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.122558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-podinfo\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.131314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.131249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-token\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.131406 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.131362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59ghh\" (UniqueName: \"kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-kube-api-access-59ghh\") pod \"e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") " pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.205035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.205004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:00.506409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.506382    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"]
Sep 11 19:31:00.508967 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:31:00.508943    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c20bca_37d9_4455_8ad6_9e31db65b248.slice/crio-ac7effbc35dc6b7916fe840def1dde8307ad3d8eb0eaca96cd57cfac6b5573f0 WatchSource:0}: Error finding container ac7effbc35dc6b7916fe840def1dde8307ad3d8eb0eaca96cd57cfac6b5573f0: Status 404 returned error can't find the container with id ac7effbc35dc6b7916fe840def1dde8307ad3d8eb0eaca96cd57cfac6b5573f0
Sep 11 19:31:00.511342 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.511308    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:00.511446 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.511379    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:00.511446 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:00.511407    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:01.231554 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:01.231510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" event={"ID":"50c20bca-37d9-4455-8ad6-9e31db65b248","Type":"ContainerStarted","Data":"5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d"}
Sep 11 19:31:01.232054 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:01.231582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" event={"ID":"50c20bca-37d9-4455-8ad6-9e31db65b248","Type":"ContainerStarted","Data":"ac7effbc35dc6b7916fe840def1dde8307ad3d8eb0eaca96cd57cfac6b5573f0"}
Sep 11 19:31:01.255263 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:01.255190    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" podStartSLOduration=2.255168324 podStartE2EDuration="2.255168324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:01.249515628 +0000 UTC m=+761.270723788" watchObservedRunningTime="2026-09-11 19:31:01.255168324 +0000 UTC m=+761.276376476"
Sep 11 19:31:02.205825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:02.205790    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:02.224709 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:02.224668    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:02.249339 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:02.249275    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:02.250680 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:02.250651    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:06.591251 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.591220    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"]
Sep 11 19:31:06.604550 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.604520    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:06.608478 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.608446    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"]
Sep 11 19:31:06.611332 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.609581    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-cac5b9bc\""
Sep 11 19:31:06.611332 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.609824    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-cac5b9bc-dockercfg-ztkmd\""
Sep 11 19:31:06.691777 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.691637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wztrd\" (UniqueName: \"kubernetes.io/projected/84c365d4-b6f1-4c22-9ab3-896c747d2830-kube-api-access-wztrd\") pod \"payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2\" (UID: \"84c365d4-b6f1-4c22-9ab3-896c747d2830\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:06.691777 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.691707    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84c365d4-b6f1-4c22-9ab3-896c747d2830-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2\" (UID: \"84c365d4-b6f1-4c22-9ab3-896c747d2830\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:06.792883 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.792845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wztrd\" (UniqueName: \"kubernetes.io/projected/84c365d4-b6f1-4c22-9ab3-896c747d2830-kube-api-access-wztrd\") pod \"payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2\" (UID: \"84c365d4-b6f1-4c22-9ab3-896c747d2830\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:06.793034 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.792908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84c365d4-b6f1-4c22-9ab3-896c747d2830-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2\" (UID: \"84c365d4-b6f1-4c22-9ab3-896c747d2830\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:06.793875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.793837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84c365d4-b6f1-4c22-9ab3-896c747d2830-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2\" (UID: \"84c365d4-b6f1-4c22-9ab3-896c747d2830\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:06.802958 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.802923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wztrd\" (UniqueName: \"kubernetes.io/projected/84c365d4-b6f1-4c22-9ab3-896c747d2830-kube-api-access-wztrd\") pod \"payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2\" (UID: \"84c365d4-b6f1-4c22-9ab3-896c747d2830\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:06.933899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:06.933856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:07.252329 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:07.252301    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"]
Sep 11 19:31:07.289057 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:07.289020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2" event={"ID":"84c365d4-b6f1-4c22-9ab3-896c747d2830","Type":"ContainerStarted","Data":"a95ee8190bb8a8b4b940b8437b39abe95785ad3e0bce7956e64ca94325da7112"}
Sep 11 19:31:08.299697 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:08.298700    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2" event={"ID":"84c365d4-b6f1-4c22-9ab3-896c747d2830","Type":"ContainerStarted","Data":"dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d"}
Sep 11 19:31:08.299697 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:08.299641    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:08.317804 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:08.317733    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2" podStartSLOduration=2.317712352 podStartE2EDuration="2.317712352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:08.315297373 +0000 UTC m=+768.336505538" watchObservedRunningTime="2026-09-11 19:31:08.317712352 +0000 UTC m=+768.338920505"
Sep 11 19:31:09.210635 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:09.210446    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 19:31:09.210635 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:09.210487    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 19:31:09.210635 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:09.210538    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:31:09.210635 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:09.210540    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:31:09.215104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:09.214833    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:31:10.226314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.226261    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:31:10.226769 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.226509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:31:10.333344 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.333296    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"]
Sep 11 19:31:10.337652 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.337617    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:31:10.338478 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.338406    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"]
Sep 11 19:31:10.341091 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.341056    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-6afc47\""
Sep 11 19:31:10.343352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.343177    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:31:10.345580 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.345552    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-6afc47-dockercfg-cnnjn\""
Sep 11 19:31:10.352733 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.352695    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"]
Sep 11 19:31:10.363669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.363636    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"]
Sep 11 19:31:10.449211 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.449167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29451453-bb90-438a-9158-036d9f47f16f-plugins-config-volume\") pod \"payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g\" (UID: \"29451453-bb90-438a-9158-036d9f47f16f\") " pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:31:10.449427 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.449273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5bbt\" (UniqueName: \"kubernetes.io/projected/44194c1a-c104-41d3-925a-a32e956dd183-kube-api-access-l5bbt\") pod \"payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn\" (UID: \"44194c1a-c104-41d3-925a-a32e956dd183\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:31:10.449427 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.449389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44194c1a-c104-41d3-925a-a32e956dd183-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn\" (UID: \"44194c1a-c104-41d3-925a-a32e956dd183\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:31:10.449551 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.449444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pllwq\" (UniqueName: \"kubernetes.io/projected/29451453-bb90-438a-9158-036d9f47f16f-kube-api-access-pllwq\") pod \"payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g\" (UID: \"29451453-bb90-438a-9158-036d9f47f16f\") " pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:31:10.550129 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.550028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29451453-bb90-438a-9158-036d9f47f16f-plugins-config-volume\") pod \"payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g\" (UID: \"29451453-bb90-438a-9158-036d9f47f16f\") " pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:31:10.550129 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.550095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5bbt\" (UniqueName: \"kubernetes.io/projected/44194c1a-c104-41d3-925a-a32e956dd183-kube-api-access-l5bbt\") pod \"payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn\" (UID: \"44194c1a-c104-41d3-925a-a32e956dd183\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:31:10.550424 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.550134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44194c1a-c104-41d3-925a-a32e956dd183-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn\" (UID: \"44194c1a-c104-41d3-925a-a32e956dd183\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:31:10.550424 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.550170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pllwq\" (UniqueName: \"kubernetes.io/projected/29451453-bb90-438a-9158-036d9f47f16f-kube-api-access-pllwq\") pod \"payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g\" (UID: \"29451453-bb90-438a-9158-036d9f47f16f\") " pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:31:10.550918 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.550893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29451453-bb90-438a-9158-036d9f47f16f-plugins-config-volume\") pod \"payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g\" (UID: \"29451453-bb90-438a-9158-036d9f47f16f\") " pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:31:10.551010 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.550965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44194c1a-c104-41d3-925a-a32e956dd183-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn\" (UID: \"44194c1a-c104-41d3-925a-a32e956dd183\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:31:10.570588 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.570537    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5bbt\" (UniqueName: \"kubernetes.io/projected/44194c1a-c104-41d3-925a-a32e956dd183-kube-api-access-l5bbt\") pod \"payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn\" (UID: \"44194c1a-c104-41d3-925a-a32e956dd183\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:31:10.570948 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.570924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pllwq\" (UniqueName: \"kubernetes.io/projected/29451453-bb90-438a-9158-036d9f47f16f-kube-api-access-pllwq\") pod \"payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g\" (UID: \"29451453-bb90-438a-9158-036d9f47f16f\") " pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:31:10.656111 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.656068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:31:10.665387 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.665357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:31:10.978696 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:31:10.978645    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44194c1a_c104_41d3_925a_a32e956dd183.slice/crio-ab6b0af655fb561bac30ec7d0b81aa37a6b390610c82ef85a92fe14b113330ba WatchSource:0}: Error finding container ab6b0af655fb561bac30ec7d0b81aa37a6b390610c82ef85a92fe14b113330ba: Status 404 returned error can't find the container with id ab6b0af655fb561bac30ec7d0b81aa37a6b390610c82ef85a92fe14b113330ba
Sep 11 19:31:10.978839 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.978690    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"]
Sep 11 19:31:10.981906 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:31:10.981883    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29451453_bb90_438a_9158_036d9f47f16f.slice/crio-c98d727a88dbbb7a803fd303134b3122f9f025623645ac56f091ab689abbfcb3 WatchSource:0}: Error finding container c98d727a88dbbb7a803fd303134b3122f9f025623645ac56f091ab689abbfcb3: Status 404 returned error can't find the container with id c98d727a88dbbb7a803fd303134b3122f9f025623645ac56f091ab689abbfcb3
Sep 11 19:31:10.982520 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:10.982498    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"]
Sep 11 19:31:11.336009 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:11.335906    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g" event={"ID":"29451453-bb90-438a-9158-036d9f47f16f","Type":"ContainerStarted","Data":"601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc"}
Sep 11 19:31:11.336009 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:11.335981    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g" event={"ID":"29451453-bb90-438a-9158-036d9f47f16f","Type":"ContainerStarted","Data":"c98d727a88dbbb7a803fd303134b3122f9f025623645ac56f091ab689abbfcb3"}
Sep 11 19:31:11.336674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:11.336657    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:31:11.339398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:11.339314    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn" event={"ID":"44194c1a-c104-41d3-925a-a32e956dd183","Type":"ContainerStarted","Data":"f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c"}
Sep 11 19:31:11.339398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:11.339365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn" event={"ID":"44194c1a-c104-41d3-925a-a32e956dd183","Type":"ContainerStarted","Data":"ab6b0af655fb561bac30ec7d0b81aa37a6b390610c82ef85a92fe14b113330ba"}
Sep 11 19:31:11.339640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:11.339606    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:31:11.357582 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:11.357536    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g" podStartSLOduration=1.357520829 podStartE2EDuration="1.357520829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:11.353334918 +0000 UTC m=+771.374543081" watchObservedRunningTime="2026-09-11 19:31:11.357520829 +0000 UTC m=+771.378728979"
Sep 11 19:31:11.369641 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:11.369250    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn" podStartSLOduration=1.369233356 podStartE2EDuration="1.369233356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:11.368965515 +0000 UTC m=+771.390173694" watchObservedRunningTime="2026-09-11 19:31:11.369233356 +0000 UTC m=+771.390441546"
Sep 11 19:31:12.346523 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.346481    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerID="bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7" exitCode=0
Sep 11 19:31:12.346523 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.346514    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" event={"ID":"a5e4efef-a9a7-4a05-8c2a-6572d5a97569","Type":"ContainerDied","Data":"bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7"}
Sep 11 19:31:12.347086 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.347054    2580 scope.go:117] "RemoveContainer" containerID="bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7"
Sep 11 19:31:12.348494 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.348461    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:12.348622 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.348536    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:12.348622 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.348578    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:12.348875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.348857    2580 generic.go:356] "Generic (PLEG): container finished" podID="e84b3895-dc08-4831-923b-9000c7935d7a" containerID="9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed" exitCode=0
Sep 11 19:31:12.348950 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.348929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" event={"ID":"e84b3895-dc08-4831-923b-9000c7935d7a","Type":"ContainerDied","Data":"9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed"}
Sep 11 19:31:12.349503 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.349487    2580 scope.go:117] "RemoveContainer" containerID="9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed"
Sep 11 19:31:12.350634 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.350605    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:12.350707 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.350677    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:12.350767 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:12.350709    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:13.360695 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:13.360597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" event={"ID":"a5e4efef-a9a7-4a05-8c2a-6572d5a97569","Type":"ContainerStarted","Data":"6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa"}
Sep 11 19:31:13.365602 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:13.365558    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" event={"ID":"e84b3895-dc08-4831-923b-9000c7935d7a","Type":"ContainerStarted","Data":"cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e"}
Sep 11 19:31:14.083303 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:14.083102    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:31:14.083303 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:14.083242    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 19:31:14.083576 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:14.083310    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 19:31:14.153431 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:14.153383    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:31:14.153667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:14.153637    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 19:31:14.153749 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:14.153713    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 19:31:15.083135 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:15.083098    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 19:31:15.083535 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:15.083154    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 19:31:15.153099 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:15.153061    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 19:31:15.153419 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:15.153375    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 19:31:16.083782 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:16.083736    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 19:31:16.084275 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:16.083820    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 19:31:16.152804 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:16.152764    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 19:31:16.153006 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:16.152831    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 19:31:17.083305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:17.083074    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 19:31:17.083305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:17.083133    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 19:31:17.171439 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:17.171402    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 19:31:17.172009 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:17.171976    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 19:31:18.083252 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:18.083208    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 19:31:18.083480 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:18.083270    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 19:31:18.152785 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:18.152745    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 19:31:18.153104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:18.153061    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 19:31:19.083328 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.082822    2580 patch_prober.go:28] interesting pod/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 19:31:19.083328 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.082897    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 19:31:19.158312 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.157669    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 19:31:19.158312 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.157735    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 19:31:19.447433 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.447387    2580 generic.go:356] "Generic (PLEG): container finished" podID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerID="0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76" exitCode=0
Sep 11 19:31:19.447736 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.447450    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" event={"ID":"651e7ec9-b53b-4291-9520-555c3b4e1a97","Type":"ContainerDied","Data":"0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76"}
Sep 11 19:31:19.448254 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.448229    2580 scope.go:117] "RemoveContainer" containerID="0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76"
Sep 11 19:31:19.449947 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.449697    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:19.449947 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.449767    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:19.449947 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.449798    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:19.841169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.841057    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"]
Sep 11 19:31:19.846060 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.846031    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:31:19.849526 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.849499    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-515a4f\""
Sep 11 19:31:19.863378 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.863348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"]
Sep 11 19:31:19.940971 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.940917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8a409d-b983-4d80-9b23-16b4128daf6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg\" (UID: \"de8a409d-b983-4d80-9b23-16b4128daf6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:31:19.941158 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:19.940998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn8lh\" (UniqueName: \"kubernetes.io/projected/de8a409d-b983-4d80-9b23-16b4128daf6b-kube-api-access-xn8lh\") pod \"payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg\" (UID: \"de8a409d-b983-4d80-9b23-16b4128daf6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:31:20.042188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.042141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8a409d-b983-4d80-9b23-16b4128daf6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg\" (UID: \"de8a409d-b983-4d80-9b23-16b4128daf6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:31:20.042367 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.042242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn8lh\" (UniqueName: \"kubernetes.io/projected/de8a409d-b983-4d80-9b23-16b4128daf6b-kube-api-access-xn8lh\") pod \"payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg\" (UID: \"de8a409d-b983-4d80-9b23-16b4128daf6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:31:20.043593 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.043566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8a409d-b983-4d80-9b23-16b4128daf6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg\" (UID: \"de8a409d-b983-4d80-9b23-16b4128daf6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:31:20.050810 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.050782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn8lh\" (UniqueName: \"kubernetes.io/projected/de8a409d-b983-4d80-9b23-16b4128daf6b-kube-api-access-xn8lh\") pod \"payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg\" (UID: \"de8a409d-b983-4d80-9b23-16b4128daf6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:31:20.086541 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.086514    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:31:20.086963 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.086943    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:31:20.087659 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.087639    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:31:20.158459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.158377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:31:20.158720 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.158692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:31:20.159403 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.159382    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:31:20.161603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.161580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:31:20.351305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.350405    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:20.459850 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.459808    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" event={"ID":"651e7ec9-b53b-4291-9520-555c3b4e1a97","Type":"ContainerStarted","Data":"061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0"}
Sep 11 19:31:20.522450 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:20.522396    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"]
Sep 11 19:31:20.523862 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:31:20.523812    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8a409d_b983_4d80_9b23_16b4128daf6b.slice/crio-82a0ada02c35bd0ed75b9514ae247eacb472d7463a4ef9cc34e0dbb81756fd22 WatchSource:0}: Error finding container 82a0ada02c35bd0ed75b9514ae247eacb472d7463a4ef9cc34e0dbb81756fd22: Status 404 returned error can't find the container with id 82a0ada02c35bd0ed75b9514ae247eacb472d7463a4ef9cc34e0dbb81756fd22
Sep 11 19:31:21.265419 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:21.265376    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:31:21.265858 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:21.265558    2580 patch_prober.go:28] interesting pod/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 11 19:31:21.265858 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:21.265597    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 11 19:31:21.467670 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:21.467631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg" event={"ID":"de8a409d-b983-4d80-9b23-16b4128daf6b","Type":"ContainerStarted","Data":"fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312"}
Sep 11 19:31:21.467916 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:21.467692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg" event={"ID":"de8a409d-b983-4d80-9b23-16b4128daf6b","Type":"ContainerStarted","Data":"82a0ada02c35bd0ed75b9514ae247eacb472d7463a4ef9cc34e0dbb81756fd22"}
Sep 11 19:31:21.488451 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:21.488403    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg" podStartSLOduration=2.488386008 podStartE2EDuration="2.488386008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:21.48598286 +0000 UTC m=+781.507191069" watchObservedRunningTime="2026-09-11 19:31:21.488386008 +0000 UTC m=+781.509594158"
Sep 11 19:31:22.264392 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:22.264347    2580 patch_prober.go:28] interesting pod/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 11 19:31:22.264589 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:22.264421    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 11 19:31:22.351499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:22.351462    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:31:22.476248 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:22.476221    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:31:22.936436 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:22.936396    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"]
Sep 11 19:31:22.939824 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:22.939800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"
Sep 11 19:31:22.942064 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:22.942040    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:31:22.942248 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:22.942045    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:31:22.952897 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:22.952857    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"]
Sep 11 19:31:22.979125 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:22.979081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk\" (UID: \"7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"
Sep 11 19:31:23.079757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:23.079716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk\" (UID: \"7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"
Sep 11 19:31:23.080649 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:23.080623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk\" (UID: \"7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"
Sep 11 19:31:23.168327 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:23.168263    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:31:23.251795 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:23.251697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"
Sep 11 19:31:23.264323 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:23.264092    2580 patch_prober.go:28] interesting pod/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 11 19:31:23.264323 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:23.264170    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 11 19:31:23.367664 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:23.367637    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:31:23.561536 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:31:23.561503    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7a2e9d_fa35_4a1b_b0a4_7a430bc63fa1.slice/crio-9c80a7d989b87c7cbef04b67f3e490309354fecc1823cd684e21978a8e4b814b WatchSource:0}: Error finding container 9c80a7d989b87c7cbef04b67f3e490309354fecc1823cd684e21978a8e4b814b: Status 404 returned error can't find the container with id 9c80a7d989b87c7cbef04b67f3e490309354fecc1823cd684e21978a8e4b814b
Sep 11 19:31:23.562152 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:23.562088    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"]
Sep 11 19:31:24.263784 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:24.263699    2580 patch_prober.go:28] interesting pod/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 11 19:31:24.263784 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:24.263758    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 11 19:31:24.491571 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:24.491531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk" event={"ID":"7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1","Type":"ContainerStarted","Data":"8788b3680e631bb1567da5a35a8e17881b00391e25fa1392a52a0ecaddc024c7"}
Sep 11 19:31:24.491971 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:24.491597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk" event={"ID":"7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1","Type":"ContainerStarted","Data":"9c80a7d989b87c7cbef04b67f3e490309354fecc1823cd684e21978a8e4b814b"}
Sep 11 19:31:24.511403 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:24.511341    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk" podStartSLOduration=2.511314645 podStartE2EDuration="2.511314645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:24.505565448 +0000 UTC m=+784.526773627" watchObservedRunningTime="2026-09-11 19:31:24.511314645 +0000 UTC m=+784.532522796"
Sep 11 19:31:25.263887 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:25.263848    2580 patch_prober.go:28] interesting pod/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 11 19:31:25.264094 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:25.263902    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 11 19:31:25.504560 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:25.504518    2580 generic.go:356] "Generic (PLEG): container finished" podID="7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1" containerID="8788b3680e631bb1567da5a35a8e17881b00391e25fa1392a52a0ecaddc024c7" exitCode=0
Sep 11 19:31:25.505070 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:25.504619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk" event={"ID":"7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1","Type":"ContainerDied","Data":"8788b3680e631bb1567da5a35a8e17881b00391e25fa1392a52a0ecaddc024c7"}
Sep 11 19:31:25.506964 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:25.506932    2580 generic.go:356] "Generic (PLEG): container finished" podID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerID="5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d" exitCode=0
Sep 11 19:31:25.507103 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:25.506984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" event={"ID":"50c20bca-37d9-4455-8ad6-9e31db65b248","Type":"ContainerDied","Data":"5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d"}
Sep 11 19:31:25.507483 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:25.507463    2580 scope.go:117] "RemoveContainer" containerID="5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d"
Sep 11 19:31:25.509293 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:25.509224    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:25.509400 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:25.509345    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:25.509470 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:25.509400    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:26.268486 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:26.268456    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:31:26.269821 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:26.269794    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:31:26.520603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:26.520501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" event={"ID":"50c20bca-37d9-4455-8ad6-9e31db65b248","Type":"ContainerStarted","Data":"22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5"}
Sep 11 19:31:26.687134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:26.687112    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"
Sep 11 19:31:26.836825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:26.836729    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1-maas-api-service-ca\") pod \"7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1\" (UID: \"7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1\") "
Sep 11 19:31:26.837087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:26.837050    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1" (UID: "7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:31:26.837272 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:26.837243    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:27.205262 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:27.205214    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:27.205729 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:27.205700    2580 patch_prober.go:28] interesting pod/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:27.205846 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:27.205769    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 19:31:27.533150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:27.533060    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"
Sep 11 19:31:27.533150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:27.533103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk" event={"ID":"7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1","Type":"ContainerDied","Data":"9c80a7d989b87c7cbef04b67f3e490309354fecc1823cd684e21978a8e4b814b"}
Sep 11 19:31:27.533657 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:27.533161    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c80a7d989b87c7cbef04b67f3e490309354fecc1823cd684e21978a8e4b814b"
Sep 11 19:31:28.206004 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:28.205555    2580 patch_prober.go:28] interesting pod/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:28.206004 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:28.205623    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 19:31:29.206548 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:29.206510    2580 patch_prober.go:28] interesting pod/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:29.207117 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:29.207082    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 19:31:30.205831 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:30.205786    2580 patch_prober.go:28] interesting pod/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:30.206422 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:30.206384    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 19:31:31.206414 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:31.206369    2580 patch_prober.go:28] interesting pod/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:31.207000 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:31.206965    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 19:31:32.210207 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:32.210171    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:32.210634 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:32.210482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:32.211261 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:32.211244    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:33.484883 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:33.484853    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:31:33.971016 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:33.970979    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"]
Sep 11 19:31:33.971211 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:33.971191    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2" podUID="84c365d4-b6f1-4c22-9ab3-896c747d2830" containerName="payload-pre-processing" containerID="cri-o://dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d" gracePeriod=30
Sep 11 19:31:34.203329 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.203294    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"]
Sep 11 19:31:34.208606 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.208582    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cac5b9bc-gq6bk"]
Sep 11 19:31:34.239075 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.239051    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:34.333765 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.333731    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"]
Sep 11 19:31:34.418474 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.418441    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84c365d4-b6f1-4c22-9ab3-896c747d2830-plugins-config-volume\") pod \"84c365d4-b6f1-4c22-9ab3-896c747d2830\" (UID: \"84c365d4-b6f1-4c22-9ab3-896c747d2830\") "
Sep 11 19:31:34.418645 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.418543    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wztrd\" (UniqueName: \"kubernetes.io/projected/84c365d4-b6f1-4c22-9ab3-896c747d2830-kube-api-access-wztrd\") pod \"84c365d4-b6f1-4c22-9ab3-896c747d2830\" (UID: \"84c365d4-b6f1-4c22-9ab3-896c747d2830\") "
Sep 11 19:31:34.418912 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.418885    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84c365d4-b6f1-4c22-9ab3-896c747d2830-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "84c365d4-b6f1-4c22-9ab3-896c747d2830" (UID: "84c365d4-b6f1-4c22-9ab3-896c747d2830"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:31:34.420854 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.420817    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c365d4-b6f1-4c22-9ab3-896c747d2830-kube-api-access-wztrd" (OuterVolumeSpecName: "kube-api-access-wztrd") pod "84c365d4-b6f1-4c22-9ab3-896c747d2830" (UID: "84c365d4-b6f1-4c22-9ab3-896c747d2830"). InnerVolumeSpecName "kube-api-access-wztrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:31:34.457022 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.455582    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1" path="/var/lib/kubelet/pods/7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1/volumes"
Sep 11 19:31:34.519623 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.519587    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wztrd\" (UniqueName: \"kubernetes.io/projected/84c365d4-b6f1-4c22-9ab3-896c747d2830-kube-api-access-wztrd\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:34.519623 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.519616    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84c365d4-b6f1-4c22-9ab3-896c747d2830-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:34.575266 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.575232    2580 generic.go:356] "Generic (PLEG): container finished" podID="84c365d4-b6f1-4c22-9ab3-896c747d2830" containerID="dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d" exitCode=0
Sep 11 19:31:34.575457 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.575298    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"
Sep 11 19:31:34.575457 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.575314    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2" event={"ID":"84c365d4-b6f1-4c22-9ab3-896c747d2830","Type":"ContainerDied","Data":"dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d"}
Sep 11 19:31:34.575457 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.575365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2" event={"ID":"84c365d4-b6f1-4c22-9ab3-896c747d2830","Type":"ContainerDied","Data":"a95ee8190bb8a8b4b940b8437b39abe95785ad3e0bce7956e64ca94325da7112"}
Sep 11 19:31:34.575457 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.575396    2580 scope.go:117] "RemoveContainer" containerID="dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d"
Sep 11 19:31:34.575682 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.575639    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy" containerID="cri-o://22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5" gracePeriod=30
Sep 11 19:31:34.584707 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.584689    2580 scope.go:117] "RemoveContainer" containerID="dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d"
Sep 11 19:31:34.585007 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:31:34.584984    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d\": container with ID starting with dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d not found: ID does not exist" containerID="dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d"
Sep 11 19:31:34.585076 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.585020    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d"} err="failed to get container status \"dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d\": rpc error: code = NotFound desc = could not find container \"dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d\": container with ID starting with dec5f4785406b9ecbbeb39b998e8b9b9d9e664fa068f0fdebcaf1212516f4a5d not found: ID does not exist"
Sep 11 19:31:34.614031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.613998    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"]
Sep 11 19:31:34.623232 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:34.623210    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cac5b9bc-6b99884f94-lb2p2"]
Sep 11 19:31:36.450382 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:36.450342    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84c365d4-b6f1-4c22-9ab3-896c747d2830" path="/var/lib/kubelet/pods/84c365d4-b6f1-4c22-9ab3-896c747d2830/volumes"
Sep 11 19:31:39.850583 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.850525    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:39.970385 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-data\") pod \"50c20bca-37d9-4455-8ad6-9e31db65b248\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") "
Sep 11 19:31:39.970573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970422    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-podinfo\") pod \"50c20bca-37d9-4455-8ad6-9e31db65b248\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") "
Sep 11 19:31:39.970573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970468    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-socket\") pod \"50c20bca-37d9-4455-8ad6-9e31db65b248\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") "
Sep 11 19:31:39.970573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970524    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-envoy\") pod \"50c20bca-37d9-4455-8ad6-9e31db65b248\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") "
Sep 11 19:31:39.970573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970521    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-data" (OuterVolumeSpecName: "istio-data") pod "50c20bca-37d9-4455-8ad6-9e31db65b248" (UID: "50c20bca-37d9-4455-8ad6-9e31db65b248"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:31:39.970573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970555    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-token\") pod \"50c20bca-37d9-4455-8ad6-9e31db65b248\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") "
Sep 11 19:31:39.970842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970596    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-certs\") pod \"50c20bca-37d9-4455-8ad6-9e31db65b248\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") "
Sep 11 19:31:39.970842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970689    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59ghh\" (UniqueName: \"kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-kube-api-access-59ghh\") pod \"50c20bca-37d9-4455-8ad6-9e31db65b248\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") "
Sep 11 19:31:39.970842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970732    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c20bca-37d9-4455-8ad6-9e31db65b248-istiod-ca-cert\") pod \"50c20bca-37d9-4455-8ad6-9e31db65b248\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") "
Sep 11 19:31:39.970842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970762    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-credential-socket\") pod \"50c20bca-37d9-4455-8ad6-9e31db65b248\" (UID: \"50c20bca-37d9-4455-8ad6-9e31db65b248\") "
Sep 11 19:31:39.970842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970813    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50c20bca-37d9-4455-8ad6-9e31db65b248" (UID: "50c20bca-37d9-4455-8ad6-9e31db65b248"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:31:39.971092 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.970931    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50c20bca-37d9-4455-8ad6-9e31db65b248" (UID: "50c20bca-37d9-4455-8ad6-9e31db65b248"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:31:39.971155 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.971111    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50c20bca-37d9-4455-8ad6-9e31db65b248" (UID: "50c20bca-37d9-4455-8ad6-9e31db65b248"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:31:39.971155 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.971130    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:39.971155 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.971130    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50c20bca-37d9-4455-8ad6-9e31db65b248-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50c20bca-37d9-4455-8ad6-9e31db65b248" (UID: "50c20bca-37d9-4455-8ad6-9e31db65b248"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:31:39.971155 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.971148    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:39.971399 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.971160    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:39.972868 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.972835    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50c20bca-37d9-4455-8ad6-9e31db65b248" (UID: "50c20bca-37d9-4455-8ad6-9e31db65b248"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:31:39.972983 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.972899    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-token" (OuterVolumeSpecName: "istio-token") pod "50c20bca-37d9-4455-8ad6-9e31db65b248" (UID: "50c20bca-37d9-4455-8ad6-9e31db65b248"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:31:39.973051 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.972986    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50c20bca-37d9-4455-8ad6-9e31db65b248" (UID: "50c20bca-37d9-4455-8ad6-9e31db65b248"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:31:39.973051 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:39.973008    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-kube-api-access-59ghh" (OuterVolumeSpecName: "kube-api-access-59ghh") pod "50c20bca-37d9-4455-8ad6-9e31db65b248" (UID: "50c20bca-37d9-4455-8ad6-9e31db65b248"). InnerVolumeSpecName "kube-api-access-59ghh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:31:40.072012 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.071977    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:40.072012 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.072007    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59ghh\" (UniqueName: \"kubernetes.io/projected/50c20bca-37d9-4455-8ad6-9e31db65b248-kube-api-access-59ghh\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:40.072221 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.072022    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c20bca-37d9-4455-8ad6-9e31db65b248-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:40.072221 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.072034    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:40.072221 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.072043    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:40.072221 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.072051    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c20bca-37d9-4455-8ad6-9e31db65b248-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:31:40.616102 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.616061    2580 generic.go:356] "Generic (PLEG): container finished" podID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerID="22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5" exitCode=0
Sep 11 19:31:40.616314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.616116    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"
Sep 11 19:31:40.616314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.616149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" event={"ID":"50c20bca-37d9-4455-8ad6-9e31db65b248","Type":"ContainerDied","Data":"22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5"}
Sep 11 19:31:40.616314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.616199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94" event={"ID":"50c20bca-37d9-4455-8ad6-9e31db65b248","Type":"ContainerDied","Data":"ac7effbc35dc6b7916fe840def1dde8307ad3d8eb0eaca96cd57cfac6b5573f0"}
Sep 11 19:31:40.616314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.616222    2580 scope.go:117] "RemoveContainer" containerID="22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5"
Sep 11 19:31:40.625640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.625619    2580 scope.go:117] "RemoveContainer" containerID="5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d"
Sep 11 19:31:40.634315 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.634292    2580 scope.go:117] "RemoveContainer" containerID="22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5"
Sep 11 19:31:40.634568 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:31:40.634551    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5\": container with ID starting with 22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5 not found: ID does not exist" containerID="22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5"
Sep 11 19:31:40.634621 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.634575    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5"} err="failed to get container status \"22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5\": rpc error: code = NotFound desc = could not find container \"22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5\": container with ID starting with 22050d1dea32c45b707a7e4152de73baf59e243b07a8e7ca38f9041b26c46ae5 not found: ID does not exist"
Sep 11 19:31:40.634621 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.634596    2580 scope.go:117] "RemoveContainer" containerID="5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d"
Sep 11 19:31:40.634844 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:31:40.634826    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d\": container with ID starting with 5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d not found: ID does not exist" containerID="5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d"
Sep 11 19:31:40.634930 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.634849    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d"} err="failed to get container status \"5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d\": rpc error: code = NotFound desc = could not find container \"5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d\": container with ID starting with 5d0aa51664be0b5142206330b07dc6098a8fa885657c0f3a286969758226fa6d not found: ID does not exist"
Sep 11 19:31:40.638905 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.638879    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"]
Sep 11 19:31:40.642663 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:40.642641    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cac5b9bc-openshift-default-dc6b6cf8d-72q94"]
Sep 11 19:31:42.019001 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.018964    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"]
Sep 11 19:31:42.019425 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.019410    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c365d4-b6f1-4c22-9ab3-896c747d2830" containerName="payload-pre-processing"
Sep 11 19:31:42.019425 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.019426    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c365d4-b6f1-4c22-9ab3-896c747d2830" containerName="payload-pre-processing"
Sep 11 19:31:42.019511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.019440    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy"
Sep 11 19:31:42.019511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.019446    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy"
Sep 11 19:31:42.019511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.019465    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1" containerName="revoke-keys"
Sep 11 19:31:42.019511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.019472    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1" containerName="revoke-keys"
Sep 11 19:31:42.019643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.019540    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy"
Sep 11 19:31:42.019643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.019549    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c365d4-b6f1-4c22-9ab3-896c747d2830" containerName="payload-pre-processing"
Sep 11 19:31:42.019643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.019557    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a7a2e9d-fa35-4a1b-b0a4-7a430bc63fa1" containerName="revoke-keys"
Sep 11 19:31:42.022525 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.022509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:31:42.025368 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.025345    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-da3756c4\""
Sep 11 19:31:42.032465 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.032264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"]
Sep 11 19:31:42.090314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.090268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4\" (UID: \"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:31:42.090314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.090316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md8f7\" (UniqueName: \"kubernetes.io/projected/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-kube-api-access-md8f7\") pod \"payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4\" (UID: \"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:31:42.190994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.190957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4\" (UID: \"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:31:42.190994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.190994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8f7\" (UniqueName: \"kubernetes.io/projected/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-kube-api-access-md8f7\") pod \"payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4\" (UID: \"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:31:42.191676 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.191648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4\" (UID: \"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:31:42.198620 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.198596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md8f7\" (UniqueName: \"kubernetes.io/projected/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-kube-api-access-md8f7\") pod \"payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4\" (UID: \"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:31:42.334505 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.334418    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:31:42.449970 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.449938    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" path="/var/lib/kubelet/pods/50c20bca-37d9-4455-8ad6-9e31db65b248/volumes"
Sep 11 19:31:42.605361 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.605337    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"]
Sep 11 19:31:42.606403 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:31:42.606381    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7fb2748_a77b_4ac8_854e_37cb2f8bd21c.slice/crio-62efa04e63f382e1c343a0825b191a4ded3a2a1d56259a986f2a978f0fe1a5de WatchSource:0}: Error finding container 62efa04e63f382e1c343a0825b191a4ded3a2a1d56259a986f2a978f0fe1a5de: Status 404 returned error can't find the container with id 62efa04e63f382e1c343a0825b191a4ded3a2a1d56259a986f2a978f0fe1a5de
Sep 11 19:31:42.631024 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:42.630989    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4" event={"ID":"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c","Type":"ContainerStarted","Data":"62efa04e63f382e1c343a0825b191a4ded3a2a1d56259a986f2a978f0fe1a5de"}
Sep 11 19:31:43.638839 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:43.638795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4" event={"ID":"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c","Type":"ContainerStarted","Data":"7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c"}
Sep 11 19:31:43.639184 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:43.638878    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:31:43.655505 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:43.655456    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4" podStartSLOduration=2.655442225 podStartE2EDuration="2.655442225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:43.654252886 +0000 UTC m=+803.675461049" watchObservedRunningTime="2026-09-11 19:31:43.655442225 +0000 UTC m=+803.676650375"
Sep 11 19:31:54.651148 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:31:54.651118    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:32:03.334701 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.334663    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"]
Sep 11 19:32:03.335104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.335091    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy"
Sep 11 19:32:03.335150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.335106    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy"
Sep 11 19:32:03.335194 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.335185    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c20bca-37d9-4455-8ad6-9e31db65b248" containerName="istio-proxy"
Sep 11 19:32:03.337659 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.337641    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"
Sep 11 19:32:03.339966 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.339945    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:32:03.340057 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.339968    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:32:03.345665 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.345560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"]
Sep 11 19:32:03.393205 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.393165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01349349-5d80-49e1-a99c-99de4c3db382-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d\" (UID: \"01349349-5d80-49e1-a99c-99de4c3db382\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"
Sep 11 19:32:03.494406 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.494358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01349349-5d80-49e1-a99c-99de4c3db382-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d\" (UID: \"01349349-5d80-49e1-a99c-99de4c3db382\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"
Sep 11 19:32:03.494935 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.494906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01349349-5d80-49e1-a99c-99de4c3db382-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d\" (UID: \"01349349-5d80-49e1-a99c-99de4c3db382\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"
Sep 11 19:32:03.649962 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.649874    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"
Sep 11 19:32:03.921530 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:03.921500    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"]
Sep 11 19:32:03.922666 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:32:03.922641    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01349349_5d80_49e1_a99c_99de4c3db382.slice/crio-0b374009b7ccfa69f0cedae8dbafc52811164c01766476d1c6f3512aed4cb957 WatchSource:0}: Error finding container 0b374009b7ccfa69f0cedae8dbafc52811164c01766476d1c6f3512aed4cb957: Status 404 returned error can't find the container with id 0b374009b7ccfa69f0cedae8dbafc52811164c01766476d1c6f3512aed4cb957
Sep 11 19:32:04.771265 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:04.771165    2580 generic.go:356] "Generic (PLEG): container finished" podID="01349349-5d80-49e1-a99c-99de4c3db382" containerID="75b3866197f060237bb8e15cdc9b86bdba866c2dda420acdd22541434974c1c9" exitCode=0
Sep 11 19:32:04.771265 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:04.771241    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d" event={"ID":"01349349-5d80-49e1-a99c-99de4c3db382","Type":"ContainerDied","Data":"75b3866197f060237bb8e15cdc9b86bdba866c2dda420acdd22541434974c1c9"}
Sep 11 19:32:04.771698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:04.771329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d" event={"ID":"01349349-5d80-49e1-a99c-99de4c3db382","Type":"ContainerStarted","Data":"0b374009b7ccfa69f0cedae8dbafc52811164c01766476d1c6f3512aed4cb957"}
Sep 11 19:32:05.913554 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:05.913528    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"
Sep 11 19:32:06.023237 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:06.023194    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01349349-5d80-49e1-a99c-99de4c3db382-maas-api-service-ca\") pod \"01349349-5d80-49e1-a99c-99de4c3db382\" (UID: \"01349349-5d80-49e1-a99c-99de4c3db382\") "
Sep 11 19:32:06.023572 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:06.023546    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01349349-5d80-49e1-a99c-99de4c3db382-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "01349349-5d80-49e1-a99c-99de4c3db382" (UID: "01349349-5d80-49e1-a99c-99de4c3db382"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:06.124124 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:06.124038    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01349349-5d80-49e1-a99c-99de4c3db382-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:32:06.784936 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:06.784855    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"
Sep 11 19:32:06.784936 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:06.784900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d" event={"ID":"01349349-5d80-49e1-a99c-99de4c3db382","Type":"ContainerDied","Data":"0b374009b7ccfa69f0cedae8dbafc52811164c01766476d1c6f3512aed4cb957"}
Sep 11 19:32:06.785113 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:06.784945    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b374009b7ccfa69f0cedae8dbafc52811164c01766476d1c6f3512aed4cb957"
Sep 11 19:32:09.934172 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:09.934136    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"]
Sep 11 19:32:09.934666 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:09.934398    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4" podUID="e7fb2748-a77b-4ac8-854e-37cb2f8bd21c" containerName="payload-pre-processing" containerID="cri-o://7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c" gracePeriod=30
Sep 11 19:32:10.201499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.201470    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:32:10.210519 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.210491    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"]
Sep 11 19:32:10.238444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.238412    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-da3756c4-87k8d"]
Sep 11 19:32:10.267944 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.267909    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md8f7\" (UniqueName: \"kubernetes.io/projected/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-kube-api-access-md8f7\") pod \"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c\" (UID: \"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c\") "
Sep 11 19:32:10.268104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.268010    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-plugins-config-volume\") pod \"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c\" (UID: \"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c\") "
Sep 11 19:32:10.268464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.268440    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e7fb2748-a77b-4ac8-854e-37cb2f8bd21c" (UID: "e7fb2748-a77b-4ac8-854e-37cb2f8bd21c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:10.270001 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.269970    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-kube-api-access-md8f7" (OuterVolumeSpecName: "kube-api-access-md8f7") pod "e7fb2748-a77b-4ac8-854e-37cb2f8bd21c" (UID: "e7fb2748-a77b-4ac8-854e-37cb2f8bd21c"). InnerVolumeSpecName "kube-api-access-md8f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:32:10.369751 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.369711    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md8f7\" (UniqueName: \"kubernetes.io/projected/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-kube-api-access-md8f7\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:32:10.369751 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.369741    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:32:10.449493 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.449406    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01349349-5d80-49e1-a99c-99de4c3db382" path="/var/lib/kubelet/pods/01349349-5d80-49e1-a99c-99de4c3db382/volumes"
Sep 11 19:32:10.815379 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.815256    2580 generic.go:356] "Generic (PLEG): container finished" podID="e7fb2748-a77b-4ac8-854e-37cb2f8bd21c" containerID="7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c" exitCode=0
Sep 11 19:32:10.815379 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.815319    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"
Sep 11 19:32:10.815379 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.815349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4" event={"ID":"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c","Type":"ContainerDied","Data":"7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c"}
Sep 11 19:32:10.815628 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.815405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4" event={"ID":"e7fb2748-a77b-4ac8-854e-37cb2f8bd21c","Type":"ContainerDied","Data":"62efa04e63f382e1c343a0825b191a4ded3a2a1d56259a986f2a978f0fe1a5de"}
Sep 11 19:32:10.815628 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.815427    2580 scope.go:117] "RemoveContainer" containerID="7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c"
Sep 11 19:32:10.825100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.825084    2580 scope.go:117] "RemoveContainer" containerID="7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c"
Sep 11 19:32:10.825371 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:32:10.825354    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c\": container with ID starting with 7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c not found: ID does not exist" containerID="7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c"
Sep 11 19:32:10.825420 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.825378    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c"} err="failed to get container status \"7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c\": rpc error: code = NotFound desc = could not find container \"7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c\": container with ID starting with 7e40d355916837aff154d2baaee33045aca7ec552184cd9213686dd6461d8b9c not found: ID does not exist"
Sep 11 19:32:10.833931 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.833907    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"]
Sep 11 19:32:10.841293 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:10.841256    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-da3756c4-7bb7c9c574-ggcr4"]
Sep 11 19:32:12.449129 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:12.449097    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7fb2748-a77b-4ac8-854e-37cb2f8bd21c" path="/var/lib/kubelet/pods/e7fb2748-a77b-4ac8-854e-37cb2f8bd21c/volumes"
Sep 11 19:32:16.862108 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.862076    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"]
Sep 11 19:32:16.862724 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.862702    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7fb2748-a77b-4ac8-854e-37cb2f8bd21c" containerName="payload-pre-processing"
Sep 11 19:32:16.862804 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.862726    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7fb2748-a77b-4ac8-854e-37cb2f8bd21c" containerName="payload-pre-processing"
Sep 11 19:32:16.862804 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.862771    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01349349-5d80-49e1-a99c-99de4c3db382" containerName="revoke-keys"
Sep 11 19:32:16.862804 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.862780    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01349349-5d80-49e1-a99c-99de4c3db382" containerName="revoke-keys"
Sep 11 19:32:16.862951 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.862874    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01349349-5d80-49e1-a99c-99de4c3db382" containerName="revoke-keys"
Sep 11 19:32:16.862951 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.862890    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7fb2748-a77b-4ac8-854e-37cb2f8bd21c" containerName="payload-pre-processing"
Sep 11 19:32:16.864923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.864904    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:16.867249 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.867226    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-846167e5-dockercfg-g79d5\""
Sep 11 19:32:16.867249 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.867246    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-846167e5\""
Sep 11 19:32:16.875757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.875730    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"]
Sep 11 19:32:16.883496 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.883467    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"]
Sep 11 19:32:16.886430 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.886403    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:16.897775 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:16.897747    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"]
Sep 11 19:32:17.035846 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.035801    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dssqf\" (UniqueName: \"kubernetes.io/projected/c5ab6827-34ce-4952-af76-4ab220c704fb-kube-api-access-dssqf\") pod \"payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv\" (UID: \"c5ab6827-34ce-4952-af76-4ab220c704fb\") " pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:17.036040 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.035928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fgd8\" (UniqueName: \"kubernetes.io/projected/1fa70a0d-37ec-4ffa-9570-4e63896c3550-kube-api-access-4fgd8\") pod \"payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68\" (UID: \"1fa70a0d-37ec-4ffa-9570-4e63896c3550\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:17.036040 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.036022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ab6827-34ce-4952-af76-4ab220c704fb-plugins-config-volume\") pod \"payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv\" (UID: \"c5ab6827-34ce-4952-af76-4ab220c704fb\") " pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:17.036135 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.036052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa70a0d-37ec-4ffa-9570-4e63896c3550-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68\" (UID: \"1fa70a0d-37ec-4ffa-9570-4e63896c3550\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:17.137546 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.137446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgd8\" (UniqueName: \"kubernetes.io/projected/1fa70a0d-37ec-4ffa-9570-4e63896c3550-kube-api-access-4fgd8\") pod \"payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68\" (UID: \"1fa70a0d-37ec-4ffa-9570-4e63896c3550\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:17.137546 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.137535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ab6827-34ce-4952-af76-4ab220c704fb-plugins-config-volume\") pod \"payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv\" (UID: \"c5ab6827-34ce-4952-af76-4ab220c704fb\") " pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:17.137789 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.137565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa70a0d-37ec-4ffa-9570-4e63896c3550-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68\" (UID: \"1fa70a0d-37ec-4ffa-9570-4e63896c3550\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:17.137789 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.137652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dssqf\" (UniqueName: \"kubernetes.io/projected/c5ab6827-34ce-4952-af76-4ab220c704fb-kube-api-access-dssqf\") pod \"payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv\" (UID: \"c5ab6827-34ce-4952-af76-4ab220c704fb\") " pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:17.138345 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.138323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ab6827-34ce-4952-af76-4ab220c704fb-plugins-config-volume\") pod \"payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv\" (UID: \"c5ab6827-34ce-4952-af76-4ab220c704fb\") " pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:17.138418 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.138358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa70a0d-37ec-4ffa-9570-4e63896c3550-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68\" (UID: \"1fa70a0d-37ec-4ffa-9570-4e63896c3550\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:17.148199 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.148170    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fgd8\" (UniqueName: \"kubernetes.io/projected/1fa70a0d-37ec-4ffa-9570-4e63896c3550-kube-api-access-4fgd8\") pod \"payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68\" (UID: \"1fa70a0d-37ec-4ffa-9570-4e63896c3550\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:17.148359 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.148219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dssqf\" (UniqueName: \"kubernetes.io/projected/c5ab6827-34ce-4952-af76-4ab220c704fb-kube-api-access-dssqf\") pod \"payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv\" (UID: \"c5ab6827-34ce-4952-af76-4ab220c704fb\") " pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:17.176416 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.176388    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:17.198809 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.198776    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:17.455160 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.455133    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"]
Sep 11 19:32:17.455945 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:32:17.455915    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa70a0d_37ec_4ffa_9570_4e63896c3550.slice/crio-75dabd63d0cbc53600b211a4c85ffb892de4baea96788f9b10f3854fca3352d3 WatchSource:0}: Error finding container 75dabd63d0cbc53600b211a4c85ffb892de4baea96788f9b10f3854fca3352d3: Status 404 returned error can't find the container with id 75dabd63d0cbc53600b211a4c85ffb892de4baea96788f9b10f3854fca3352d3
Sep 11 19:32:17.488907 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.488876    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"]
Sep 11 19:32:17.489626 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:32:17.489607    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ab6827_34ce_4952_af76_4ab220c704fb.slice/crio-bfca1f09d4a8e15d444f4abffb1fec39db79f52014ba3a8c7d11a9619e82637a WatchSource:0}: Error finding container bfca1f09d4a8e15d444f4abffb1fec39db79f52014ba3a8c7d11a9619e82637a: Status 404 returned error can't find the container with id bfca1f09d4a8e15d444f4abffb1fec39db79f52014ba3a8c7d11a9619e82637a
Sep 11 19:32:17.861132 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.861033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68" event={"ID":"1fa70a0d-37ec-4ffa-9570-4e63896c3550","Type":"ContainerStarted","Data":"95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb"}
Sep 11 19:32:17.861132 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.861084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68" event={"ID":"1fa70a0d-37ec-4ffa-9570-4e63896c3550","Type":"ContainerStarted","Data":"75dabd63d0cbc53600b211a4c85ffb892de4baea96788f9b10f3854fca3352d3"}
Sep 11 19:32:17.861392 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.861128    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:17.862655 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.862631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv" event={"ID":"c5ab6827-34ce-4952-af76-4ab220c704fb","Type":"ContainerStarted","Data":"c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356"}
Sep 11 19:32:17.862962 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.862669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv" event={"ID":"c5ab6827-34ce-4952-af76-4ab220c704fb","Type":"ContainerStarted","Data":"bfca1f09d4a8e15d444f4abffb1fec39db79f52014ba3a8c7d11a9619e82637a"}
Sep 11 19:32:17.862962 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.862689    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:17.876122 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.876055    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68" podStartSLOduration=1.876041055 podStartE2EDuration="1.876041055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:32:17.875310015 +0000 UTC m=+837.896518184" watchObservedRunningTime="2026-09-11 19:32:17.876041055 +0000 UTC m=+837.897249204"
Sep 11 19:32:17.890415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:17.890372    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv" podStartSLOduration=1.8903590000000001 podStartE2EDuration="1.890359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:32:17.888696902 +0000 UTC m=+837.909905074" watchObservedRunningTime="2026-09-11 19:32:17.890359 +0000 UTC m=+837.911567149"
Sep 11 19:32:28.872321 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:28.872258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:28.872767 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:28.872371    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:39.270163 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.270124    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"]
Sep 11 19:32:39.273409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.273393    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"
Sep 11 19:32:39.275662 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.275636    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:32:39.275662 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.275655    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:32:39.283194 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.283168    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"]
Sep 11 19:32:39.358598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.358557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c761555d-9ec6-44f1-b0b7-59cb06cdba2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-846167e5-wsnsn\" (UID: \"c761555d-9ec6-44f1-b0b7-59cb06cdba2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"
Sep 11 19:32:39.459430 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.459393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c761555d-9ec6-44f1-b0b7-59cb06cdba2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-846167e5-wsnsn\" (UID: \"c761555d-9ec6-44f1-b0b7-59cb06cdba2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"
Sep 11 19:32:39.460085 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.460057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c761555d-9ec6-44f1-b0b7-59cb06cdba2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-846167e5-wsnsn\" (UID: \"c761555d-9ec6-44f1-b0b7-59cb06cdba2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"
Sep 11 19:32:39.584858 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.584761    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"
Sep 11 19:32:39.859965 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.859937    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"]
Sep 11 19:32:39.862162 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:32:39.862136    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc761555d_9ec6_44f1_b0b7_59cb06cdba2b.slice/crio-1442e36d1df5f600bab356f34630679aebc08e0346ccbb036564543301ce6460 WatchSource:0}: Error finding container 1442e36d1df5f600bab356f34630679aebc08e0346ccbb036564543301ce6460: Status 404 returned error can't find the container with id 1442e36d1df5f600bab356f34630679aebc08e0346ccbb036564543301ce6460
Sep 11 19:32:39.996400 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:39.996360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn" event={"ID":"c761555d-9ec6-44f1-b0b7-59cb06cdba2b","Type":"ContainerStarted","Data":"1442e36d1df5f600bab356f34630679aebc08e0346ccbb036564543301ce6460"}
Sep 11 19:32:41.004405 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:41.004368    2580 generic.go:356] "Generic (PLEG): container finished" podID="c761555d-9ec6-44f1-b0b7-59cb06cdba2b" containerID="956597142b19f7d740ed0059521de33f4702cfdbd00b5a24687d08e1fa36cc45" exitCode=0
Sep 11 19:32:41.004782 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:41.004428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn" event={"ID":"c761555d-9ec6-44f1-b0b7-59cb06cdba2b","Type":"ContainerDied","Data":"956597142b19f7d740ed0059521de33f4702cfdbd00b5a24687d08e1fa36cc45"}
Sep 11 19:32:42.149630 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:42.149603    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"
Sep 11 19:32:42.293106 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:42.293019    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c761555d-9ec6-44f1-b0b7-59cb06cdba2b-maas-api-service-ca\") pod \"c761555d-9ec6-44f1-b0b7-59cb06cdba2b\" (UID: \"c761555d-9ec6-44f1-b0b7-59cb06cdba2b\") "
Sep 11 19:32:42.293478 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:42.293440    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c761555d-9ec6-44f1-b0b7-59cb06cdba2b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c761555d-9ec6-44f1-b0b7-59cb06cdba2b" (UID: "c761555d-9ec6-44f1-b0b7-59cb06cdba2b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:42.394707 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:42.394669    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c761555d-9ec6-44f1-b0b7-59cb06cdba2b-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:32:43.024025 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:43.023997    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"
Sep 11 19:32:43.024227 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:43.023998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn" event={"ID":"c761555d-9ec6-44f1-b0b7-59cb06cdba2b","Type":"ContainerDied","Data":"1442e36d1df5f600bab356f34630679aebc08e0346ccbb036564543301ce6460"}
Sep 11 19:32:43.024227 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:43.024173    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1442e36d1df5f600bab356f34630679aebc08e0346ccbb036564543301ce6460"
Sep 11 19:32:45.272695 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.272658    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"]
Sep 11 19:32:45.273091 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.272913    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv" podUID="c5ab6827-34ce-4952-af76-4ab220c704fb" containerName="payload-processing" containerID="cri-o://c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356" gracePeriod=30
Sep 11 19:32:45.283560 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.283530    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"]
Sep 11 19:32:45.283845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.283806    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68" podUID="1fa70a0d-37ec-4ffa-9570-4e63896c3550" containerName="payload-pre-processing" containerID="cri-o://95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb" gracePeriod=30
Sep 11 19:32:45.438108 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.438072    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"]
Sep 11 19:32:45.441733 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.441702    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-846167e5-wsnsn"]
Sep 11 19:32:45.560120 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.560030    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:45.587232 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.587202    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:45.628916 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.628886    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dssqf\" (UniqueName: \"kubernetes.io/projected/c5ab6827-34ce-4952-af76-4ab220c704fb-kube-api-access-dssqf\") pod \"c5ab6827-34ce-4952-af76-4ab220c704fb\" (UID: \"c5ab6827-34ce-4952-af76-4ab220c704fb\") "
Sep 11 19:32:45.629108 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.629029    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ab6827-34ce-4952-af76-4ab220c704fb-plugins-config-volume\") pod \"c5ab6827-34ce-4952-af76-4ab220c704fb\" (UID: \"c5ab6827-34ce-4952-af76-4ab220c704fb\") "
Sep 11 19:32:45.629429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.629408    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ab6827-34ce-4952-af76-4ab220c704fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c5ab6827-34ce-4952-af76-4ab220c704fb" (UID: "c5ab6827-34ce-4952-af76-4ab220c704fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:45.634048 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.634018    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ab6827-34ce-4952-af76-4ab220c704fb-kube-api-access-dssqf" (OuterVolumeSpecName: "kube-api-access-dssqf") pod "c5ab6827-34ce-4952-af76-4ab220c704fb" (UID: "c5ab6827-34ce-4952-af76-4ab220c704fb"). InnerVolumeSpecName "kube-api-access-dssqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:32:45.729875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.729838    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa70a0d-37ec-4ffa-9570-4e63896c3550-plugins-config-volume\") pod \"1fa70a0d-37ec-4ffa-9570-4e63896c3550\" (UID: \"1fa70a0d-37ec-4ffa-9570-4e63896c3550\") "
Sep 11 19:32:45.730066 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.729903    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fgd8\" (UniqueName: \"kubernetes.io/projected/1fa70a0d-37ec-4ffa-9570-4e63896c3550-kube-api-access-4fgd8\") pod \"1fa70a0d-37ec-4ffa-9570-4e63896c3550\" (UID: \"1fa70a0d-37ec-4ffa-9570-4e63896c3550\") "
Sep 11 19:32:45.730231 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.730205    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fa70a0d-37ec-4ffa-9570-4e63896c3550-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1fa70a0d-37ec-4ffa-9570-4e63896c3550" (UID: "1fa70a0d-37ec-4ffa-9570-4e63896c3550"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:45.730334 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.730315    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ab6827-34ce-4952-af76-4ab220c704fb-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:32:45.730391 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.730339    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dssqf\" (UniqueName: \"kubernetes.io/projected/c5ab6827-34ce-4952-af76-4ab220c704fb-kube-api-access-dssqf\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:32:45.731895 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.731876    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa70a0d-37ec-4ffa-9570-4e63896c3550-kube-api-access-4fgd8" (OuterVolumeSpecName: "kube-api-access-4fgd8") pod "1fa70a0d-37ec-4ffa-9570-4e63896c3550" (UID: "1fa70a0d-37ec-4ffa-9570-4e63896c3550"). InnerVolumeSpecName "kube-api-access-4fgd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:32:45.831112 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.831023    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fgd8\" (UniqueName: \"kubernetes.io/projected/1fa70a0d-37ec-4ffa-9570-4e63896c3550-kube-api-access-4fgd8\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:32:45.831112 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:45.831055    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa70a0d-37ec-4ffa-9570-4e63896c3550-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:32:46.042210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.042176    2580 generic.go:356] "Generic (PLEG): container finished" podID="1fa70a0d-37ec-4ffa-9570-4e63896c3550" containerID="95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb" exitCode=0
Sep 11 19:32:46.042456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.042223    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"
Sep 11 19:32:46.042456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.042269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68" event={"ID":"1fa70a0d-37ec-4ffa-9570-4e63896c3550","Type":"ContainerDied","Data":"95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb"}
Sep 11 19:32:46.042456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.042359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68" event={"ID":"1fa70a0d-37ec-4ffa-9570-4e63896c3550","Type":"ContainerDied","Data":"75dabd63d0cbc53600b211a4c85ffb892de4baea96788f9b10f3854fca3352d3"}
Sep 11 19:32:46.042456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.042390    2580 scope.go:117] "RemoveContainer" containerID="95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb"
Sep 11 19:32:46.043655 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.043635    2580 generic.go:356] "Generic (PLEG): container finished" podID="c5ab6827-34ce-4952-af76-4ab220c704fb" containerID="c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356" exitCode=0
Sep 11 19:32:46.043728 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.043679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv" event={"ID":"c5ab6827-34ce-4952-af76-4ab220c704fb","Type":"ContainerDied","Data":"c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356"}
Sep 11 19:32:46.043787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.043745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv" event={"ID":"c5ab6827-34ce-4952-af76-4ab220c704fb","Type":"ContainerDied","Data":"bfca1f09d4a8e15d444f4abffb1fec39db79f52014ba3a8c7d11a9619e82637a"}
Sep 11 19:32:46.043787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.043684    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"
Sep 11 19:32:46.052449 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.052422    2580 scope.go:117] "RemoveContainer" containerID="95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb"
Sep 11 19:32:46.059701 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:32:46.059673    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb\": container with ID starting with 95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb not found: ID does not exist" containerID="95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb"
Sep 11 19:32:46.059889 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.059853    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb"} err="failed to get container status \"95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb\": rpc error: code = NotFound desc = could not find container \"95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb\": container with ID starting with 95dc719d2420fa1da145a8714b0e2a006a56cebd5d893ec85d54184c8f5f69bb not found: ID does not exist"
Sep 11 19:32:46.060005 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.059890    2580 scope.go:117] "RemoveContainer" containerID="c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356"
Sep 11 19:32:46.069363 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.069334    2580 scope.go:117] "RemoveContainer" containerID="c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356"
Sep 11 19:32:46.069747 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:32:46.069716    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356\": container with ID starting with c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356 not found: ID does not exist" containerID="c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356"
Sep 11 19:32:46.069821 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.069771    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356"} err="failed to get container status \"c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356\": rpc error: code = NotFound desc = could not find container \"c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356\": container with ID starting with c1eb7d508be5df9849f9ae713823bbd206a0de3b92f66cd33e0949ceb0c92356 not found: ID does not exist"
Sep 11 19:32:46.076270 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.076247    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"]
Sep 11 19:32:46.079950 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.079926    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-846167e5-7dd7d84574-xzl68"]
Sep 11 19:32:46.089775 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.089726    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"]
Sep 11 19:32:46.095932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.095907    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-846167e5-6969cc6bf5-b76lv"]
Sep 11 19:32:46.450016 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.449983    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa70a0d-37ec-4ffa-9570-4e63896c3550" path="/var/lib/kubelet/pods/1fa70a0d-37ec-4ffa-9570-4e63896c3550/volumes"
Sep 11 19:32:46.450394 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.450366    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5ab6827-34ce-4952-af76-4ab220c704fb" path="/var/lib/kubelet/pods/c5ab6827-34ce-4952-af76-4ab220c704fb/volumes"
Sep 11 19:32:46.450662 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:46.450650    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c761555d-9ec6-44f1-b0b7-59cb06cdba2b" path="/var/lib/kubelet/pods/c761555d-9ec6-44f1-b0b7-59cb06cdba2b/volumes"
Sep 11 19:32:54.735380 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.735344    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"]
Sep 11 19:32:54.735825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.735787    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa70a0d-37ec-4ffa-9570-4e63896c3550" containerName="payload-pre-processing"
Sep 11 19:32:54.735825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.735800    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa70a0d-37ec-4ffa-9570-4e63896c3550" containerName="payload-pre-processing"
Sep 11 19:32:54.735825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.735808    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ab6827-34ce-4952-af76-4ab220c704fb" containerName="payload-processing"
Sep 11 19:32:54.735825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.735814    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ab6827-34ce-4952-af76-4ab220c704fb" containerName="payload-processing"
Sep 11 19:32:54.735961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.735833    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c761555d-9ec6-44f1-b0b7-59cb06cdba2b" containerName="revoke-keys"
Sep 11 19:32:54.735961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.735842    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c761555d-9ec6-44f1-b0b7-59cb06cdba2b" containerName="revoke-keys"
Sep 11 19:32:54.735961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.735904    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fa70a0d-37ec-4ffa-9570-4e63896c3550" containerName="payload-pre-processing"
Sep 11 19:32:54.735961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.735916    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c761555d-9ec6-44f1-b0b7-59cb06cdba2b" containerName="revoke-keys"
Sep 11 19:32:54.735961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.735928    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ab6827-34ce-4952-af76-4ab220c704fb" containerName="payload-processing"
Sep 11 19:32:54.740250 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.740233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:32:54.744994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.744969    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f09ed0d7\""
Sep 11 19:32:54.745116 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.745031    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f09ed0d7-dockercfg-25p6l\""
Sep 11 19:32:54.750229 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.750208    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"]
Sep 11 19:32:54.779435 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.779397    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"]
Sep 11 19:32:54.783048 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.783029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:32:54.800699 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.800665    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"]
Sep 11 19:32:54.925684 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.925643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2kc7\" (UniqueName: \"kubernetes.io/projected/231f00a2-14d5-470f-af82-47385a9d3d0f-kube-api-access-p2kc7\") pod \"payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv\" (UID: \"231f00a2-14d5-470f-af82-47385a9d3d0f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:32:54.925855 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.925705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/231f00a2-14d5-470f-af82-47385a9d3d0f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv\" (UID: \"231f00a2-14d5-470f-af82-47385a9d3d0f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:32:54.925855 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.925826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwwkz\" (UniqueName: \"kubernetes.io/projected/1328ff76-3e1e-4b92-aad6-1a032c13a71f-kube-api-access-hwwkz\") pod \"payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg\" (UID: \"1328ff76-3e1e-4b92-aad6-1a032c13a71f\") " pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:32:54.925935 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:54.925879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1328ff76-3e1e-4b92-aad6-1a032c13a71f-plugins-config-volume\") pod \"payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg\" (UID: \"1328ff76-3e1e-4b92-aad6-1a032c13a71f\") " pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:32:55.027444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.027345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwwkz\" (UniqueName: \"kubernetes.io/projected/1328ff76-3e1e-4b92-aad6-1a032c13a71f-kube-api-access-hwwkz\") pod \"payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg\" (UID: \"1328ff76-3e1e-4b92-aad6-1a032c13a71f\") " pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:32:55.027444 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.027400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1328ff76-3e1e-4b92-aad6-1a032c13a71f-plugins-config-volume\") pod \"payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg\" (UID: \"1328ff76-3e1e-4b92-aad6-1a032c13a71f\") " pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:32:55.027674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.027455    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2kc7\" (UniqueName: \"kubernetes.io/projected/231f00a2-14d5-470f-af82-47385a9d3d0f-kube-api-access-p2kc7\") pod \"payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv\" (UID: \"231f00a2-14d5-470f-af82-47385a9d3d0f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:32:55.027674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.027483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/231f00a2-14d5-470f-af82-47385a9d3d0f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv\" (UID: \"231f00a2-14d5-470f-af82-47385a9d3d0f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:32:55.032311 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.028668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/231f00a2-14d5-470f-af82-47385a9d3d0f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv\" (UID: \"231f00a2-14d5-470f-af82-47385a9d3d0f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:32:55.032311 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.028757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1328ff76-3e1e-4b92-aad6-1a032c13a71f-plugins-config-volume\") pod \"payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg\" (UID: \"1328ff76-3e1e-4b92-aad6-1a032c13a71f\") " pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:32:55.037150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.037121    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2kc7\" (UniqueName: \"kubernetes.io/projected/231f00a2-14d5-470f-af82-47385a9d3d0f-kube-api-access-p2kc7\") pod \"payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv\" (UID: \"231f00a2-14d5-470f-af82-47385a9d3d0f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:32:55.037295 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.037207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwwkz\" (UniqueName: \"kubernetes.io/projected/1328ff76-3e1e-4b92-aad6-1a032c13a71f-kube-api-access-hwwkz\") pod \"payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg\" (UID: \"1328ff76-3e1e-4b92-aad6-1a032c13a71f\") " pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:32:55.050765 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.050743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:32:55.093338 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.093273    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:32:55.338725 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.338694    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"]
Sep 11 19:32:55.339916 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:32:55.339890    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231f00a2_14d5_470f_af82_47385a9d3d0f.slice/crio-a6b72b00a3ac7d407e2ef7c3f555e30dfe19ea95ab43defbcf117f1d740ab0d9 WatchSource:0}: Error finding container a6b72b00a3ac7d407e2ef7c3f555e30dfe19ea95ab43defbcf117f1d740ab0d9: Status 404 returned error can't find the container with id a6b72b00a3ac7d407e2ef7c3f555e30dfe19ea95ab43defbcf117f1d740ab0d9
Sep 11 19:32:55.381891 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:55.381866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"]
Sep 11 19:32:55.386390 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:32:55.386355    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1328ff76_3e1e_4b92_aad6_1a032c13a71f.slice/crio-5a69667caab34f66c12ddab6edda7e54de67a4806df0b3df35598d627d134821 WatchSource:0}: Error finding container 5a69667caab34f66c12ddab6edda7e54de67a4806df0b3df35598d627d134821: Status 404 returned error can't find the container with id 5a69667caab34f66c12ddab6edda7e54de67a4806df0b3df35598d627d134821
Sep 11 19:32:56.110784 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:56.110745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg" event={"ID":"1328ff76-3e1e-4b92-aad6-1a032c13a71f","Type":"ContainerStarted","Data":"2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57"}
Sep 11 19:32:56.111267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:56.110810    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg" event={"ID":"1328ff76-3e1e-4b92-aad6-1a032c13a71f","Type":"ContainerStarted","Data":"5a69667caab34f66c12ddab6edda7e54de67a4806df0b3df35598d627d134821"}
Sep 11 19:32:56.111267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:56.110839    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:32:56.112563 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:56.112536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv" event={"ID":"231f00a2-14d5-470f-af82-47385a9d3d0f","Type":"ContainerStarted","Data":"70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db"}
Sep 11 19:32:56.112696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:56.112581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv" event={"ID":"231f00a2-14d5-470f-af82-47385a9d3d0f","Type":"ContainerStarted","Data":"a6b72b00a3ac7d407e2ef7c3f555e30dfe19ea95ab43defbcf117f1d740ab0d9"}
Sep 11 19:32:56.112696 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:56.112622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:32:56.128645 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:56.128592    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg" podStartSLOduration=2.128574956 podStartE2EDuration="2.128574956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:32:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:32:56.12590518 +0000 UTC m=+876.147113346" watchObservedRunningTime="2026-09-11 19:32:56.128574956 +0000 UTC m=+876.149783105"
Sep 11 19:32:56.141828 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:32:56.141775    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv" podStartSLOduration=2.141760919 podStartE2EDuration="2.141760919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:32:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:32:56.139658336 +0000 UTC m=+876.160866510" watchObservedRunningTime="2026-09-11 19:32:56.141760919 +0000 UTC m=+876.162969069"
Sep 11 19:33:07.122457 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:07.122423    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:33:07.122932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:07.122660    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:33:19.719146 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:19.719035    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"]
Sep 11 19:33:19.723125 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:19.723104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"
Sep 11 19:33:19.725240 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:19.725223    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:33:19.725325 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:19.725303    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:33:19.729953 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:19.729927    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"]
Sep 11 19:33:19.777078 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:19.776822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce234bc1-4873-4185-8e16-55ce07b66f8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg\" (UID: \"ce234bc1-4873-4185-8e16-55ce07b66f8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"
Sep 11 19:33:19.878355 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:19.878314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce234bc1-4873-4185-8e16-55ce07b66f8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg\" (UID: \"ce234bc1-4873-4185-8e16-55ce07b66f8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"
Sep 11 19:33:19.878946 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:19.878926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce234bc1-4873-4185-8e16-55ce07b66f8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg\" (UID: \"ce234bc1-4873-4185-8e16-55ce07b66f8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"
Sep 11 19:33:20.053966 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:20.053876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"
Sep 11 19:33:20.324939 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:20.324908    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"]
Sep 11 19:33:20.326378 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:33:20.326343    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce234bc1_4873_4185_8e16_55ce07b66f8f.slice/crio-53c01f11c737951e8f835835c4078983f52dc79ef74b98ff786056f136ed171b WatchSource:0}: Error finding container 53c01f11c737951e8f835835c4078983f52dc79ef74b98ff786056f136ed171b: Status 404 returned error can't find the container with id 53c01f11c737951e8f835835c4078983f52dc79ef74b98ff786056f136ed171b
Sep 11 19:33:20.418588 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:20.418557    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:33:20.422530 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:20.422497    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:33:21.269417 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:21.269329    2580 generic.go:356] "Generic (PLEG): container finished" podID="ce234bc1-4873-4185-8e16-55ce07b66f8f" containerID="cc73a2af319b0bd39aba2af60e71a1d4138897f180107c4863ed2889279fbff8" exitCode=0
Sep 11 19:33:21.269771 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:21.269414    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg" event={"ID":"ce234bc1-4873-4185-8e16-55ce07b66f8f","Type":"ContainerDied","Data":"cc73a2af319b0bd39aba2af60e71a1d4138897f180107c4863ed2889279fbff8"}
Sep 11 19:33:21.269771 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:21.269468    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg" event={"ID":"ce234bc1-4873-4185-8e16-55ce07b66f8f","Type":"ContainerStarted","Data":"53c01f11c737951e8f835835c4078983f52dc79ef74b98ff786056f136ed171b"}
Sep 11 19:33:22.413490 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:22.413463    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"
Sep 11 19:33:22.504229 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:22.504197    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce234bc1-4873-4185-8e16-55ce07b66f8f-maas-api-service-ca\") pod \"ce234bc1-4873-4185-8e16-55ce07b66f8f\" (UID: \"ce234bc1-4873-4185-8e16-55ce07b66f8f\") "
Sep 11 19:33:22.504551 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:22.504526    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce234bc1-4873-4185-8e16-55ce07b66f8f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ce234bc1-4873-4185-8e16-55ce07b66f8f" (UID: "ce234bc1-4873-4185-8e16-55ce07b66f8f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:33:22.605977 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:22.605895    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce234bc1-4873-4185-8e16-55ce07b66f8f-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:33:23.282199 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:23.282167    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"
Sep 11 19:33:23.282390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:23.282170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg" event={"ID":"ce234bc1-4873-4185-8e16-55ce07b66f8f","Type":"ContainerDied","Data":"53c01f11c737951e8f835835c4078983f52dc79ef74b98ff786056f136ed171b"}
Sep 11 19:33:23.282390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:23.282311    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53c01f11c737951e8f835835c4078983f52dc79ef74b98ff786056f136ed171b"
Sep 11 19:33:29.001484 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.001449    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"]
Sep 11 19:33:29.001921 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.001908    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce234bc1-4873-4185-8e16-55ce07b66f8f" containerName="revoke-keys"
Sep 11 19:33:29.001982 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.001923    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce234bc1-4873-4185-8e16-55ce07b66f8f" containerName="revoke-keys"
Sep 11 19:33:29.002021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.001992    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce234bc1-4873-4185-8e16-55ce07b66f8f" containerName="revoke-keys"
Sep 11 19:33:29.004801 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.004782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.007754 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.007730    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-6afc47\"/\"default-dockercfg-qrx77\""
Sep 11 19:33:29.007876 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.007767    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-6afc47\"/\"autores-model-6afc47-kserve-self-signed-certs\""
Sep 11 19:33:29.007876 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.007776    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-6afc47\"/\"kube-root-ca.crt\""
Sep 11 19:33:29.007876 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.007796    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-6afc47\"/\"openshift-service-ca.crt\""
Sep 11 19:33:29.015890 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.015861    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"]
Sep 11 19:33:29.173424 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.173381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k8vv\" (UniqueName: \"kubernetes.io/projected/b7ec3c8b-7113-4c3d-a330-b9146519cc13-kube-api-access-5k8vv\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.173610 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.173499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-dshm\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.173610 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.173584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-model-cache\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.173698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.173651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-home\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.173698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.173682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tls-certs\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.173784 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.173704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tmp-dir\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.274690 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.274594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-home\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.275125 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.275096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tls-certs\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.275226 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.275138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tmp-dir\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.275226 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.275208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k8vv\" (UniqueName: \"kubernetes.io/projected/b7ec3c8b-7113-4c3d-a330-b9146519cc13-kube-api-access-5k8vv\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.275363 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.275337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-dshm\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.275421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.275397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-model-cache\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.275801 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.275761    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-model-cache\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.275928 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.275029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-home\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.276537 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.276509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tmp-dir\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.281628 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.281602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-dshm\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.282189 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.282164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tls-certs\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.285138 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.285105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k8vv\" (UniqueName: \"kubernetes.io/projected/b7ec3c8b-7113-4c3d-a330-b9146519cc13-kube-api-access-5k8vv\") pod \"autores-model-6afc47-kserve-845f98f447-tpht4\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") " pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.315054 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.315017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:29.589342 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:29.589314    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"]
Sep 11 19:33:29.590894 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:33:29.590862    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7ec3c8b_7113_4c3d_a330_b9146519cc13.slice/crio-9bda93536255e451b77b5f6b4e3b16e28ef5a495446ebcbb3fd729b3696fd580 WatchSource:0}: Error finding container 9bda93536255e451b77b5f6b4e3b16e28ef5a495446ebcbb3fd729b3696fd580: Status 404 returned error can't find the container with id 9bda93536255e451b77b5f6b4e3b16e28ef5a495446ebcbb3fd729b3696fd580
Sep 11 19:33:30.326971 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:30.326925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4" event={"ID":"b7ec3c8b-7113-4c3d-a330-b9146519cc13","Type":"ContainerStarted","Data":"93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156"}
Sep 11 19:33:30.327388 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:30.326977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4" event={"ID":"b7ec3c8b-7113-4c3d-a330-b9146519cc13","Type":"ContainerStarted","Data":"9bda93536255e451b77b5f6b4e3b16e28ef5a495446ebcbb3fd729b3696fd580"}
Sep 11 19:33:30.343029 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:30.342975    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4" podStartSLOduration=2.342955859 podStartE2EDuration="2.342955859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:33:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:33:30.342862516 +0000 UTC m=+910.364070687" watchObservedRunningTime="2026-09-11 19:33:30.342955859 +0000 UTC m=+910.364164010"
Sep 11 19:33:31.800150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:31.800112    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"]
Sep 11 19:33:31.800673 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:31.800374    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg" podUID="1328ff76-3e1e-4b92-aad6-1a032c13a71f" containerName="payload-processing" containerID="cri-o://2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57" gracePeriod=30
Sep 11 19:33:31.807025 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:31.806991    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"]
Sep 11 19:33:31.807443 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:31.807394    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv" podUID="231f00a2-14d5-470f-af82-47385a9d3d0f" containerName="payload-pre-processing" containerID="cri-o://70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db" gracePeriod=30
Sep 11 19:33:31.971473 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:31.971432    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"]
Sep 11 19:33:31.979042 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:31.977490    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f09ed0d7-swnvg"]
Sep 11 19:33:32.101305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.099669    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:33:32.144352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.144324    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:33:32.212901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.212861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1328ff76-3e1e-4b92-aad6-1a032c13a71f-plugins-config-volume\") pod \"1328ff76-3e1e-4b92-aad6-1a032c13a71f\" (UID: \"1328ff76-3e1e-4b92-aad6-1a032c13a71f\") "
Sep 11 19:33:32.213114 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.212950    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwwkz\" (UniqueName: \"kubernetes.io/projected/1328ff76-3e1e-4b92-aad6-1a032c13a71f-kube-api-access-hwwkz\") pod \"1328ff76-3e1e-4b92-aad6-1a032c13a71f\" (UID: \"1328ff76-3e1e-4b92-aad6-1a032c13a71f\") "
Sep 11 19:33:32.213700 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.213667    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1328ff76-3e1e-4b92-aad6-1a032c13a71f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1328ff76-3e1e-4b92-aad6-1a032c13a71f" (UID: "1328ff76-3e1e-4b92-aad6-1a032c13a71f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:33:32.218184 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.218000    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1328ff76-3e1e-4b92-aad6-1a032c13a71f-kube-api-access-hwwkz" (OuterVolumeSpecName: "kube-api-access-hwwkz") pod "1328ff76-3e1e-4b92-aad6-1a032c13a71f" (UID: "1328ff76-3e1e-4b92-aad6-1a032c13a71f"). InnerVolumeSpecName "kube-api-access-hwwkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:33:32.314183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.314091    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/231f00a2-14d5-470f-af82-47385a9d3d0f-plugins-config-volume\") pod \"231f00a2-14d5-470f-af82-47385a9d3d0f\" (UID: \"231f00a2-14d5-470f-af82-47385a9d3d0f\") "
Sep 11 19:33:32.314183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.314140    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2kc7\" (UniqueName: \"kubernetes.io/projected/231f00a2-14d5-470f-af82-47385a9d3d0f-kube-api-access-p2kc7\") pod \"231f00a2-14d5-470f-af82-47385a9d3d0f\" (UID: \"231f00a2-14d5-470f-af82-47385a9d3d0f\") "
Sep 11 19:33:32.314446 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.314431    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1328ff76-3e1e-4b92-aad6-1a032c13a71f-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:33:32.314505 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.314447    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwwkz\" (UniqueName: \"kubernetes.io/projected/1328ff76-3e1e-4b92-aad6-1a032c13a71f-kube-api-access-hwwkz\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:33:32.314505 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.314465    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/231f00a2-14d5-470f-af82-47385a9d3d0f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "231f00a2-14d5-470f-af82-47385a9d3d0f" (UID: "231f00a2-14d5-470f-af82-47385a9d3d0f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:33:32.316210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.316189    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231f00a2-14d5-470f-af82-47385a9d3d0f-kube-api-access-p2kc7" (OuterVolumeSpecName: "kube-api-access-p2kc7") pod "231f00a2-14d5-470f-af82-47385a9d3d0f" (UID: "231f00a2-14d5-470f-af82-47385a9d3d0f"). InnerVolumeSpecName "kube-api-access-p2kc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:33:32.340962 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.340935    2580 generic.go:356] "Generic (PLEG): container finished" podID="231f00a2-14d5-470f-af82-47385a9d3d0f" containerID="70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db" exitCode=0
Sep 11 19:33:32.341082 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.340979    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"
Sep 11 19:33:32.341082 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.341026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv" event={"ID":"231f00a2-14d5-470f-af82-47385a9d3d0f","Type":"ContainerDied","Data":"70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db"}
Sep 11 19:33:32.341176 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.341102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv" event={"ID":"231f00a2-14d5-470f-af82-47385a9d3d0f","Type":"ContainerDied","Data":"a6b72b00a3ac7d407e2ef7c3f555e30dfe19ea95ab43defbcf117f1d740ab0d9"}
Sep 11 19:33:32.341176 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.341127    2580 scope.go:117] "RemoveContainer" containerID="70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db"
Sep 11 19:33:32.342412 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.342389    2580 generic.go:356] "Generic (PLEG): container finished" podID="1328ff76-3e1e-4b92-aad6-1a032c13a71f" containerID="2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57" exitCode=0
Sep 11 19:33:32.342526 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.342432    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"
Sep 11 19:33:32.342526 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.342481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg" event={"ID":"1328ff76-3e1e-4b92-aad6-1a032c13a71f","Type":"ContainerDied","Data":"2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57"}
Sep 11 19:33:32.342626 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.342528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg" event={"ID":"1328ff76-3e1e-4b92-aad6-1a032c13a71f","Type":"ContainerDied","Data":"5a69667caab34f66c12ddab6edda7e54de67a4806df0b3df35598d627d134821"}
Sep 11 19:33:32.353957 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.353938    2580 scope.go:117] "RemoveContainer" containerID="70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db"
Sep 11 19:33:32.354250 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:33:32.354224    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db\": container with ID starting with 70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db not found: ID does not exist" containerID="70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db"
Sep 11 19:33:32.354330 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.354261    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db"} err="failed to get container status \"70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db\": rpc error: code = NotFound desc = could not find container \"70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db\": container with ID starting with 70cd61e9219424271f6a432f6ee092ba83d49f8da0dc7c245290721a7dea68db not found: ID does not exist"
Sep 11 19:33:32.354330 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.354308    2580 scope.go:117] "RemoveContainer" containerID="2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57"
Sep 11 19:33:32.362852 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.362834    2580 scope.go:117] "RemoveContainer" containerID="2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57"
Sep 11 19:33:32.363090 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:33:32.363074    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57\": container with ID starting with 2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57 not found: ID does not exist" containerID="2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57"
Sep 11 19:33:32.363134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.363097    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57"} err="failed to get container status \"2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57\": rpc error: code = NotFound desc = could not find container \"2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57\": container with ID starting with 2bcb19cf9e40950a107b798a263e17d4994e7863188ae0d1c8322b0333ed9b57 not found: ID does not exist"
Sep 11 19:33:32.367329 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.367265    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"]
Sep 11 19:33:32.371096 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.371075    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f09ed0d7-574c8c75cc-wqnsg"]
Sep 11 19:33:32.380895 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.380873    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"]
Sep 11 19:33:32.386306 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.386245    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f09ed0d7-548c9f554b-ks7zv"]
Sep 11 19:33:32.414967 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.414933    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/231f00a2-14d5-470f-af82-47385a9d3d0f-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:33:32.414967 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.414964    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2kc7\" (UniqueName: \"kubernetes.io/projected/231f00a2-14d5-470f-af82-47385a9d3d0f-kube-api-access-p2kc7\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:33:32.449394 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.449355    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1328ff76-3e1e-4b92-aad6-1a032c13a71f" path="/var/lib/kubelet/pods/1328ff76-3e1e-4b92-aad6-1a032c13a71f/volumes"
Sep 11 19:33:32.449840 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.449819    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="231f00a2-14d5-470f-af82-47385a9d3d0f" path="/var/lib/kubelet/pods/231f00a2-14d5-470f-af82-47385a9d3d0f/volumes"
Sep 11 19:33:32.450203 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:32.450185    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce234bc1-4873-4185-8e16-55ce07b66f8f" path="/var/lib/kubelet/pods/ce234bc1-4873-4185-8e16-55ce07b66f8f/volumes"
Sep 11 19:33:39.316233 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:39.316197    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:39.316844 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:39.316249    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:39.328988 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:39.328958    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:33:39.410390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:33:39.410344    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:34:01.242101 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.242062    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"]
Sep 11 19:34:01.242518 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.242504    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231f00a2-14d5-470f-af82-47385a9d3d0f" containerName="payload-pre-processing"
Sep 11 19:34:01.242518 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.242519    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="231f00a2-14d5-470f-af82-47385a9d3d0f" containerName="payload-pre-processing"
Sep 11 19:34:01.242595 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.242528    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1328ff76-3e1e-4b92-aad6-1a032c13a71f" containerName="payload-processing"
Sep 11 19:34:01.242595 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.242535    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1328ff76-3e1e-4b92-aad6-1a032c13a71f" containerName="payload-processing"
Sep 11 19:34:01.242659 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.242602    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1328ff76-3e1e-4b92-aad6-1a032c13a71f" containerName="payload-processing"
Sep 11 19:34:01.242659 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.242614    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="231f00a2-14d5-470f-af82-47385a9d3d0f" containerName="payload-pre-processing"
Sep 11 19:34:01.244825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.244808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"
Sep 11 19:34:01.247023 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.246998    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:34:01.247148 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.246998    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:34:01.252498 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.252472    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"]
Sep 11 19:34:01.401932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.401894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52cf2cfd-eaeb-4179-8e65-b741918bf811-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-6afc47-j6w26\" (UID: \"52cf2cfd-eaeb-4179-8e65-b741918bf811\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"
Sep 11 19:34:01.502858 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.502759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52cf2cfd-eaeb-4179-8e65-b741918bf811-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-6afc47-j6w26\" (UID: \"52cf2cfd-eaeb-4179-8e65-b741918bf811\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"
Sep 11 19:34:01.503453 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.503434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52cf2cfd-eaeb-4179-8e65-b741918bf811-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-6afc47-j6w26\" (UID: \"52cf2cfd-eaeb-4179-8e65-b741918bf811\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"
Sep 11 19:34:01.558757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.558725    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"
Sep 11 19:34:01.840124 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:01.840061    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"]
Sep 11 19:34:02.534807 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:02.534777    2580 generic.go:356] "Generic (PLEG): container finished" podID="52cf2cfd-eaeb-4179-8e65-b741918bf811" containerID="2cd7089ec36b9bcd8560d1a2777605b2228ab7fb6491b0cc8bb1fddc481ffbd7" exitCode=0
Sep 11 19:34:02.535131 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:02.534860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26" event={"ID":"52cf2cfd-eaeb-4179-8e65-b741918bf811","Type":"ContainerDied","Data":"2cd7089ec36b9bcd8560d1a2777605b2228ab7fb6491b0cc8bb1fddc481ffbd7"}
Sep 11 19:34:02.535131 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:02.534918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26" event={"ID":"52cf2cfd-eaeb-4179-8e65-b741918bf811","Type":"ContainerStarted","Data":"894abddde94cd33c6ed0ebe2a3c67ef6af3676b2f5320911e7c9f6e62a6f3e9e"}
Sep 11 19:34:03.685931 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:03.685901    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"
Sep 11 19:34:03.826712 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:03.826637    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52cf2cfd-eaeb-4179-8e65-b741918bf811-maas-api-service-ca\") pod \"52cf2cfd-eaeb-4179-8e65-b741918bf811\" (UID: \"52cf2cfd-eaeb-4179-8e65-b741918bf811\") "
Sep 11 19:34:03.827027 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:03.827002    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52cf2cfd-eaeb-4179-8e65-b741918bf811-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "52cf2cfd-eaeb-4179-8e65-b741918bf811" (UID: "52cf2cfd-eaeb-4179-8e65-b741918bf811"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:34:03.827101 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:03.827088    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52cf2cfd-eaeb-4179-8e65-b741918bf811-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:04.548136 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:04.548108    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"
Sep 11 19:34:04.548332 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:04.548148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26" event={"ID":"52cf2cfd-eaeb-4179-8e65-b741918bf811","Type":"ContainerDied","Data":"894abddde94cd33c6ed0ebe2a3c67ef6af3676b2f5320911e7c9f6e62a6f3e9e"}
Sep 11 19:34:04.548332 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:04.548194    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="894abddde94cd33c6ed0ebe2a3c67ef6af3676b2f5320911e7c9f6e62a6f3e9e"
Sep 11 19:34:11.918362 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:11.918325    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"]
Sep 11 19:34:11.920847 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:11.919225    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g" podUID="29451453-bb90-438a-9158-036d9f47f16f" containerName="payload-processing" containerID="cri-o://601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc" gracePeriod=30
Sep 11 19:34:11.924849 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:11.924815    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"]
Sep 11 19:34:11.925085 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:11.925033    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn" podUID="44194c1a-c104-41d3-925a-a32e956dd183" containerName="payload-pre-processing" containerID="cri-o://f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c" gracePeriod=30
Sep 11 19:34:12.084925 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.084888    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"]
Sep 11 19:34:12.090466 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.090437    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-6afc47-j6w26"]
Sep 11 19:34:12.193781 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.193756    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:34:12.220089 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.220063    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:34:12.310733 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.310696    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29451453-bb90-438a-9158-036d9f47f16f-plugins-config-volume\") pod \"29451453-bb90-438a-9158-036d9f47f16f\" (UID: \"29451453-bb90-438a-9158-036d9f47f16f\") "
Sep 11 19:34:12.310934 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.310810    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pllwq\" (UniqueName: \"kubernetes.io/projected/29451453-bb90-438a-9158-036d9f47f16f-kube-api-access-pllwq\") pod \"29451453-bb90-438a-9158-036d9f47f16f\" (UID: \"29451453-bb90-438a-9158-036d9f47f16f\") "
Sep 11 19:34:12.311129 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.311102    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29451453-bb90-438a-9158-036d9f47f16f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29451453-bb90-438a-9158-036d9f47f16f" (UID: "29451453-bb90-438a-9158-036d9f47f16f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:34:12.312855 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.312835    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29451453-bb90-438a-9158-036d9f47f16f-kube-api-access-pllwq" (OuterVolumeSpecName: "kube-api-access-pllwq") pod "29451453-bb90-438a-9158-036d9f47f16f" (UID: "29451453-bb90-438a-9158-036d9f47f16f"). InnerVolumeSpecName "kube-api-access-pllwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:34:12.411399 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.411365    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5bbt\" (UniqueName: \"kubernetes.io/projected/44194c1a-c104-41d3-925a-a32e956dd183-kube-api-access-l5bbt\") pod \"44194c1a-c104-41d3-925a-a32e956dd183\" (UID: \"44194c1a-c104-41d3-925a-a32e956dd183\") "
Sep 11 19:34:12.411581 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.411492    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44194c1a-c104-41d3-925a-a32e956dd183-plugins-config-volume\") pod \"44194c1a-c104-41d3-925a-a32e956dd183\" (UID: \"44194c1a-c104-41d3-925a-a32e956dd183\") "
Sep 11 19:34:12.411699 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.411685    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pllwq\" (UniqueName: \"kubernetes.io/projected/29451453-bb90-438a-9158-036d9f47f16f-kube-api-access-pllwq\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:12.411767 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.411700    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29451453-bb90-438a-9158-036d9f47f16f-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:12.411877 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.411851    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44194c1a-c104-41d3-925a-a32e956dd183-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44194c1a-c104-41d3-925a-a32e956dd183" (UID: "44194c1a-c104-41d3-925a-a32e956dd183"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:34:12.413481 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.413459    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44194c1a-c104-41d3-925a-a32e956dd183-kube-api-access-l5bbt" (OuterVolumeSpecName: "kube-api-access-l5bbt") pod "44194c1a-c104-41d3-925a-a32e956dd183" (UID: "44194c1a-c104-41d3-925a-a32e956dd183"). InnerVolumeSpecName "kube-api-access-l5bbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:34:12.449434 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.449409    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52cf2cfd-eaeb-4179-8e65-b741918bf811" path="/var/lib/kubelet/pods/52cf2cfd-eaeb-4179-8e65-b741918bf811/volumes"
Sep 11 19:34:12.513275 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.513239    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5bbt\" (UniqueName: \"kubernetes.io/projected/44194c1a-c104-41d3-925a-a32e956dd183-kube-api-access-l5bbt\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:12.513399 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.513274    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44194c1a-c104-41d3-925a-a32e956dd183-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:12.603417 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.603383    2580 generic.go:356] "Generic (PLEG): container finished" podID="29451453-bb90-438a-9158-036d9f47f16f" containerID="601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc" exitCode=0
Sep 11 19:34:12.603592 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.603430    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"
Sep 11 19:34:12.603592 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.603472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g" event={"ID":"29451453-bb90-438a-9158-036d9f47f16f","Type":"ContainerDied","Data":"601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc"}
Sep 11 19:34:12.603592 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.603526    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g" event={"ID":"29451453-bb90-438a-9158-036d9f47f16f","Type":"ContainerDied","Data":"c98d727a88dbbb7a803fd303134b3122f9f025623645ac56f091ab689abbfcb3"}
Sep 11 19:34:12.603592 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.603548    2580 scope.go:117] "RemoveContainer" containerID="601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc"
Sep 11 19:34:12.605154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.605022    2580 generic.go:356] "Generic (PLEG): container finished" podID="44194c1a-c104-41d3-925a-a32e956dd183" containerID="f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c" exitCode=0
Sep 11 19:34:12.605154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.605074    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"
Sep 11 19:34:12.605154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.605083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn" event={"ID":"44194c1a-c104-41d3-925a-a32e956dd183","Type":"ContainerDied","Data":"f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c"}
Sep 11 19:34:12.605154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.605123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn" event={"ID":"44194c1a-c104-41d3-925a-a32e956dd183","Type":"ContainerDied","Data":"ab6b0af655fb561bac30ec7d0b81aa37a6b390610c82ef85a92fe14b113330ba"}
Sep 11 19:34:12.613323 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.613302    2580 scope.go:117] "RemoveContainer" containerID="601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc"
Sep 11 19:34:12.613590 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:34:12.613573    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc\": container with ID starting with 601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc not found: ID does not exist" containerID="601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc"
Sep 11 19:34:12.613667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.613599    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc"} err="failed to get container status \"601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc\": rpc error: code = NotFound desc = could not find container \"601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc\": container with ID starting with 601b8519ca1ed914c9033a2435cd6f31f63ec7e35df4436b03efbf9d83b818bc not found: ID does not exist"
Sep 11 19:34:12.613667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.613623    2580 scope.go:117] "RemoveContainer" containerID="f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c"
Sep 11 19:34:12.622114 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.622097    2580 scope.go:117] "RemoveContainer" containerID="f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c"
Sep 11 19:34:12.622460 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:34:12.622444    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c\": container with ID starting with f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c not found: ID does not exist" containerID="f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c"
Sep 11 19:34:12.622522 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.622465    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c"} err="failed to get container status \"f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c\": rpc error: code = NotFound desc = could not find container \"f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c\": container with ID starting with f3624c2a03bab5fa6b9dbfee0c796125aa15717f6c544a5cb34307f68b48ea6c not found: ID does not exist"
Sep 11 19:34:12.622639 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.622622    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"]
Sep 11 19:34:12.626429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.626407    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-6afc47-78844dbff9-5sj7g"]
Sep 11 19:34:12.635719 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.635699    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"]
Sep 11 19:34:12.639727 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:12.639706    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6afc47-597dbf69cd-mgxmn"]
Sep 11 19:34:14.450150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:14.450111    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29451453-bb90-438a-9158-036d9f47f16f" path="/var/lib/kubelet/pods/29451453-bb90-438a-9158-036d9f47f16f/volumes"
Sep 11 19:34:14.450719 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:14.450696    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44194c1a-c104-41d3-925a-a32e956dd183" path="/var/lib/kubelet/pods/44194c1a-c104-41d3-925a-a32e956dd183/volumes"
Sep 11 19:34:17.392898 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:17.392860    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"]
Sep 11 19:34:20.037645 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.037605    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"]
Sep 11 19:34:20.038025 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.038012    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44194c1a-c104-41d3-925a-a32e956dd183" containerName="payload-pre-processing"
Sep 11 19:34:20.038074 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.038026    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="44194c1a-c104-41d3-925a-a32e956dd183" containerName="payload-pre-processing"
Sep 11 19:34:20.038074 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.038039    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29451453-bb90-438a-9158-036d9f47f16f" containerName="payload-processing"
Sep 11 19:34:20.038074 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.038045    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="29451453-bb90-438a-9158-036d9f47f16f" containerName="payload-processing"
Sep 11 19:34:20.038074 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.038064    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52cf2cfd-eaeb-4179-8e65-b741918bf811" containerName="revoke-keys"
Sep 11 19:34:20.038074 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.038069    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="52cf2cfd-eaeb-4179-8e65-b741918bf811" containerName="revoke-keys"
Sep 11 19:34:20.038220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.038130    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="52cf2cfd-eaeb-4179-8e65-b741918bf811" containerName="revoke-keys"
Sep 11 19:34:20.038220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.038140    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="29451453-bb90-438a-9158-036d9f47f16f" containerName="payload-processing"
Sep 11 19:34:20.038220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.038146    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="44194c1a-c104-41d3-925a-a32e956dd183" containerName="payload-pre-processing"
Sep 11 19:34:20.041260 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.041237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"
Sep 11 19:34:20.043449 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.043425    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:34:20.043574 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.043479    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:34:20.048096 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.048069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"]
Sep 11 19:34:20.083940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.083906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58e372b3-91ee-47ea-a5a5-6d599fece803-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr\" (UID: \"58e372b3-91ee-47ea-a5a5-6d599fece803\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"
Sep 11 19:34:20.184515 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.184477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58e372b3-91ee-47ea-a5a5-6d599fece803-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr\" (UID: \"58e372b3-91ee-47ea-a5a5-6d599fece803\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"
Sep 11 19:34:20.185114 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.185091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58e372b3-91ee-47ea-a5a5-6d599fece803-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr\" (UID: \"58e372b3-91ee-47ea-a5a5-6d599fece803\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"
Sep 11 19:34:20.355759 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.355678    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:34:20.364615 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.364593    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"
Sep 11 19:34:20.648757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.648730    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"]
Sep 11 19:34:20.651231 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:34:20.651203    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e372b3_91ee_47ea_a5a5_6d599fece803.slice/crio-32082241e32500dcc6978f66d03a1f75e958e5db4e73b5e4e157f926ae6cdbfc WatchSource:0}: Error finding container 32082241e32500dcc6978f66d03a1f75e958e5db4e73b5e4e157f926ae6cdbfc: Status 404 returned error can't find the container with id 32082241e32500dcc6978f66d03a1f75e958e5db4e73b5e4e157f926ae6cdbfc
Sep 11 19:34:20.665810 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:20.665782    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr" event={"ID":"58e372b3-91ee-47ea-a5a5-6d599fece803","Type":"ContainerStarted","Data":"32082241e32500dcc6978f66d03a1f75e958e5db4e73b5e4e157f926ae6cdbfc"}
Sep 11 19:34:21.674723 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:21.674640    2580 generic.go:356] "Generic (PLEG): container finished" podID="58e372b3-91ee-47ea-a5a5-6d599fece803" containerID="7115ee81f13f893c6a18f4f9817d66764e65868030a81ce0e5c57e033107a6ab" exitCode=0
Sep 11 19:34:21.675078 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:21.674721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr" event={"ID":"58e372b3-91ee-47ea-a5a5-6d599fece803","Type":"ContainerDied","Data":"7115ee81f13f893c6a18f4f9817d66764e65868030a81ce0e5c57e033107a6ab"}
Sep 11 19:34:22.812335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:22.812306    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"
Sep 11 19:34:22.921562 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:22.921528    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58e372b3-91ee-47ea-a5a5-6d599fece803-maas-api-service-ca\") pod \"58e372b3-91ee-47ea-a5a5-6d599fece803\" (UID: \"58e372b3-91ee-47ea-a5a5-6d599fece803\") "
Sep 11 19:34:22.921896 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:22.921871    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e372b3-91ee-47ea-a5a5-6d599fece803-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "58e372b3-91ee-47ea-a5a5-6d599fece803" (UID: "58e372b3-91ee-47ea-a5a5-6d599fece803"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:34:23.022605 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:23.022526    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58e372b3-91ee-47ea-a5a5-6d599fece803-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:23.688610 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:23.688573    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr" event={"ID":"58e372b3-91ee-47ea-a5a5-6d599fece803","Type":"ContainerDied","Data":"32082241e32500dcc6978f66d03a1f75e958e5db4e73b5e4e157f926ae6cdbfc"}
Sep 11 19:34:23.688777 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:23.688629    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32082241e32500dcc6978f66d03a1f75e958e5db4e73b5e4e157f926ae6cdbfc"
Sep 11 19:34:23.688777 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:23.688583    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"
Sep 11 19:34:30.606624 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:30.606595    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"]
Sep 11 19:34:30.607413 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:30.607358    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx" podUID="86cb66cf-179f-4131-a132-bfe5ce6e3278" containerName="payload-pre-processing" containerID="cri-o://110558543e8688e3d4ea8f54b9506db13a30f50012e28d51eb97fc4009fde163" gracePeriod=30
Sep 11 19:34:30.731523 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:30.731495    2580 generic.go:356] "Generic (PLEG): container finished" podID="86cb66cf-179f-4131-a132-bfe5ce6e3278" containerID="110558543e8688e3d4ea8f54b9506db13a30f50012e28d51eb97fc4009fde163" exitCode=0
Sep 11 19:34:30.731637 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:30.731566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx" event={"ID":"86cb66cf-179f-4131-a132-bfe5ce6e3278","Type":"ContainerDied","Data":"110558543e8688e3d4ea8f54b9506db13a30f50012e28d51eb97fc4009fde163"}
Sep 11 19:34:30.776694 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:30.776656    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"]
Sep 11 19:34:30.791896 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:30.791862    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-8fbb58-9sjhr"]
Sep 11 19:34:30.893921 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:30.893877    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:34:30.999343 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:30.999273    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww8c5\" (UniqueName: \"kubernetes.io/projected/86cb66cf-179f-4131-a132-bfe5ce6e3278-kube-api-access-ww8c5\") pod \"86cb66cf-179f-4131-a132-bfe5ce6e3278\" (UID: \"86cb66cf-179f-4131-a132-bfe5ce6e3278\") "
Sep 11 19:34:30.999512 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:30.999454    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86cb66cf-179f-4131-a132-bfe5ce6e3278-plugins-config-volume\") pod \"86cb66cf-179f-4131-a132-bfe5ce6e3278\" (UID: \"86cb66cf-179f-4131-a132-bfe5ce6e3278\") "
Sep 11 19:34:30.999787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:30.999760    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86cb66cf-179f-4131-a132-bfe5ce6e3278-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86cb66cf-179f-4131-a132-bfe5ce6e3278" (UID: "86cb66cf-179f-4131-a132-bfe5ce6e3278"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:34:31.001603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:31.001574    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86cb66cf-179f-4131-a132-bfe5ce6e3278-kube-api-access-ww8c5" (OuterVolumeSpecName: "kube-api-access-ww8c5") pod "86cb66cf-179f-4131-a132-bfe5ce6e3278" (UID: "86cb66cf-179f-4131-a132-bfe5ce6e3278"). InnerVolumeSpecName "kube-api-access-ww8c5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:34:31.100352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:31.100315    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86cb66cf-179f-4131-a132-bfe5ce6e3278-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:31.100352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:31.100345    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww8c5\" (UniqueName: \"kubernetes.io/projected/86cb66cf-179f-4131-a132-bfe5ce6e3278-kube-api-access-ww8c5\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:31.738445 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:31.738408    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx" event={"ID":"86cb66cf-179f-4131-a132-bfe5ce6e3278","Type":"ContainerDied","Data":"72881b8b0661c03477312a1662784988752c691ce2bffb965965b59955e3131d"}
Sep 11 19:34:31.738445 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:31.738442    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"
Sep 11 19:34:31.738934 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:31.738474    2580 scope.go:117] "RemoveContainer" containerID="110558543e8688e3d4ea8f54b9506db13a30f50012e28d51eb97fc4009fde163"
Sep 11 19:34:31.763646 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:31.763613    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"]
Sep 11 19:34:31.770235 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:31.770199    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-8fbb58-684cc87ccd-tvngx"]
Sep 11 19:34:32.412312 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.412236    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4" podUID="b7ec3c8b-7113-4c3d-a330-b9146519cc13" containerName="main" containerID="cri-o://93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156" gracePeriod=45
Sep 11 19:34:32.449814 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.449786    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e372b3-91ee-47ea-a5a5-6d599fece803" path="/var/lib/kubelet/pods/58e372b3-91ee-47ea-a5a5-6d599fece803/volumes"
Sep 11 19:34:32.450149 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.450136    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86cb66cf-179f-4131-a132-bfe5ce6e3278" path="/var/lib/kubelet/pods/86cb66cf-179f-4131-a132-bfe5ce6e3278/volumes"
Sep 11 19:34:32.668674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.668615    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:34:32.747536 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.747495    2580 generic.go:356] "Generic (PLEG): container finished" podID="b7ec3c8b-7113-4c3d-a330-b9146519cc13" containerID="93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156" exitCode=0
Sep 11 19:34:32.747536 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.747536    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"
Sep 11 19:34:32.748077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.747544    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4" event={"ID":"b7ec3c8b-7113-4c3d-a330-b9146519cc13","Type":"ContainerDied","Data":"93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156"}
Sep 11 19:34:32.748077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.747584    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4" event={"ID":"b7ec3c8b-7113-4c3d-a330-b9146519cc13","Type":"ContainerDied","Data":"9bda93536255e451b77b5f6b4e3b16e28ef5a495446ebcbb3fd729b3696fd580"}
Sep 11 19:34:32.748077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.747606    2580 scope.go:117] "RemoveContainer" containerID="93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156"
Sep 11 19:34:32.756417 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.756393    2580 scope.go:117] "RemoveContainer" containerID="93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156"
Sep 11 19:34:32.756698 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:34:32.756679    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156\": container with ID starting with 93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156 not found: ID does not exist" containerID="93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156"
Sep 11 19:34:32.756745 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.756706    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156"} err="failed to get container status \"93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156\": rpc error: code = NotFound desc = could not find container \"93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156\": container with ID starting with 93ed9dd3f0fa5410b14b27eef7c864d8dab78171acbf0501f9fa96408c9d3156 not found: ID does not exist"
Sep 11 19:34:32.817782 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.817750    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-model-cache\") pod \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") "
Sep 11 19:34:32.817949 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.817793    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tls-certs\") pod \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") "
Sep 11 19:34:32.817949 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.817860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-home\") pod \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") "
Sep 11 19:34:32.817949 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.817884    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k8vv\" (UniqueName: \"kubernetes.io/projected/b7ec3c8b-7113-4c3d-a330-b9146519cc13-kube-api-access-5k8vv\") pod \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") "
Sep 11 19:34:32.817949 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.817933    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-dshm\") pod \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") "
Sep 11 19:34:32.818140 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.817962    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tmp-dir\") pod \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\" (UID: \"b7ec3c8b-7113-4c3d-a330-b9146519cc13\") "
Sep 11 19:34:32.818140 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.818061    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-model-cache" (OuterVolumeSpecName: "model-cache") pod "b7ec3c8b-7113-4c3d-a330-b9146519cc13" (UID: "b7ec3c8b-7113-4c3d-a330-b9146519cc13"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:34:32.818140 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.818112    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-home" (OuterVolumeSpecName: "home") pod "b7ec3c8b-7113-4c3d-a330-b9146519cc13" (UID: "b7ec3c8b-7113-4c3d-a330-b9146519cc13"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:34:32.818338 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.818270    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b7ec3c8b-7113-4c3d-a330-b9146519cc13" (UID: "b7ec3c8b-7113-4c3d-a330-b9146519cc13"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:34:32.818393 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.818369    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-model-cache\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:32.818428 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.818391    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-home\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:32.820175 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.820144    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-dshm" (OuterVolumeSpecName: "dshm") pod "b7ec3c8b-7113-4c3d-a330-b9146519cc13" (UID: "b7ec3c8b-7113-4c3d-a330-b9146519cc13"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:34:32.820327 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.820237    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b7ec3c8b-7113-4c3d-a330-b9146519cc13" (UID: "b7ec3c8b-7113-4c3d-a330-b9146519cc13"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:34:32.820327 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.820265    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7ec3c8b-7113-4c3d-a330-b9146519cc13-kube-api-access-5k8vv" (OuterVolumeSpecName: "kube-api-access-5k8vv") pod "b7ec3c8b-7113-4c3d-a330-b9146519cc13" (UID: "b7ec3c8b-7113-4c3d-a330-b9146519cc13"). InnerVolumeSpecName "kube-api-access-5k8vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:34:32.919973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.919883    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k8vv\" (UniqueName: \"kubernetes.io/projected/b7ec3c8b-7113-4c3d-a330-b9146519cc13-kube-api-access-5k8vv\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:32.919973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.919913    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-dshm\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:32.919973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.919924    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tmp-dir\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:32.919973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:32.919937    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ec3c8b-7113-4c3d-a330-b9146519cc13-tls-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:33.069268 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:33.069229    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"]
Sep 11 19:34:33.073296 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:33.073261    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-6afc47/autores-model-6afc47-kserve-845f98f447-tpht4"]
Sep 11 19:34:34.449114 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:34.449078    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7ec3c8b-7113-4c3d-a330-b9146519cc13" path="/var/lib/kubelet/pods/b7ec3c8b-7113-4c3d-a330-b9146519cc13/volumes"
Sep 11 19:34:37.386383 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:37.386345    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"]
Sep 11 19:34:37.386868 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:37.386576    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy" containerID="cri-o://6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa" gracePeriod=30
Sep 11 19:34:42.643643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.643615    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:34:42.809269 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.809179    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerID="6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa" exitCode=0
Sep 11 19:34:42.809269 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.809228    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"
Sep 11 19:34:42.809504 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.809270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" event={"ID":"a5e4efef-a9a7-4a05-8c2a-6572d5a97569","Type":"ContainerDied","Data":"6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa"}
Sep 11 19:34:42.809504 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.809335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v" event={"ID":"a5e4efef-a9a7-4a05-8c2a-6572d5a97569","Type":"ContainerDied","Data":"27fa2bf9bba4a84cc1c929947bb2241605c838e79b673a3f85882a8f6131af79"}
Sep 11 19:34:42.809504 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.809358    2580 scope.go:117] "RemoveContainer" containerID="6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa"
Sep 11 19:34:42.818387 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.818363    2580 scope.go:117] "RemoveContainer" containerID="bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7"
Sep 11 19:34:42.818593 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.818576    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-envoy\") pod \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") "
Sep 11 19:34:42.818661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.818618    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-podinfo\") pod \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") "
Sep 11 19:34:42.818661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.818642    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-676kb\" (UniqueName: \"kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-kube-api-access-676kb\") pod \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") "
Sep 11 19:34:42.818752 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.818686    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-data\") pod \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") "
Sep 11 19:34:42.818752 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.818710    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-socket\") pod \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") "
Sep 11 19:34:42.818752 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.818734    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-certs\") pod \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") "
Sep 11 19:34:42.818904 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.818792    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-credential-socket\") pod \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") "
Sep 11 19:34:42.818904 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.818857    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-token\") pod \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") "
Sep 11 19:34:42.819063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.818908    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istiod-ca-cert\") pod \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\" (UID: \"a5e4efef-a9a7-4a05-8c2a-6572d5a97569\") "
Sep 11 19:34:42.819063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.819024    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5e4efef-a9a7-4a05-8c2a-6572d5a97569" (UID: "a5e4efef-a9a7-4a05-8c2a-6572d5a97569"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:34:42.819179 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.819095    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5e4efef-a9a7-4a05-8c2a-6572d5a97569" (UID: "a5e4efef-a9a7-4a05-8c2a-6572d5a97569"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:34:42.819869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.819471    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5e4efef-a9a7-4a05-8c2a-6572d5a97569" (UID: "a5e4efef-a9a7-4a05-8c2a-6572d5a97569"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:34:42.819869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.819580    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5e4efef-a9a7-4a05-8c2a-6572d5a97569" (UID: "a5e4efef-a9a7-4a05-8c2a-6572d5a97569"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:34:42.819869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.819588    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5e4efef-a9a7-4a05-8c2a-6572d5a97569" (UID: "a5e4efef-a9a7-4a05-8c2a-6572d5a97569"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:34:42.819869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.819784    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:42.819869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.819804    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:42.819869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.819818    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:42.819869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.819831    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:42.819869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.819845    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:42.820885 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.820863    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5e4efef-a9a7-4a05-8c2a-6572d5a97569" (UID: "a5e4efef-a9a7-4a05-8c2a-6572d5a97569"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:34:42.821041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.821024    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5e4efef-a9a7-4a05-8c2a-6572d5a97569" (UID: "a5e4efef-a9a7-4a05-8c2a-6572d5a97569"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:34:42.821134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.821085    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-kube-api-access-676kb" (OuterVolumeSpecName: "kube-api-access-676kb") pod "a5e4efef-a9a7-4a05-8c2a-6572d5a97569" (UID: "a5e4efef-a9a7-4a05-8c2a-6572d5a97569"). InnerVolumeSpecName "kube-api-access-676kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:34:42.821493 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.821477    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5e4efef-a9a7-4a05-8c2a-6572d5a97569" (UID: "a5e4efef-a9a7-4a05-8c2a-6572d5a97569"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:34:42.839702 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.839683    2580 scope.go:117] "RemoveContainer" containerID="6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa"
Sep 11 19:34:42.840024 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:34:42.839998    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa\": container with ID starting with 6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa not found: ID does not exist" containerID="6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa"
Sep 11 19:34:42.840087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.840032    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa"} err="failed to get container status \"6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa\": rpc error: code = NotFound desc = could not find container \"6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa\": container with ID starting with 6b2de3adb2768b4167083d191b257643e5d899ad907f069836bfaee9d02edcaa not found: ID does not exist"
Sep 11 19:34:42.840087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.840049    2580 scope.go:117] "RemoveContainer" containerID="bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7"
Sep 11 19:34:42.840395 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:34:42.840378    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7\": container with ID starting with bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7 not found: ID does not exist" containerID="bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7"
Sep 11 19:34:42.840447 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.840403    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7"} err="failed to get container status \"bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7\": rpc error: code = NotFound desc = could not find container \"bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7\": container with ID starting with bd89bb0ced30a217a7893124c1e74c7d9607a31b5e2b829d3e295603d7e32af7 not found: ID does not exist"
Sep 11 19:34:42.920980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.920945    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-676kb\" (UniqueName: \"kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-kube-api-access-676kb\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:42.920980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.920977    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:42.921140 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.920988    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:42.921140 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:42.920996    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e4efef-a9a7-4a05-8c2a-6572d5a97569-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:34:43.132327 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:43.132292    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"]
Sep 11 19:34:43.138974 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:43.138949    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-8fbb58-openshift-default-6db696994-kmm4v"]
Sep 11 19:34:44.449629 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:44.449595    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" path="/var/lib/kubelet/pods/a5e4efef-a9a7-4a05-8c2a-6572d5a97569/volumes"
Sep 11 19:34:52.616011 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.615969    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"]
Sep 11 19:34:52.616594 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616571    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e372b3-91ee-47ea-a5a5-6d599fece803" containerName="revoke-keys"
Sep 11 19:34:52.616687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616596    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e372b3-91ee-47ea-a5a5-6d599fece803" containerName="revoke-keys"
Sep 11 19:34:52.616687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616608    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7ec3c8b-7113-4c3d-a330-b9146519cc13" containerName="main"
Sep 11 19:34:52.616687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616616    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7ec3c8b-7113-4c3d-a330-b9146519cc13" containerName="main"
Sep 11 19:34:52.616687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616630    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy"
Sep 11 19:34:52.616687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616640    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy"
Sep 11 19:34:52.616687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616661    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86cb66cf-179f-4131-a132-bfe5ce6e3278" containerName="payload-pre-processing"
Sep 11 19:34:52.616687 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616670    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86cb66cf-179f-4131-a132-bfe5ce6e3278" containerName="payload-pre-processing"
Sep 11 19:34:52.617035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616779    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7ec3c8b-7113-4c3d-a330-b9146519cc13" containerName="main"
Sep 11 19:34:52.617035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616794    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86cb66cf-179f-4131-a132-bfe5ce6e3278" containerName="payload-pre-processing"
Sep 11 19:34:52.617035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616804    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy"
Sep 11 19:34:52.617035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616815    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy"
Sep 11 19:34:52.617035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.616825    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e372b3-91ee-47ea-a5a5-6d599fece803" containerName="revoke-keys"
Sep 11 19:34:52.619926 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.619900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.622460 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.622436    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1fc808\"/\"default-dockercfg-8gddw\""
Sep 11 19:34:52.623224 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.623205    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1fc808\"/\"premium-w0-1fc808-kserve-self-signed-certs\""
Sep 11 19:34:52.623354 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.623230    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-1fc808\"/\"openshift-service-ca.crt\""
Sep 11 19:34:52.623354 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.623299    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-1fc808\"/\"kube-root-ca.crt\""
Sep 11 19:34:52.635251 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.635213    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"]
Sep 11 19:34:52.718736 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.718691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-model-cache\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.718932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.718744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-home\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.718932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.718775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tls-certs\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.719053 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.718948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cthwp\" (UniqueName: \"kubernetes.io/projected/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-kube-api-access-cthwp\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.719053 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.718988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-dshm\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.719053 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.719012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tmp-dir\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.820016 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.819970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cthwp\" (UniqueName: \"kubernetes.io/projected/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-kube-api-access-cthwp\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.820220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.820029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-dshm\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.820220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.820057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tmp-dir\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.820220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.820094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-model-cache\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.820220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.820126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-home\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.820220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.820155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tls-certs\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.820597 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.820567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tmp-dir\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.820859 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.820832    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-model-cache\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.820968 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.820867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-home\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.822969 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.822944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-dshm\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.823300 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.823261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tls-certs\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.834883 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.834859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cthwp\" (UniqueName: \"kubernetes.io/projected/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-kube-api-access-cthwp\") pod \"premium-w0-1fc808-kserve-8d6dbb456-scxl8\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") " pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:52.930157 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:52.930124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:34:53.209874 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:53.209840    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"]
Sep 11 19:34:53.211413 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:34:53.211387    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58bbd33d_130e_4e9c_8fa7_a39a896d1e08.slice/crio-4e8a4a15cd7f20cccc462ea0a727a419dfd99d3c9afbb43ba8d0642cafb5af56 WatchSource:0}: Error finding container 4e8a4a15cd7f20cccc462ea0a727a419dfd99d3c9afbb43ba8d0642cafb5af56: Status 404 returned error can't find the container with id 4e8a4a15cd7f20cccc462ea0a727a419dfd99d3c9afbb43ba8d0642cafb5af56
Sep 11 19:34:53.876901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:53.876868    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8" event={"ID":"58bbd33d-130e-4e9c-8fa7-a39a896d1e08","Type":"ContainerStarted","Data":"ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71"}
Sep 11 19:34:53.877313 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:53.876910    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8" event={"ID":"58bbd33d-130e-4e9c-8fa7-a39a896d1e08","Type":"ContainerStarted","Data":"4e8a4a15cd7f20cccc462ea0a727a419dfd99d3c9afbb43ba8d0642cafb5af56"}
Sep 11 19:34:53.893412 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:53.893363    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8" podStartSLOduration=1.893347838 podStartE2EDuration="1.893347838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:34:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:53.892231474 +0000 UTC m=+993.913439645" watchObservedRunningTime="2026-09-11 19:34:53.893347838 +0000 UTC m=+993.914556011"
Sep 11 19:34:55.408692 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.408656    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"]
Sep 11 19:34:55.409301 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.409264    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy"
Sep 11 19:34:55.409409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.409302    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e4efef-a9a7-4a05-8c2a-6572d5a97569" containerName="istio-proxy"
Sep 11 19:34:55.412576 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.412555    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.414758 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.414738    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-472add-openshift-default-dockercfg-r5bdt\""
Sep 11 19:34:55.423685 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.423662    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"]
Sep 11 19:34:55.445791 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.445761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-token\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.445933 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.445799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcxzr\" (UniqueName: \"kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-kube-api-access-rcxzr\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.445933 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.445842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-podinfo\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.445933 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.445871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-credential-socket\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.445933 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.445888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-socket\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.446079 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.445977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-certs\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.446079 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.446016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-data\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.446079 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.446031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f790286-5663-4c8d-9469-4bc902bcf9d0-istiod-ca-cert\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.446079 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.446047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-envoy\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.546912 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.546868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f790286-5663-4c8d-9469-4bc902bcf9d0-istiod-ca-cert\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.546925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-envoy\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-token\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcxzr\" (UniqueName: \"kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-kube-api-access-rcxzr\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-podinfo\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-credential-socket\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-socket\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-certs\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547398 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-data\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-credential-socket\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-socket\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547722 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f790286-5663-4c8d-9469-4bc902bcf9d0-istiod-ca-cert\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547722 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-data\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.547791 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.547751    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-certs\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.549544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.549518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-envoy\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.549668 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.549572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-podinfo\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.554599 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.554573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-token\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.555363 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.555345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcxzr\" (UniqueName: \"kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-kube-api-access-rcxzr\") pod \"e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") " pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:55.723596 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:55.723511    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:56.013764 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:56.013737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"]
Sep 11 19:34:56.015871 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:34:56.015839    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f790286_5663_4c8d_9469_4bc902bcf9d0.slice/crio-bbe59246f8aae35eb316e45f1bc7168c573e007d9634df20ee28059f04f5175d WatchSource:0}: Error finding container bbe59246f8aae35eb316e45f1bc7168c573e007d9634df20ee28059f04f5175d: Status 404 returned error can't find the container with id bbe59246f8aae35eb316e45f1bc7168c573e007d9634df20ee28059f04f5175d
Sep 11 19:34:56.018132 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:56.018096    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:34:56.018241 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:56.018172    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:34:56.018241 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:56.018218    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:34:56.896763 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:56.896725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" event={"ID":"6f790286-5663-4c8d-9469-4bc902bcf9d0","Type":"ContainerStarted","Data":"4c8df7439d8b91555788ffcbbf6126cf391fbc7cd072a71ecbecd14a4ac10e77"}
Sep 11 19:34:56.897190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:56.896778    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" event={"ID":"6f790286-5663-4c8d-9469-4bc902bcf9d0","Type":"ContainerStarted","Data":"bbe59246f8aae35eb316e45f1bc7168c573e007d9634df20ee28059f04f5175d"}
Sep 11 19:34:56.917245 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:56.917189    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" podStartSLOduration=1.917173996 podStartE2EDuration="1.917173996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:34:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:34:56.915667505 +0000 UTC m=+996.936875674" watchObservedRunningTime="2026-09-11 19:34:56.917173996 +0000 UTC m=+996.938382157"
Sep 11 19:34:57.724363 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:57.724322    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:57.729913 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:57.729888    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:57.902601 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:57.902569    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:34:57.903729 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:34:57.903706    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:35:01.742030 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.741994    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"]
Sep 11 19:35:01.745623 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.745603    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:35:01.747628 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.747606    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-472add-dockercfg-j8bbx\""
Sep 11 19:35:01.748231 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.748204    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-472add\""
Sep 11 19:35:01.758776 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.758750    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"]
Sep 11 19:35:01.817456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.817413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29c6767-31a6-400f-9e44-bebb7f65fdf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh\" (UID: \"a29c6767-31a6-400f-9e44-bebb7f65fdf7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:35:01.817456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.817459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5f6p\" (UniqueName: \"kubernetes.io/projected/a29c6767-31a6-400f-9e44-bebb7f65fdf7-kube-api-access-s5f6p\") pod \"payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh\" (UID: \"a29c6767-31a6-400f-9e44-bebb7f65fdf7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:35:01.919125 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.919083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29c6767-31a6-400f-9e44-bebb7f65fdf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh\" (UID: \"a29c6767-31a6-400f-9e44-bebb7f65fdf7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:35:01.919125 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.919132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5f6p\" (UniqueName: \"kubernetes.io/projected/a29c6767-31a6-400f-9e44-bebb7f65fdf7-kube-api-access-s5f6p\") pod \"payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh\" (UID: \"a29c6767-31a6-400f-9e44-bebb7f65fdf7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:35:01.919881 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.919858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29c6767-31a6-400f-9e44-bebb7f65fdf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh\" (UID: \"a29c6767-31a6-400f-9e44-bebb7f65fdf7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:35:01.927446 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:01.927420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5f6p\" (UniqueName: \"kubernetes.io/projected/a29c6767-31a6-400f-9e44-bebb7f65fdf7-kube-api-access-s5f6p\") pod \"payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh\" (UID: \"a29c6767-31a6-400f-9e44-bebb7f65fdf7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:35:02.064515 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:02.064424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:35:02.351335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:02.351309    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"]
Sep 11 19:35:02.352665 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:35:02.352628    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29c6767_31a6_400f_9e44_bebb7f65fdf7.slice/crio-69bcc755045f215a14d49460dc5f91f53cb9417a16bbdd57f3fa3da96fbd5816 WatchSource:0}: Error finding container 69bcc755045f215a14d49460dc5f91f53cb9417a16bbdd57f3fa3da96fbd5816: Status 404 returned error can't find the container with id 69bcc755045f215a14d49460dc5f91f53cb9417a16bbdd57f3fa3da96fbd5816
Sep 11 19:35:02.930996 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:02.930961    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:35:02.931508 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:02.931020    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:35:02.936716 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:02.936683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh" event={"ID":"a29c6767-31a6-400f-9e44-bebb7f65fdf7","Type":"ContainerStarted","Data":"8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13"}
Sep 11 19:35:02.936881 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:02.936743    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh" event={"ID":"a29c6767-31a6-400f-9e44-bebb7f65fdf7","Type":"ContainerStarted","Data":"69bcc755045f215a14d49460dc5f91f53cb9417a16bbdd57f3fa3da96fbd5816"}
Sep 11 19:35:02.936881 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:02.936776    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:35:02.944392 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:02.944361    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:35:02.954761 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:02.954716    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh" podStartSLOduration=1.954698695 podStartE2EDuration="1.954698695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:02.951637461 +0000 UTC m=+1002.972845634" watchObservedRunningTime="2026-09-11 19:35:02.954698695 +0000 UTC m=+1002.975906846"
Sep 11 19:35:03.953769 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:03.953741    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:35:13.945489 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:13.945454    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:35:19.697670 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.697631    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"]
Sep 11 19:35:19.701133 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.701116    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:35:19.703549 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.703518    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-20a8f069\""
Sep 11 19:35:19.703666 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.703612    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-20a8f069-dockercfg-8lhjk\""
Sep 11 19:35:19.711049 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.711020    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"]
Sep 11 19:35:19.795611 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.795578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa2010a-b201-41dc-937a-2f5043025016-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn\" (UID: \"1fa2010a-b201-41dc-937a-2f5043025016\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:35:19.795785 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.795640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw6jq\" (UniqueName: \"kubernetes.io/projected/1fa2010a-b201-41dc-937a-2f5043025016-kube-api-access-kw6jq\") pod \"payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn\" (UID: \"1fa2010a-b201-41dc-937a-2f5043025016\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:35:19.896353 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.896319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa2010a-b201-41dc-937a-2f5043025016-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn\" (UID: \"1fa2010a-b201-41dc-937a-2f5043025016\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:35:19.896520 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.896412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6jq\" (UniqueName: \"kubernetes.io/projected/1fa2010a-b201-41dc-937a-2f5043025016-kube-api-access-kw6jq\") pod \"payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn\" (UID: \"1fa2010a-b201-41dc-937a-2f5043025016\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:35:19.897138 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.897117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa2010a-b201-41dc-937a-2f5043025016-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn\" (UID: \"1fa2010a-b201-41dc-937a-2f5043025016\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:35:19.905723 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:19.905689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw6jq\" (UniqueName: \"kubernetes.io/projected/1fa2010a-b201-41dc-937a-2f5043025016-kube-api-access-kw6jq\") pod \"payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn\" (UID: \"1fa2010a-b201-41dc-937a-2f5043025016\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:35:20.014650 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:20.014558    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:35:20.294921 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:35:20.294889    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa2010a_b201_41dc_937a_2f5043025016.slice/crio-309fe164f6cf45bc412cfce9505be3d648415606d8ca92a06ed61b425e35c01e WatchSource:0}: Error finding container 309fe164f6cf45bc412cfce9505be3d648415606d8ca92a06ed61b425e35c01e: Status 404 returned error can't find the container with id 309fe164f6cf45bc412cfce9505be3d648415606d8ca92a06ed61b425e35c01e
Sep 11 19:35:20.295656 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:20.295628    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"]
Sep 11 19:35:21.064641 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:21.064606    2580 generic.go:356] "Generic (PLEG): container finished" podID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerID="4c8df7439d8b91555788ffcbbf6126cf391fbc7cd072a71ecbecd14a4ac10e77" exitCode=0
Sep 11 19:35:21.065096 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:21.064676    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" event={"ID":"6f790286-5663-4c8d-9469-4bc902bcf9d0","Type":"ContainerDied","Data":"4c8df7439d8b91555788ffcbbf6126cf391fbc7cd072a71ecbecd14a4ac10e77"}
Sep 11 19:35:21.065170 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:21.065147    2580 scope.go:117] "RemoveContainer" containerID="4c8df7439d8b91555788ffcbbf6126cf391fbc7cd072a71ecbecd14a4ac10e77"
Sep 11 19:35:21.066523 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:21.066491    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:35:21.066636 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:21.066563    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:35:21.066636 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:21.066604    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:35:21.066709 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:21.066504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn" event={"ID":"1fa2010a-b201-41dc-937a-2f5043025016","Type":"ContainerStarted","Data":"9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74"}
Sep 11 19:35:21.066749 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:21.066730    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:35:21.066783 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:21.066756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn" event={"ID":"1fa2010a-b201-41dc-937a-2f5043025016","Type":"ContainerStarted","Data":"309fe164f6cf45bc412cfce9505be3d648415606d8ca92a06ed61b425e35c01e"}
Sep 11 19:35:21.134466 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:21.134411    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn" podStartSLOduration=2.134388543 podStartE2EDuration="2.134388543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:21.127054419 +0000 UTC m=+1021.148262573" watchObservedRunningTime="2026-09-11 19:35:21.134388543 +0000 UTC m=+1021.155596696"
Sep 11 19:35:22.075160 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:22.075124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" event={"ID":"6f790286-5663-4c8d-9469-4bc902bcf9d0","Type":"ContainerStarted","Data":"0303c3194cafdee4ce92f69709158f17284b1e1f92c816e2b007bd2d15d1f55a"}
Sep 11 19:35:22.724067 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:22.724034    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:35:22.724258 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:22.724233    2580 patch_prober.go:28] interesting pod/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 19:35:22.724323 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:22.724302    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 19:35:23.724822 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:23.724783    2580 patch_prober.go:28] interesting pod/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 19:35:23.725208 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:23.724843    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 19:35:24.724514 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:24.724478    2580 patch_prober.go:28] interesting pod/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 19:35:24.724702 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:24.724536    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 19:35:25.724740 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:25.724700    2580 patch_prober.go:28] interesting pod/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 19:35:25.725135 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:25.724758    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 19:35:26.724409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:26.724372    2580 patch_prober.go:28] interesting pod/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 19:35:26.724590 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:26.724440    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 19:35:27.728297 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:27.728242    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:35:27.728694 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:27.728520    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:35:27.729296 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:27.729262    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:35:32.077760 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:32.077729    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:35:36.292073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.292035    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"]
Sep 11 19:35:36.295271 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.295247    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.298487 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.298456    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-515a4f\"/\"openshift-service-ca.crt\""
Sep 11 19:35:36.298642 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.298531    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-515a4f\"/\"test-model-515a4f-kserve-self-signed-certs\""
Sep 11 19:35:36.298642 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.298565    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-515a4f\"/\"default-dockercfg-55vtf\""
Sep 11 19:35:36.298778 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.298758    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-515a4f\"/\"kube-root-ca.crt\""
Sep 11 19:35:36.304940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.304911    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"]
Sep 11 19:35:36.361928 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.361894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tls-certs\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.362083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.361938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85txz\" (UniqueName: \"kubernetes.io/projected/a9950dba-e999-4d68-9c5b-01e6a491ed6f-kube-api-access-85txz\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.362083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.361962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-home\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.362083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.362015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-dshm\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.362083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.362048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-model-cache\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.362224 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.362112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tmp-dir\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.463579 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.463539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tls-certs\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.463769 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.463593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85txz\" (UniqueName: \"kubernetes.io/projected/a9950dba-e999-4d68-9c5b-01e6a491ed6f-kube-api-access-85txz\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.463769 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.463622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-home\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.463769 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.463663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-dshm\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.463769 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.463714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-model-cache\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.463769 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.463751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tmp-dir\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.464074 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.464045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-home\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.464154 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.464072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-model-cache\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.464244 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.464221    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tmp-dir\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.465921 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.465902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-dshm\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.466178 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.466159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tls-certs\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.470953 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.470925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85txz\" (UniqueName: \"kubernetes.io/projected/a9950dba-e999-4d68-9c5b-01e6a491ed6f-kube-api-access-85txz\") pod \"test-model-515a4f-kserve-977556f7c-msjwr\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") " pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.607839 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.607753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:36.883431 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:36.883353    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"]
Sep 11 19:35:36.886825 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:35:36.886792    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9950dba_e999_4d68_9c5b_01e6a491ed6f.slice/crio-6afad176857cbc7b873512bc15e59ed54ffbb4213698f1949cbaa0b6efa58364 WatchSource:0}: Error finding container 6afad176857cbc7b873512bc15e59ed54ffbb4213698f1949cbaa0b6efa58364: Status 404 returned error can't find the container with id 6afad176857cbc7b873512bc15e59ed54ffbb4213698f1949cbaa0b6efa58364
Sep 11 19:35:37.171147 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:37.171039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr" event={"ID":"a9950dba-e999-4d68-9c5b-01e6a491ed6f","Type":"ContainerStarted","Data":"45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b"}
Sep 11 19:35:37.171147 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:37.171088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr" event={"ID":"a9950dba-e999-4d68-9c5b-01e6a491ed6f","Type":"ContainerStarted","Data":"6afad176857cbc7b873512bc15e59ed54ffbb4213698f1949cbaa0b6efa58364"}
Sep 11 19:35:37.190714 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:37.190662    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr" podStartSLOduration=1.190647549 podStartE2EDuration="1.190647549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:37.187903585 +0000 UTC m=+1037.209111757" watchObservedRunningTime="2026-09-11 19:35:37.190647549 +0000 UTC m=+1037.211855698"
Sep 11 19:35:46.608869 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:46.608834    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:46.609423 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:46.608912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:46.621941 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:46.621918    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:47.240562 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:47.240532    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:35:52.287178 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:52.287135    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"]
Sep 11 19:35:52.289902 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:52.289877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"
Sep 11 19:35:52.292189 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:52.292161    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:35:52.292275 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:52.292258    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:35:52.298884 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:52.298798    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"]
Sep 11 19:35:52.428212 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:52.428170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa6933c-2d29-41d5-903a-c6e7ba81eb3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-20a8f069-skbbn\" (UID: \"efa6933c-2d29-41d5-903a-c6e7ba81eb3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"
Sep 11 19:35:52.529334 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:52.529270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa6933c-2d29-41d5-903a-c6e7ba81eb3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-20a8f069-skbbn\" (UID: \"efa6933c-2d29-41d5-903a-c6e7ba81eb3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"
Sep 11 19:35:52.529915 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:52.529894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa6933c-2d29-41d5-903a-c6e7ba81eb3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-20a8f069-skbbn\" (UID: \"efa6933c-2d29-41d5-903a-c6e7ba81eb3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"
Sep 11 19:35:52.603197 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:52.603101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"
Sep 11 19:35:52.877713 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:52.877681    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"]
Sep 11 19:35:52.878781 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:35:52.878754    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa6933c_2d29_41d5_903a_c6e7ba81eb3c.slice/crio-49cc80960e0167b10555a7376eef318bedfc05b4f8378d174b2cf71f73b33bd7 WatchSource:0}: Error finding container 49cc80960e0167b10555a7376eef318bedfc05b4f8378d174b2cf71f73b33bd7: Status 404 returned error can't find the container with id 49cc80960e0167b10555a7376eef318bedfc05b4f8378d174b2cf71f73b33bd7
Sep 11 19:35:53.269441 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:53.269405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn" event={"ID":"efa6933c-2d29-41d5-903a-c6e7ba81eb3c","Type":"ContainerStarted","Data":"98dec9350fd9b231d510405a91be78e838773c6bcdb8acd0ee0c1f9f76d1131f"}
Sep 11 19:35:53.269617 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:53.269465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn" event={"ID":"efa6933c-2d29-41d5-903a-c6e7ba81eb3c","Type":"ContainerStarted","Data":"49cc80960e0167b10555a7376eef318bedfc05b4f8378d174b2cf71f73b33bd7"}
Sep 11 19:35:53.287627 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:53.287575    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn" podStartSLOduration=1.2875590909999999 podStartE2EDuration="1.287559091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:53.28502279 +0000 UTC m=+1053.306230965" watchObservedRunningTime="2026-09-11 19:35:53.287559091 +0000 UTC m=+1053.308767237"
Sep 11 19:35:54.277493 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:54.277455    2580 generic.go:356] "Generic (PLEG): container finished" podID="efa6933c-2d29-41d5-903a-c6e7ba81eb3c" containerID="98dec9350fd9b231d510405a91be78e838773c6bcdb8acd0ee0c1f9f76d1131f" exitCode=0
Sep 11 19:35:54.277668 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:54.277542    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn" event={"ID":"efa6933c-2d29-41d5-903a-c6e7ba81eb3c","Type":"ContainerDied","Data":"98dec9350fd9b231d510405a91be78e838773c6bcdb8acd0ee0c1f9f76d1131f"}
Sep 11 19:35:55.421269 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:55.421235    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"
Sep 11 19:35:55.561144 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:55.561064    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa6933c-2d29-41d5-903a-c6e7ba81eb3c-maas-api-service-ca\") pod \"efa6933c-2d29-41d5-903a-c6e7ba81eb3c\" (UID: \"efa6933c-2d29-41d5-903a-c6e7ba81eb3c\") "
Sep 11 19:35:55.561454 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:55.561432    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa6933c-2d29-41d5-903a-c6e7ba81eb3c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "efa6933c-2d29-41d5-903a-c6e7ba81eb3c" (UID: "efa6933c-2d29-41d5-903a-c6e7ba81eb3c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:35:55.661801 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:55.661766    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa6933c-2d29-41d5-903a-c6e7ba81eb3c-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:35:56.292116 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:56.292081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn" event={"ID":"efa6933c-2d29-41d5-903a-c6e7ba81eb3c","Type":"ContainerDied","Data":"49cc80960e0167b10555a7376eef318bedfc05b4f8378d174b2cf71f73b33bd7"}
Sep 11 19:35:56.292116 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:56.292114    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"
Sep 11 19:35:56.292336 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:35:56.292130    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49cc80960e0167b10555a7376eef318bedfc05b4f8378d174b2cf71f73b33bd7"
Sep 11 19:36:02.924840 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:02.924795    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"]
Sep 11 19:36:02.925332 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:02.925060    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn" podUID="1fa2010a-b201-41dc-937a-2f5043025016" containerName="payload-pre-processing" containerID="cri-o://9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74" gracePeriod=30
Sep 11 19:36:03.078874 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.078834    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"]
Sep 11 19:36:03.081529 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.081497    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-20a8f069-skbbn"]
Sep 11 19:36:03.198919 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.198885    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:36:03.228598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.228562    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw6jq\" (UniqueName: \"kubernetes.io/projected/1fa2010a-b201-41dc-937a-2f5043025016-kube-api-access-kw6jq\") pod \"1fa2010a-b201-41dc-937a-2f5043025016\" (UID: \"1fa2010a-b201-41dc-937a-2f5043025016\") "
Sep 11 19:36:03.228791 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.228611    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa2010a-b201-41dc-937a-2f5043025016-plugins-config-volume\") pod \"1fa2010a-b201-41dc-937a-2f5043025016\" (UID: \"1fa2010a-b201-41dc-937a-2f5043025016\") "
Sep 11 19:36:03.228995 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.228969    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fa2010a-b201-41dc-937a-2f5043025016-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1fa2010a-b201-41dc-937a-2f5043025016" (UID: "1fa2010a-b201-41dc-937a-2f5043025016"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:36:03.230683 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.230652    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa2010a-b201-41dc-937a-2f5043025016-kube-api-access-kw6jq" (OuterVolumeSpecName: "kube-api-access-kw6jq") pod "1fa2010a-b201-41dc-937a-2f5043025016" (UID: "1fa2010a-b201-41dc-937a-2f5043025016"). InnerVolumeSpecName "kube-api-access-kw6jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:36:03.330125 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.330092    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw6jq\" (UniqueName: \"kubernetes.io/projected/1fa2010a-b201-41dc-937a-2f5043025016-kube-api-access-kw6jq\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:36:03.330125 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.330120    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa2010a-b201-41dc-937a-2f5043025016-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:36:03.333967 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.333935    2580 generic.go:356] "Generic (PLEG): container finished" podID="1fa2010a-b201-41dc-937a-2f5043025016" containerID="9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74" exitCode=0
Sep 11 19:36:03.334080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.333975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn" event={"ID":"1fa2010a-b201-41dc-937a-2f5043025016","Type":"ContainerDied","Data":"9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74"}
Sep 11 19:36:03.334080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.333980    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"
Sep 11 19:36:03.334080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.334045    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn" event={"ID":"1fa2010a-b201-41dc-937a-2f5043025016","Type":"ContainerDied","Data":"309fe164f6cf45bc412cfce9505be3d648415606d8ca92a06ed61b425e35c01e"}
Sep 11 19:36:03.334080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.334066    2580 scope.go:117] "RemoveContainer" containerID="9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74"
Sep 11 19:36:03.344668 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.344649    2580 scope.go:117] "RemoveContainer" containerID="9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74"
Sep 11 19:36:03.344941 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:36:03.344922    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74\": container with ID starting with 9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74 not found: ID does not exist" containerID="9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74"
Sep 11 19:36:03.345002 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.344953    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74"} err="failed to get container status \"9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74\": rpc error: code = NotFound desc = could not find container \"9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74\": container with ID starting with 9420d2576c24db943243d8561c455f50b834cb135c952db5b468080b41470b74 not found: ID does not exist"
Sep 11 19:36:03.355289 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.355252    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"]
Sep 11 19:36:03.360147 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:03.360121    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-20a8f069-66d6bfdd6-zgzvn"]
Sep 11 19:36:04.450066 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:04.450030    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa2010a-b201-41dc-937a-2f5043025016" path="/var/lib/kubelet/pods/1fa2010a-b201-41dc-937a-2f5043025016/volumes"
Sep 11 19:36:04.450476 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:04.450441    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efa6933c-2d29-41d5-903a-c6e7ba81eb3c" path="/var/lib/kubelet/pods/efa6933c-2d29-41d5-903a-c6e7ba81eb3c/volumes"
Sep 11 19:36:30.574064 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.574024    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"]
Sep 11 19:36:30.574525 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.574449    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa6933c-2d29-41d5-903a-c6e7ba81eb3c" containerName="revoke-keys"
Sep 11 19:36:30.574525 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.574461    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa6933c-2d29-41d5-903a-c6e7ba81eb3c" containerName="revoke-keys"
Sep 11 19:36:30.574525 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.574481    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa2010a-b201-41dc-937a-2f5043025016" containerName="payload-pre-processing"
Sep 11 19:36:30.574525 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.574487    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa2010a-b201-41dc-937a-2f5043025016" containerName="payload-pre-processing"
Sep 11 19:36:30.574667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.574555    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa6933c-2d29-41d5-903a-c6e7ba81eb3c" containerName="revoke-keys"
Sep 11 19:36:30.574667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.574564    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fa2010a-b201-41dc-937a-2f5043025016" containerName="payload-pre-processing"
Sep 11 19:36:30.577233 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.577213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:36:30.580434 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.580410    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-b5bf35\""
Sep 11 19:36:30.580528 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.580436    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-b5bf35-dockercfg-vgr2g\""
Sep 11 19:36:30.586548 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.586522    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"]
Sep 11 19:36:30.601654 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.601627    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"]
Sep 11 19:36:30.607707 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.607689    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:36:30.616723 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.616700    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"]
Sep 11 19:36:30.617009 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.616987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt7lw\" (UniqueName: \"kubernetes.io/projected/6264aa67-c496-490c-8b47-16cabffeb157-kube-api-access-xt7lw\") pod \"payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s\" (UID: \"6264aa67-c496-490c-8b47-16cabffeb157\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:36:30.617084 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.617028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s92qw\" (UniqueName: \"kubernetes.io/projected/93b00f44-75c2-4170-baaf-f48d77f9dae3-kube-api-access-s92qw\") pod \"payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4\" (UID: \"93b00f44-75c2-4170-baaf-f48d77f9dae3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:36:30.617127 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.617086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93b00f44-75c2-4170-baaf-f48d77f9dae3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4\" (UID: \"93b00f44-75c2-4170-baaf-f48d77f9dae3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:36:30.617183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.617169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6264aa67-c496-490c-8b47-16cabffeb157-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s\" (UID: \"6264aa67-c496-490c-8b47-16cabffeb157\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:36:30.718010 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.717978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6264aa67-c496-490c-8b47-16cabffeb157-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s\" (UID: \"6264aa67-c496-490c-8b47-16cabffeb157\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:36:30.718167 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.718052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt7lw\" (UniqueName: \"kubernetes.io/projected/6264aa67-c496-490c-8b47-16cabffeb157-kube-api-access-xt7lw\") pod \"payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s\" (UID: \"6264aa67-c496-490c-8b47-16cabffeb157\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:36:30.718167 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.718102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s92qw\" (UniqueName: \"kubernetes.io/projected/93b00f44-75c2-4170-baaf-f48d77f9dae3-kube-api-access-s92qw\") pod \"payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4\" (UID: \"93b00f44-75c2-4170-baaf-f48d77f9dae3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:36:30.718167 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.718135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93b00f44-75c2-4170-baaf-f48d77f9dae3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4\" (UID: \"93b00f44-75c2-4170-baaf-f48d77f9dae3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:36:30.718700 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.718679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6264aa67-c496-490c-8b47-16cabffeb157-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s\" (UID: \"6264aa67-c496-490c-8b47-16cabffeb157\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:36:30.718817 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.718800    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93b00f44-75c2-4170-baaf-f48d77f9dae3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4\" (UID: \"93b00f44-75c2-4170-baaf-f48d77f9dae3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:36:30.726319 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.726291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt7lw\" (UniqueName: \"kubernetes.io/projected/6264aa67-c496-490c-8b47-16cabffeb157-kube-api-access-xt7lw\") pod \"payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s\" (UID: \"6264aa67-c496-490c-8b47-16cabffeb157\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:36:30.726426 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.726315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s92qw\" (UniqueName: \"kubernetes.io/projected/93b00f44-75c2-4170-baaf-f48d77f9dae3-kube-api-access-s92qw\") pod \"payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4\" (UID: \"93b00f44-75c2-4170-baaf-f48d77f9dae3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:36:30.888708 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.888626    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:36:30.919234 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:30.919201    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:36:31.161583 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:31.161554    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"]
Sep 11 19:36:31.162536 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:36:31.162511    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b00f44_75c2_4170_baaf_f48d77f9dae3.slice/crio-8cd5c625eb891d733e38ee52491f599cb49e1fdda6d0d8d8d007131c13b518d8 WatchSource:0}: Error finding container 8cd5c625eb891d733e38ee52491f599cb49e1fdda6d0d8d8d007131c13b518d8: Status 404 returned error can't find the container with id 8cd5c625eb891d733e38ee52491f599cb49e1fdda6d0d8d8d007131c13b518d8
Sep 11 19:36:31.205213 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:31.205187    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"]
Sep 11 19:36:31.206570 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:36:31.206542    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6264aa67_c496_490c_8b47_16cabffeb157.slice/crio-567f3a9f2d4e4d895168e201e3b1fe917d9f633ab4149d6f1d0f93ab45e1ca54 WatchSource:0}: Error finding container 567f3a9f2d4e4d895168e201e3b1fe917d9f633ab4149d6f1d0f93ab45e1ca54: Status 404 returned error can't find the container with id 567f3a9f2d4e4d895168e201e3b1fe917d9f633ab4149d6f1d0f93ab45e1ca54
Sep 11 19:36:31.506644 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:31.506611    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s" event={"ID":"6264aa67-c496-490c-8b47-16cabffeb157","Type":"ContainerStarted","Data":"c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959"}
Sep 11 19:36:31.506845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:31.506668    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s" event={"ID":"6264aa67-c496-490c-8b47-16cabffeb157","Type":"ContainerStarted","Data":"567f3a9f2d4e4d895168e201e3b1fe917d9f633ab4149d6f1d0f93ab45e1ca54"}
Sep 11 19:36:31.506845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:31.506794    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:36:31.508494 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:31.508466    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4" event={"ID":"93b00f44-75c2-4170-baaf-f48d77f9dae3","Type":"ContainerStarted","Data":"e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb"}
Sep 11 19:36:31.508616 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:31.508513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4" event={"ID":"93b00f44-75c2-4170-baaf-f48d77f9dae3","Type":"ContainerStarted","Data":"8cd5c625eb891d733e38ee52491f599cb49e1fdda6d0d8d8d007131c13b518d8"}
Sep 11 19:36:31.508616 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:31.508563    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:36:31.535037 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:31.528216    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s" podStartSLOduration=1.528189057 podStartE2EDuration="1.528189057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:36:31.522029869 +0000 UTC m=+1091.543238038" watchObservedRunningTime="2026-09-11 19:36:31.528189057 +0000 UTC m=+1091.549397208"
Sep 11 19:36:31.539810 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:31.539766    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4" podStartSLOduration=1.539752112 podStartE2EDuration="1.539752112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:36:31.538808958 +0000 UTC m=+1091.560017136" watchObservedRunningTime="2026-09-11 19:36:31.539752112 +0000 UTC m=+1091.560960262"
Sep 11 19:36:42.516902 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:42.516869    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:36:42.517455 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:42.516937    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:36:52.236940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:52.236904    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"]
Sep 11 19:36:52.239510 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:52.239490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"
Sep 11 19:36:52.241616 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:52.241592    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:36:52.241616 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:52.241604    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:36:52.247295 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:52.247260    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"]
Sep 11 19:36:52.340003 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:52.339972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae6ee783-108d-4320-b114-a26293b6d74e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-472add-mn56f\" (UID: \"ae6ee783-108d-4320-b114-a26293b6d74e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"
Sep 11 19:36:52.440643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:52.440603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae6ee783-108d-4320-b114-a26293b6d74e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-472add-mn56f\" (UID: \"ae6ee783-108d-4320-b114-a26293b6d74e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"
Sep 11 19:36:52.441206 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:52.441187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae6ee783-108d-4320-b114-a26293b6d74e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-472add-mn56f\" (UID: \"ae6ee783-108d-4320-b114-a26293b6d74e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"
Sep 11 19:36:52.552909 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:52.552825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"
Sep 11 19:36:52.823260 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:52.823228    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"]
Sep 11 19:36:52.824071 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:36:52.824044    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6ee783_108d_4320_b114_a26293b6d74e.slice/crio-0c65716d2d331f7a61e0ad4c7c1882dc838bef22b36fe5aaa816889e1b55807e WatchSource:0}: Error finding container 0c65716d2d331f7a61e0ad4c7c1882dc838bef22b36fe5aaa816889e1b55807e: Status 404 returned error can't find the container with id 0c65716d2d331f7a61e0ad4c7c1882dc838bef22b36fe5aaa816889e1b55807e
Sep 11 19:36:53.650301 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:53.650240    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae6ee783-108d-4320-b114-a26293b6d74e" containerID="9d763b4118bfc449ba6f9adb3b6934eaa98671d94324b366e22cd399133e59cf" exitCode=0
Sep 11 19:36:53.650729 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:53.650337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f" event={"ID":"ae6ee783-108d-4320-b114-a26293b6d74e","Type":"ContainerDied","Data":"9d763b4118bfc449ba6f9adb3b6934eaa98671d94324b366e22cd399133e59cf"}
Sep 11 19:36:53.650729 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:53.650387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f" event={"ID":"ae6ee783-108d-4320-b114-a26293b6d74e","Type":"ContainerStarted","Data":"0c65716d2d331f7a61e0ad4c7c1882dc838bef22b36fe5aaa816889e1b55807e"}
Sep 11 19:36:54.799603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:54.799575    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"
Sep 11 19:36:54.968804 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:54.968768    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae6ee783-108d-4320-b114-a26293b6d74e-maas-api-service-ca\") pod \"ae6ee783-108d-4320-b114-a26293b6d74e\" (UID: \"ae6ee783-108d-4320-b114-a26293b6d74e\") "
Sep 11 19:36:54.969127 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:54.969099    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae6ee783-108d-4320-b114-a26293b6d74e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ae6ee783-108d-4320-b114-a26293b6d74e" (UID: "ae6ee783-108d-4320-b114-a26293b6d74e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:36:55.070357 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:55.070325    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae6ee783-108d-4320-b114-a26293b6d74e-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:36:55.664541 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:55.664511    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"
Sep 11 19:36:55.664541 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:55.664529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f" event={"ID":"ae6ee783-108d-4320-b114-a26293b6d74e","Type":"ContainerDied","Data":"0c65716d2d331f7a61e0ad4c7c1882dc838bef22b36fe5aaa816889e1b55807e"}
Sep 11 19:36:55.664752 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:36:55.664573    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c65716d2d331f7a61e0ad4c7c1882dc838bef22b36fe5aaa816889e1b55807e"
Sep 11 19:37:02.792968 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:02.792932    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"]
Sep 11 19:37:02.793410 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:02.793141    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh" podUID="a29c6767-31a6-400f-9e44-bebb7f65fdf7" containerName="payload-pre-processing" containerID="cri-o://8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13" gracePeriod=30
Sep 11 19:37:02.980458 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:02.980422    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"]
Sep 11 19:37:02.989887 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:02.989859    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-472add-mn56f"]
Sep 11 19:37:03.075369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.074658    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:37:03.157661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.157621    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5f6p\" (UniqueName: \"kubernetes.io/projected/a29c6767-31a6-400f-9e44-bebb7f65fdf7-kube-api-access-s5f6p\") pod \"a29c6767-31a6-400f-9e44-bebb7f65fdf7\" (UID: \"a29c6767-31a6-400f-9e44-bebb7f65fdf7\") "
Sep 11 19:37:03.157873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.157685    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29c6767-31a6-400f-9e44-bebb7f65fdf7-plugins-config-volume\") pod \"a29c6767-31a6-400f-9e44-bebb7f65fdf7\" (UID: \"a29c6767-31a6-400f-9e44-bebb7f65fdf7\") "
Sep 11 19:37:03.158055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.158028    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a29c6767-31a6-400f-9e44-bebb7f65fdf7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a29c6767-31a6-400f-9e44-bebb7f65fdf7" (UID: "a29c6767-31a6-400f-9e44-bebb7f65fdf7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:03.159899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.159874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a29c6767-31a6-400f-9e44-bebb7f65fdf7-kube-api-access-s5f6p" (OuterVolumeSpecName: "kube-api-access-s5f6p") pod "a29c6767-31a6-400f-9e44-bebb7f65fdf7" (UID: "a29c6767-31a6-400f-9e44-bebb7f65fdf7"). InnerVolumeSpecName "kube-api-access-s5f6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:37:03.258755 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.258713    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5f6p\" (UniqueName: \"kubernetes.io/projected/a29c6767-31a6-400f-9e44-bebb7f65fdf7-kube-api-access-s5f6p\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:03.258755 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.258748    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29c6767-31a6-400f-9e44-bebb7f65fdf7-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:03.715755 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.715710    2580 generic.go:356] "Generic (PLEG): container finished" podID="a29c6767-31a6-400f-9e44-bebb7f65fdf7" containerID="8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13" exitCode=0
Sep 11 19:37:03.715755 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.715752    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"
Sep 11 19:37:03.715988 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.715758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh" event={"ID":"a29c6767-31a6-400f-9e44-bebb7f65fdf7","Type":"ContainerDied","Data":"8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13"}
Sep 11 19:37:03.715988 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.715817    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh" event={"ID":"a29c6767-31a6-400f-9e44-bebb7f65fdf7","Type":"ContainerDied","Data":"69bcc755045f215a14d49460dc5f91f53cb9417a16bbdd57f3fa3da96fbd5816"}
Sep 11 19:37:03.715988 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.715852    2580 scope.go:117] "RemoveContainer" containerID="8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13"
Sep 11 19:37:03.725479 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.725458    2580 scope.go:117] "RemoveContainer" containerID="8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13"
Sep 11 19:37:03.725764 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:37:03.725743    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13\": container with ID starting with 8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13 not found: ID does not exist" containerID="8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13"
Sep 11 19:37:03.725833 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.725776    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13"} err="failed to get container status \"8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13\": rpc error: code = NotFound desc = could not find container \"8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13\": container with ID starting with 8c8d1abc42ff917cd758242ff93be085bdca9ecb567e32b8bc279c818ccd2e13 not found: ID does not exist"
Sep 11 19:37:03.738038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.738010    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"]
Sep 11 19:37:03.741440 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:03.741420    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-472add-588cff74bb-z8jjh"]
Sep 11 19:37:04.453936 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:04.453901    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a29c6767-31a6-400f-9e44-bebb7f65fdf7" path="/var/lib/kubelet/pods/a29c6767-31a6-400f-9e44-bebb7f65fdf7/volumes"
Sep 11 19:37:04.454333 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:04.454221    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae6ee783-108d-4320-b114-a26293b6d74e" path="/var/lib/kubelet/pods/ae6ee783-108d-4320-b114-a26293b6d74e/volumes"
Sep 11 19:37:36.700761 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.700724    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"]
Sep 11 19:37:36.701261 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.701190    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29c6767-31a6-400f-9e44-bebb7f65fdf7" containerName="payload-pre-processing"
Sep 11 19:37:36.701261 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.701204    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29c6767-31a6-400f-9e44-bebb7f65fdf7" containerName="payload-pre-processing"
Sep 11 19:37:36.701261 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.701213    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae6ee783-108d-4320-b114-a26293b6d74e" containerName="revoke-keys"
Sep 11 19:37:36.701261 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.701218    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae6ee783-108d-4320-b114-a26293b6d74e" containerName="revoke-keys"
Sep 11 19:37:36.701499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.701334    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a29c6767-31a6-400f-9e44-bebb7f65fdf7" containerName="payload-pre-processing"
Sep 11 19:37:36.701499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.701343    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae6ee783-108d-4320-b114-a26293b6d74e" containerName="revoke-keys"
Sep 11 19:37:36.705651 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.705632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.708046 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.708018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1fc808\"/\"distinct-w0-1fc808-kserve-self-signed-certs\""
Sep 11 19:37:36.715454 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.715429    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"]
Sep 11 19:37:36.791992 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.791961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-model-cache\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.792134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.792027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-dshm\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.792134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.792071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m2r9\" (UniqueName: \"kubernetes.io/projected/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-kube-api-access-8m2r9\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.792134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.792126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-home\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.792243 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.792150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tmp-dir\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.792243 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.792204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tls-certs\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.893956 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.893900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m2r9\" (UniqueName: \"kubernetes.io/projected/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-kube-api-access-8m2r9\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.894732 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.894693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-home\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.895381 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.895358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tmp-dir\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.895859 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.895843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tls-certs\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.896415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.896396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-model-cache\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.896730 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.896704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-dshm\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.896855 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.895773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tmp-dir\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.896855 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.895266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-home\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.896855 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.896840    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-model-cache\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.899439 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.899418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-dshm\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.899561 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.899540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tls-certs\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:36.902114 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:36.902092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m2r9\" (UniqueName: \"kubernetes.io/projected/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-kube-api-access-8m2r9\") pod \"distinct-w0-1fc808-kserve-674f85579-299g5\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:37.017084 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:37.016985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:37.290099 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:37.290072    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"]
Sep 11 19:37:37.291306 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:37:37.291260    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfdbc30c_ddc3_462d_9e65_a4c183a20c36.slice/crio-2f7b6e006e65db8e238da1b60d9d3d4fee30d23f28828e450b923273d32fdf83 WatchSource:0}: Error finding container 2f7b6e006e65db8e238da1b60d9d3d4fee30d23f28828e450b923273d32fdf83: Status 404 returned error can't find the container with id 2f7b6e006e65db8e238da1b60d9d3d4fee30d23f28828e450b923273d32fdf83
Sep 11 19:37:37.936899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:37.936863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5" event={"ID":"cfdbc30c-ddc3-462d-9e65-a4c183a20c36","Type":"ContainerStarted","Data":"de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d"}
Sep 11 19:37:37.936899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:37.936905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5" event={"ID":"cfdbc30c-ddc3-462d-9e65-a4c183a20c36","Type":"ContainerStarted","Data":"2f7b6e006e65db8e238da1b60d9d3d4fee30d23f28828e450b923273d32fdf83"}
Sep 11 19:37:37.954796 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:37.954750    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5" podStartSLOduration=1.954734179 podStartE2EDuration="1.954734179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:37:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:37:37.953380972 +0000 UTC m=+1157.974589142" watchObservedRunningTime="2026-09-11 19:37:37.954734179 +0000 UTC m=+1157.975942328"
Sep 11 19:37:45.830129 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:45.830046    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"]
Sep 11 19:37:45.830697 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:45.830365    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy" containerID="cri-o://0303c3194cafdee4ce92f69709158f17284b1e1f92c816e2b007bd2d15d1f55a" gracePeriod=30
Sep 11 19:37:46.550428 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.550396    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"]
Sep 11 19:37:46.554530 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.554504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.556922 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.556899    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-967296-openshift-default-dockercfg-rfvbl\""
Sep 11 19:37:46.565340 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.565313    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"]
Sep 11 19:37:46.596573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.596529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-certs\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.596573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.596578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e223d8-8c67-491f-bc14-70da75d87672-istio-podinfo\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.596811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.596628    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-credential-socket\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.596811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.596694    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-envoy\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.596811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.596742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e223d8-8c67-491f-bc14-70da75d87672-istiod-ca-cert\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.596811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.596772    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-socket\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.596811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.596793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ddwk\" (UniqueName: \"kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-kube-api-access-6ddwk\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.597070 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.596821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-data\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.597070 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.596879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-istio-token\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.697828 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.697792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-envoy\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.697839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e223d8-8c67-491f-bc14-70da75d87672-istiod-ca-cert\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.697866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-socket\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.697887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ddwk\" (UniqueName: \"kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-kube-api-access-6ddwk\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.697904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-data\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.697941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-istio-token\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698021 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.697998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-certs\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698490 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.698143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e223d8-8c67-491f-bc14-70da75d87672-istio-podinfo\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698490 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.698195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-credential-socket\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698490 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.698341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-socket\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698490 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.698368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-data\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698693 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.698573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-credential-socket\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698802 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.698780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-certs\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.698867 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.698782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e223d8-8c67-491f-bc14-70da75d87672-istiod-ca-cert\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.700200 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.700181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-envoy\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.700590 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.700573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e223d8-8c67-491f-bc14-70da75d87672-istio-podinfo\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.708084 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.708053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ddwk\" (UniqueName: \"kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-kube-api-access-6ddwk\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.708708 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.708665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-istio-token\") pod \"e2e-noten-967296-openshift-default-6ffc69d94-zbt4n\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") " pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:46.866055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:46.865962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:47.017342 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:47.017314    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:47.017342 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:47.017361    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:47.030298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:47.030256    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:47.153445 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:47.153418    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"]
Sep 11 19:37:47.153570 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:37:47.153548    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e223d8_8c67_491f_bc14_70da75d87672.slice/crio-4721cf089d2b15d6b1c0bff0127ab0e964f725059c701d588ac1a0270a81344b WatchSource:0}: Error finding container 4721cf089d2b15d6b1c0bff0127ab0e964f725059c701d588ac1a0270a81344b: Status 404 returned error can't find the container with id 4721cf089d2b15d6b1c0bff0127ab0e964f725059c701d588ac1a0270a81344b
Sep 11 19:37:47.155866 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:47.155830    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:37:47.155992 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:47.155895    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:37:47.155992 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:47.155925    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:37:48.003008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:48.002964    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n" event={"ID":"68e223d8-8c67-491f-bc14-70da75d87672","Type":"ContainerStarted","Data":"684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1"}
Sep 11 19:37:48.003466 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:48.003027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n" event={"ID":"68e223d8-8c67-491f-bc14-70da75d87672","Type":"ContainerStarted","Data":"4721cf089d2b15d6b1c0bff0127ab0e964f725059c701d588ac1a0270a81344b"}
Sep 11 19:37:48.014335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:48.014309    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:37:48.025909 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:48.025851    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n" podStartSLOduration=2.025837096 podStartE2EDuration="2.025837096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:37:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:37:48.024382043 +0000 UTC m=+1168.045590205" watchObservedRunningTime="2026-09-11 19:37:48.025837096 +0000 UTC m=+1168.047045245"
Sep 11 19:37:48.866823 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:48.866788    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:48.877051 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:48.877017    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:49.009456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:49.009423    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:49.010913 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:49.010887    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:37:51.026400 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.026366    2580 generic.go:356] "Generic (PLEG): container finished" podID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerID="0303c3194cafdee4ce92f69709158f17284b1e1f92c816e2b007bd2d15d1f55a" exitCode=0
Sep 11 19:37:51.026840 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.026455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" event={"ID":"6f790286-5663-4c8d-9469-4bc902bcf9d0","Type":"ContainerDied","Data":"0303c3194cafdee4ce92f69709158f17284b1e1f92c816e2b007bd2d15d1f55a"}
Sep 11 19:37:51.026840 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.026537    2580 scope.go:117] "RemoveContainer" containerID="4c8df7439d8b91555788ffcbbf6126cf391fbc7cd072a71ecbecd14a4ac10e77"
Sep 11 19:37:51.096107 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.096048    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:37:51.143827 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.143794    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-token\") pod \"6f790286-5663-4c8d-9469-4bc902bcf9d0\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") "
Sep 11 19:37:51.143999 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.143886    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-envoy\") pod \"6f790286-5663-4c8d-9469-4bc902bcf9d0\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") "
Sep 11 19:37:51.143999 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.143947    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-certs\") pod \"6f790286-5663-4c8d-9469-4bc902bcf9d0\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") "
Sep 11 19:37:51.143999 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.143991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-socket\") pod \"6f790286-5663-4c8d-9469-4bc902bcf9d0\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") "
Sep 11 19:37:51.144169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.144030    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcxzr\" (UniqueName: \"kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-kube-api-access-rcxzr\") pod \"6f790286-5663-4c8d-9469-4bc902bcf9d0\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") "
Sep 11 19:37:51.144169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.144078    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-credential-socket\") pod \"6f790286-5663-4c8d-9469-4bc902bcf9d0\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") "
Sep 11 19:37:51.144348 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.144265    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-data\") pod \"6f790286-5663-4c8d-9469-4bc902bcf9d0\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") "
Sep 11 19:37:51.144574 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.144365    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f790286-5663-4c8d-9469-4bc902bcf9d0" (UID: "6f790286-5663-4c8d-9469-4bc902bcf9d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:37:51.144679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.144552    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f790286-5663-4c8d-9469-4bc902bcf9d0-istiod-ca-cert\") pod \"6f790286-5663-4c8d-9469-4bc902bcf9d0\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") "
Sep 11 19:37:51.144679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.144488    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f790286-5663-4c8d-9469-4bc902bcf9d0" (UID: "6f790286-5663-4c8d-9469-4bc902bcf9d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:37:51.144679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.144515    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f790286-5663-4c8d-9469-4bc902bcf9d0" (UID: "6f790286-5663-4c8d-9469-4bc902bcf9d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:37:51.144679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.144655    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-podinfo\") pod \"6f790286-5663-4c8d-9469-4bc902bcf9d0\" (UID: \"6f790286-5663-4c8d-9469-4bc902bcf9d0\") "
Sep 11 19:37:51.144901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.144753    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f790286-5663-4c8d-9469-4bc902bcf9d0" (UID: "6f790286-5663-4c8d-9469-4bc902bcf9d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:37:51.144963 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.144911    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f790286-5663-4c8d-9469-4bc902bcf9d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f790286-5663-4c8d-9469-4bc902bcf9d0" (UID: "6f790286-5663-4c8d-9469-4bc902bcf9d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:51.145198 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.145163    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:51.145427 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.145395    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:51.145427 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.145424    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:51.145570 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.145441    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:51.145570 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.145457    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f790286-5663-4c8d-9469-4bc902bcf9d0-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:51.146419 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.146388    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f790286-5663-4c8d-9469-4bc902bcf9d0" (UID: "6f790286-5663-4c8d-9469-4bc902bcf9d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:37:51.146519 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.146493    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-kube-api-access-rcxzr" (OuterVolumeSpecName: "kube-api-access-rcxzr") pod "6f790286-5663-4c8d-9469-4bc902bcf9d0" (UID: "6f790286-5663-4c8d-9469-4bc902bcf9d0"). InnerVolumeSpecName "kube-api-access-rcxzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:37:51.146800 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.146787    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f790286-5663-4c8d-9469-4bc902bcf9d0" (UID: "6f790286-5663-4c8d-9469-4bc902bcf9d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:37:51.147177 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.147163    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f790286-5663-4c8d-9469-4bc902bcf9d0" (UID: "6f790286-5663-4c8d-9469-4bc902bcf9d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:37:51.246577 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.246534    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcxzr\" (UniqueName: \"kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-kube-api-access-rcxzr\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:51.246577 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.246569    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:51.246577 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.246583    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:51.246810 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:51.246596    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f790286-5663-4c8d-9469-4bc902bcf9d0-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:37:52.034138 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:52.034107    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"
Sep 11 19:37:52.034138 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:52.034134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9" event={"ID":"6f790286-5663-4c8d-9469-4bc902bcf9d0","Type":"ContainerDied","Data":"bbe59246f8aae35eb316e45f1bc7168c573e007d9634df20ee28059f04f5175d"}
Sep 11 19:37:52.034633 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:52.034184    2580 scope.go:117] "RemoveContainer" containerID="0303c3194cafdee4ce92f69709158f17284b1e1f92c816e2b007bd2d15d1f55a"
Sep 11 19:37:52.056806 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:52.056780    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"]
Sep 11 19:37:52.060790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:52.060766    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-472add-openshift-default-5dc8d5bbc6-ncxl9"]
Sep 11 19:37:52.450802 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:37:52.450769    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" path="/var/lib/kubelet/pods/6f790286-5663-4c8d-9469-4bc902bcf9d0/volumes"
Sep 11 19:38:20.472793 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:20.472762    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:38:20.477732 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:20.477709    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:38:20.582164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:20.582131    2580 scope.go:117] "RemoveContainer" containerID="75b3866197f060237bb8e15cdc9b86bdba866c2dda420acdd22541434974c1c9"
Sep 11 19:38:20.591509 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:20.591488    2580 scope.go:117] "RemoveContainer" containerID="8788b3680e631bb1567da5a35a8e17881b00391e25fa1392a52a0ecaddc024c7"
Sep 11 19:38:42.705012 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.704975    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"]
Sep 11 19:38:42.705528 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.705509    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy"
Sep 11 19:38:42.705579 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.705531    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy"
Sep 11 19:38:42.705579 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.705545    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy"
Sep 11 19:38:42.705579 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.705550    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy"
Sep 11 19:38:42.705677 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.705632    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy"
Sep 11 19:38:42.710259 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.710239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.713513 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.713482    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-55586842\"/\"e2e-lifecycle-model-55586842-kserve-self-signed-certs\""
Sep 11 19:38:42.713644 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.713544    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-55586842\"/\"openshift-service-ca.crt\""
Sep 11 19:38:42.713644 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.713486    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-55586842\"/\"default-dockercfg-lfsxj\""
Sep 11 19:38:42.713644 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.713492    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-55586842\"/\"kube-root-ca.crt\""
Sep 11 19:38:42.721534 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.721508    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"]
Sep 11 19:38:42.862220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.862150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-home\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.862464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.862359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpd4m\" (UniqueName: \"kubernetes.io/projected/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-kube-api-access-dpd4m\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.862464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.862445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-model-cache\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.862577 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.862491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tmp-dir\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.862577 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.862528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-dshm\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.862577 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.862556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tls-certs\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.964270 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.964172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-model-cache\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.964270 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.964223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tmp-dir\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.964270 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.964257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-dshm\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.964576 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.964302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tls-certs\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.964576 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.964388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-home\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.964576 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.964469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpd4m\" (UniqueName: \"kubernetes.io/projected/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-kube-api-access-dpd4m\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.964737 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.964654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-model-cache\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.964737 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.964685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tmp-dir\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.964970 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.964943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-home\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.968171 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.968124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tls-certs\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.969603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.969572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-dshm\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:42.973223 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:42.973198    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpd4m\" (UniqueName: \"kubernetes.io/projected/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-kube-api-access-dpd4m\") pod \"e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") " pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:43.023107 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:43.023078    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:43.295202 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:43.295171    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"]
Sep 11 19:38:43.297903 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:38:43.297874    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ebf0f96_2d16_4c13_9ae3_75c5b79e665a.slice/crio-dd74047cbb82c622d7fcab86b44634097935967526b4b6195f436509187a2aaf WatchSource:0}: Error finding container dd74047cbb82c622d7fcab86b44634097935967526b4b6195f436509187a2aaf: Status 404 returned error can't find the container with id dd74047cbb82c622d7fcab86b44634097935967526b4b6195f436509187a2aaf
Sep 11 19:38:43.372344 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:43.372314    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n" event={"ID":"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a","Type":"ContainerStarted","Data":"9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246"}
Sep 11 19:38:43.372464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:43.372360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n" event={"ID":"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a","Type":"ContainerStarted","Data":"dd74047cbb82c622d7fcab86b44634097935967526b4b6195f436509187a2aaf"}
Sep 11 19:38:43.388774 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:43.388711    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n" podStartSLOduration=1.388688325 podStartE2EDuration="1.388688325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:38:43.387967629 +0000 UTC m=+1223.409175794" watchObservedRunningTime="2026-09-11 19:38:43.388688325 +0000 UTC m=+1223.409896477"
Sep 11 19:38:53.024327 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.024247    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:53.024915 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.024353    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:53.037054 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.037029    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:53.197732 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.197698    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"]
Sep 11 19:38:53.198261 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.198245    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f790286-5663-4c8d-9469-4bc902bcf9d0" containerName="istio-proxy"
Sep 11 19:38:53.201416 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.201397    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.203581 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.203555    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1fc808\"/\"distinct-2-w0-1fc808-kserve-self-signed-certs\""
Sep 11 19:38:53.212335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.212306    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"]
Sep 11 19:38:53.267971 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.267937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-tmp-dir\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.268143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.267978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnhgm\" (UniqueName: \"kubernetes.io/projected/f9b14de1-4170-47e5-9dfd-04b934de024f-kube-api-access-mnhgm\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.268143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.268011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9b14de1-4170-47e5-9dfd-04b934de024f-tls-certs\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.268143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.268070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-home\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.268143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.268097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-model-cache\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.268314 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.268237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-dshm\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.369931 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.369835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-tmp-dir\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.369931 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.369884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnhgm\" (UniqueName: \"kubernetes.io/projected/f9b14de1-4170-47e5-9dfd-04b934de024f-kube-api-access-mnhgm\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.369931 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.369913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9b14de1-4170-47e5-9dfd-04b934de024f-tls-certs\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.370230 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.369937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-home\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.370230 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.369953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-model-cache\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.370230 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.370035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-dshm\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.370417 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.370331    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-tmp-dir\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.370417 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.370369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-home\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.370490 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.370477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-model-cache\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.372242 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.372222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-dshm\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.372529 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.372511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9b14de1-4170-47e5-9dfd-04b934de024f-tls-certs\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.378357 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.378337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnhgm\" (UniqueName: \"kubernetes.io/projected/f9b14de1-4170-47e5-9dfd-04b934de024f-kube-api-access-mnhgm\") pod \"distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") " pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.452947 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.452911    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:38:53.514899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.514852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:38:53.793017 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:53.792988    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"]
Sep 11 19:38:53.795177 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:38:53.795145    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9b14de1_4170_47e5_9dfd_04b934de024f.slice/crio-1c84bcfd6e2d0cc501d1e84797f0d3307df99670daa702c29ad6077128e464d4 WatchSource:0}: Error finding container 1c84bcfd6e2d0cc501d1e84797f0d3307df99670daa702c29ad6077128e464d4: Status 404 returned error can't find the container with id 1c84bcfd6e2d0cc501d1e84797f0d3307df99670daa702c29ad6077128e464d4
Sep 11 19:38:54.449252 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:54.449215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc" event={"ID":"f9b14de1-4170-47e5-9dfd-04b934de024f","Type":"ContainerStarted","Data":"63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104"}
Sep 11 19:38:54.449252 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:54.449259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc" event={"ID":"f9b14de1-4170-47e5-9dfd-04b934de024f","Type":"ContainerStarted","Data":"1c84bcfd6e2d0cc501d1e84797f0d3307df99670daa702c29ad6077128e464d4"}
Sep 11 19:38:54.461646 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:54.461595    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc" podStartSLOduration=1.461578686 podStartE2EDuration="1.461578686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:38:54.459163179 +0000 UTC m=+1234.480371329" watchObservedRunningTime="2026-09-11 19:38:54.461578686 +0000 UTC m=+1234.482786836"
Sep 11 19:38:55.905150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:55.905088    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"]
Sep 11 19:38:55.905746 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:55.905418    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n" podUID="68e223d8-8c67-491f-bc14-70da75d87672" containerName="istio-proxy" containerID="cri-o://684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1" gracePeriod=30
Sep 11 19:38:56.380480 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:56.380430    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"]
Sep 11 19:38:56.384169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:56.384150    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"
Sep 11 19:38:56.386608 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:56.386545    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:38:56.387666 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:56.387642    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:38:56.391184 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:56.391163    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"]
Sep 11 19:38:56.504340 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:56.504308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8902ef0f-f611-43dd-9f0a-4a3642f2b365-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46\" (UID: \"8902ef0f-f611-43dd-9f0a-4a3642f2b365\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"
Sep 11 19:38:56.605054 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:56.605018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8902ef0f-f611-43dd-9f0a-4a3642f2b365-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46\" (UID: \"8902ef0f-f611-43dd-9f0a-4a3642f2b365\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"
Sep 11 19:38:56.605678 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:56.605652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8902ef0f-f611-43dd-9f0a-4a3642f2b365-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46\" (UID: \"8902ef0f-f611-43dd-9f0a-4a3642f2b365\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"
Sep 11 19:38:56.698825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:56.698792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"
Sep 11 19:38:56.973189 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:56.973159    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"]
Sep 11 19:38:56.973942 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:38:56.973920    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8902ef0f_f611_43dd_9f0a_4a3642f2b365.slice/crio-7fd3b74ea37ee399fff55483a565d1080067085d22b806351681354648f78937 WatchSource:0}: Error finding container 7fd3b74ea37ee399fff55483a565d1080067085d22b806351681354648f78937: Status 404 returned error can't find the container with id 7fd3b74ea37ee399fff55483a565d1080067085d22b806351681354648f78937
Sep 11 19:38:57.463514 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:57.463478    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46" event={"ID":"8902ef0f-f611-43dd-9f0a-4a3642f2b365","Type":"ContainerStarted","Data":"e3b28b1dc84d36073c21d0887db5e0493df4817cfaf26ebad7d6198137292d3d"}
Sep 11 19:38:57.463680 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:57.463531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46" event={"ID":"8902ef0f-f611-43dd-9f0a-4a3642f2b365","Type":"ContainerStarted","Data":"7fd3b74ea37ee399fff55483a565d1080067085d22b806351681354648f78937"}
Sep 11 19:38:57.478259 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:57.478200    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46" podStartSLOduration=1.47818318 podStartE2EDuration="1.47818318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:38:57.478090995 +0000 UTC m=+1237.499299145" watchObservedRunningTime="2026-09-11 19:38:57.47818318 +0000 UTC m=+1237.499391331"
Sep 11 19:38:58.470582 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:58.470543    2580 generic.go:356] "Generic (PLEG): container finished" podID="8902ef0f-f611-43dd-9f0a-4a3642f2b365" containerID="e3b28b1dc84d36073c21d0887db5e0493df4817cfaf26ebad7d6198137292d3d" exitCode=0
Sep 11 19:38:58.470956 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:58.470628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46" event={"ID":"8902ef0f-f611-43dd-9f0a-4a3642f2b365","Type":"ContainerDied","Data":"e3b28b1dc84d36073c21d0887db5e0493df4817cfaf26ebad7d6198137292d3d"}
Sep 11 19:38:58.688054 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:58.686768    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"]
Sep 11 19:38:59.625521 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:59.625490    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"
Sep 11 19:38:59.739715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:59.739640    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8902ef0f-f611-43dd-9f0a-4a3642f2b365-maas-api-service-ca\") pod \"8902ef0f-f611-43dd-9f0a-4a3642f2b365\" (UID: \"8902ef0f-f611-43dd-9f0a-4a3642f2b365\") "
Sep 11 19:38:59.740010 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:59.739985    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8902ef0f-f611-43dd-9f0a-4a3642f2b365-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8902ef0f-f611-43dd-9f0a-4a3642f2b365" (UID: "8902ef0f-f611-43dd-9f0a-4a3642f2b365"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:38:59.841503 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:38:59.841471    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8902ef0f-f611-43dd-9f0a-4a3642f2b365-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:00.485080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:00.485046    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"
Sep 11 19:39:00.485230 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:00.485076    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46" event={"ID":"8902ef0f-f611-43dd-9f0a-4a3642f2b365","Type":"ContainerDied","Data":"7fd3b74ea37ee399fff55483a565d1080067085d22b806351681354648f78937"}
Sep 11 19:39:00.485230 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:00.485132    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fd3b74ea37ee399fff55483a565d1080067085d22b806351681354648f78937"
Sep 11 19:39:01.184453 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.184426    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:39:01.254800 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.254768    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-socket\") pod \"68e223d8-8c67-491f-bc14-70da75d87672\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") "
Sep 11 19:39:01.254974 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.254822    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-certs\") pod \"68e223d8-8c67-491f-bc14-70da75d87672\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") "
Sep 11 19:39:01.254974 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.254845    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e223d8-8c67-491f-bc14-70da75d87672-istio-podinfo\") pod \"68e223d8-8c67-491f-bc14-70da75d87672\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") "
Sep 11 19:39:01.254974 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.254905    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-data\") pod \"68e223d8-8c67-491f-bc14-70da75d87672\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") "
Sep 11 19:39:01.254974 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.254921    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ddwk\" (UniqueName: \"kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-kube-api-access-6ddwk\") pod \"68e223d8-8c67-491f-bc14-70da75d87672\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") "
Sep 11 19:39:01.254974 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.254956    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-credential-socket\") pod \"68e223d8-8c67-491f-bc14-70da75d87672\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") "
Sep 11 19:39:01.255238 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.254991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-istio-token\") pod \"68e223d8-8c67-491f-bc14-70da75d87672\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") "
Sep 11 19:39:01.255238 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.255033    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-envoy\") pod \"68e223d8-8c67-491f-bc14-70da75d87672\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") "
Sep 11 19:39:01.255238 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.255067    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e223d8-8c67-491f-bc14-70da75d87672-istiod-ca-cert\") pod \"68e223d8-8c67-491f-bc14-70da75d87672\" (UID: \"68e223d8-8c67-491f-bc14-70da75d87672\") "
Sep 11 19:39:01.255427 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.255059    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68e223d8-8c67-491f-bc14-70da75d87672" (UID: "68e223d8-8c67-491f-bc14-70da75d87672"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:01.255427 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.255112    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68e223d8-8c67-491f-bc14-70da75d87672" (UID: "68e223d8-8c67-491f-bc14-70da75d87672"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:01.255427 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.255339    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-data" (OuterVolumeSpecName: "istio-data") pod "68e223d8-8c67-491f-bc14-70da75d87672" (UID: "68e223d8-8c67-491f-bc14-70da75d87672"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:01.255591 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.255493    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68e223d8-8c67-491f-bc14-70da75d87672-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68e223d8-8c67-491f-bc14-70da75d87672" (UID: "68e223d8-8c67-491f-bc14-70da75d87672"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:39:01.255650 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.255606    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68e223d8-8c67-491f-bc14-70da75d87672" (UID: "68e223d8-8c67-491f-bc14-70da75d87672"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:01.257790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.257763    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68e223d8-8c67-491f-bc14-70da75d87672" (UID: "68e223d8-8c67-491f-bc14-70da75d87672"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:01.257899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.257808    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-kube-api-access-6ddwk" (OuterVolumeSpecName: "kube-api-access-6ddwk") pod "68e223d8-8c67-491f-bc14-70da75d87672" (UID: "68e223d8-8c67-491f-bc14-70da75d87672"). InnerVolumeSpecName "kube-api-access-6ddwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:39:01.257899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.257833    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68e223d8-8c67-491f-bc14-70da75d87672-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68e223d8-8c67-491f-bc14-70da75d87672" (UID: "68e223d8-8c67-491f-bc14-70da75d87672"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:39:01.257899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.257858    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-istio-token" (OuterVolumeSpecName: "istio-token") pod "68e223d8-8c67-491f-bc14-70da75d87672" (UID: "68e223d8-8c67-491f-bc14-70da75d87672"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:39:01.356787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.356745    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:01.356787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.356778    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68e223d8-8c67-491f-bc14-70da75d87672-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:01.357008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.356797    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:01.357008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.356809    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:01.357008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.356820    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68e223d8-8c67-491f-bc14-70da75d87672-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:01.357008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.356829    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:01.357008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.356841    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ddwk\" (UniqueName: \"kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-kube-api-access-6ddwk\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:01.357008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.356853    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68e223d8-8c67-491f-bc14-70da75d87672-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:01.357008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.356864    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68e223d8-8c67-491f-bc14-70da75d87672-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:01.492603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.492510    2580 generic.go:356] "Generic (PLEG): container finished" podID="68e223d8-8c67-491f-bc14-70da75d87672" containerID="684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1" exitCode=0
Sep 11 19:39:01.492603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.492587    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"
Sep 11 19:39:01.492789 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.492598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n" event={"ID":"68e223d8-8c67-491f-bc14-70da75d87672","Type":"ContainerDied","Data":"684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1"}
Sep 11 19:39:01.492789 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.492656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n" event={"ID":"68e223d8-8c67-491f-bc14-70da75d87672","Type":"ContainerDied","Data":"4721cf089d2b15d6b1c0bff0127ab0e964f725059c701d588ac1a0270a81344b"}
Sep 11 19:39:01.492789 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.492678    2580 scope.go:117] "RemoveContainer" containerID="684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1"
Sep 11 19:39:01.502937 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.502919    2580 scope.go:117] "RemoveContainer" containerID="684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1"
Sep 11 19:39:01.503221 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:39:01.503202    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1\": container with ID starting with 684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1 not found: ID does not exist" containerID="684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1"
Sep 11 19:39:01.503267 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.503230    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1"} err="failed to get container status \"684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1\": rpc error: code = NotFound desc = could not find container \"684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1\": container with ID starting with 684fc3c5448f84c0d1c460ce9063de093ffb14d5068419ca690abc2e725426f1 not found: ID does not exist"
Sep 11 19:39:01.514326 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.514272    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"]
Sep 11 19:39:01.517248 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:01.517224    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-967296-openshift-default-6ffc69d94-zbt4n"]
Sep 11 19:39:02.449947 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:02.449901    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68e223d8-8c67-491f-bc14-70da75d87672" path="/var/lib/kubelet/pods/68e223d8-8c67-491f-bc14-70da75d87672/volumes"
Sep 11 19:39:03.515931 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:03.515900    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:39:03.516331 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:03.515948    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:39:03.528790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:03.528764    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:39:04.524589 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:04.524559    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:39:07.052164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:07.052131    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"]
Sep 11 19:39:07.056674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:07.056645    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0610b-7vm46"]
Sep 11 19:39:08.449653 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:08.449623    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8902ef0f-f611-43dd-9f0a-4a3642f2b365" path="/var/lib/kubelet/pods/8902ef0f-f611-43dd-9f0a-4a3642f2b365/volumes"
Sep 11 19:39:13.346860 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.346770    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"]
Sep 11 19:39:13.347242 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.346971    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy" containerID="cri-o://cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e" gracePeriod=30
Sep 11 19:39:13.710896 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.710845    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr" podUID="a9950dba-e999-4d68-9c5b-01e6a491ed6f" containerName="main" containerID="cri-o://45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b" gracePeriod=45
Sep 11 19:39:13.730849 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.730821    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"]
Sep 11 19:39:13.731258 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.731240    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8902ef0f-f611-43dd-9f0a-4a3642f2b365" containerName="revoke-keys"
Sep 11 19:39:13.731311 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.731258    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8902ef0f-f611-43dd-9f0a-4a3642f2b365" containerName="revoke-keys"
Sep 11 19:39:13.731311 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.731269    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68e223d8-8c67-491f-bc14-70da75d87672" containerName="istio-proxy"
Sep 11 19:39:13.731311 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.731274    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68e223d8-8c67-491f-bc14-70da75d87672" containerName="istio-proxy"
Sep 11 19:39:13.731410 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.731382    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8902ef0f-f611-43dd-9f0a-4a3642f2b365" containerName="revoke-keys"
Sep 11 19:39:13.731410 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.731394    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68e223d8-8c67-491f-bc14-70da75d87672" containerName="istio-proxy"
Sep 11 19:39:13.734462 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.734444    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"
Sep 11 19:39:13.736606 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.736582    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:39:13.736695 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.736645    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:39:13.742544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.742523    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"]
Sep 11 19:39:13.889951 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.889914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/821a9389-d83c-466e-9d33-f2f9ba69400b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x\" (UID: \"821a9389-d83c-466e-9d33-f2f9ba69400b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"
Sep 11 19:39:13.976807 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.976753    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:39:13.991029 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.991001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/821a9389-d83c-466e-9d33-f2f9ba69400b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x\" (UID: \"821a9389-d83c-466e-9d33-f2f9ba69400b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"
Sep 11 19:39:13.991669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:13.991617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/821a9389-d83c-466e-9d33-f2f9ba69400b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x\" (UID: \"821a9389-d83c-466e-9d33-f2f9ba69400b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"
Sep 11 19:39:14.091656 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.091619    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-home\") pod \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") "
Sep 11 19:39:14.091656 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.091659    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tmp-dir\") pod \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") "
Sep 11 19:39:14.091871 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.091691    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-dshm\") pod \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") "
Sep 11 19:39:14.091871 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.091732    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tls-certs\") pod \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") "
Sep 11 19:39:14.091871 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.091754    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-model-cache\") pod \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") "
Sep 11 19:39:14.091871 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.091853    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85txz\" (UniqueName: \"kubernetes.io/projected/a9950dba-e999-4d68-9c5b-01e6a491ed6f-kube-api-access-85txz\") pod \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\" (UID: \"a9950dba-e999-4d68-9c5b-01e6a491ed6f\") "
Sep 11 19:39:14.092095 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.091891    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a9950dba-e999-4d68-9c5b-01e6a491ed6f" (UID: "a9950dba-e999-4d68-9c5b-01e6a491ed6f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:14.092095 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.091956    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-home" (OuterVolumeSpecName: "home") pod "a9950dba-e999-4d68-9c5b-01e6a491ed6f" (UID: "a9950dba-e999-4d68-9c5b-01e6a491ed6f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:14.092187 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.092089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-model-cache" (OuterVolumeSpecName: "model-cache") pod "a9950dba-e999-4d68-9c5b-01e6a491ed6f" (UID: "a9950dba-e999-4d68-9c5b-01e6a491ed6f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:14.092247 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.092226    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-home\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:14.092321 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.092250    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tmp-dir\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:14.092321 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.092262    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-model-cache\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:14.094041 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.094009    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-dshm" (OuterVolumeSpecName: "dshm") pod "a9950dba-e999-4d68-9c5b-01e6a491ed6f" (UID: "a9950dba-e999-4d68-9c5b-01e6a491ed6f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:14.094150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.094100    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a9950dba-e999-4d68-9c5b-01e6a491ed6f" (UID: "a9950dba-e999-4d68-9c5b-01e6a491ed6f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:39:14.094150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.094094    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9950dba-e999-4d68-9c5b-01e6a491ed6f-kube-api-access-85txz" (OuterVolumeSpecName: "kube-api-access-85txz") pod "a9950dba-e999-4d68-9c5b-01e6a491ed6f" (UID: "a9950dba-e999-4d68-9c5b-01e6a491ed6f"). InnerVolumeSpecName "kube-api-access-85txz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:39:14.099184 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.099166    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"
Sep 11 19:39:14.192990 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.192957    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9950dba-e999-4d68-9c5b-01e6a491ed6f-dshm\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:14.192990 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.192987    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9950dba-e999-4d68-9c5b-01e6a491ed6f-tls-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:14.193171 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.192998    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85txz\" (UniqueName: \"kubernetes.io/projected/a9950dba-e999-4d68-9c5b-01e6a491ed6f-kube-api-access-85txz\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:14.375347 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.375316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"]
Sep 11 19:39:14.376221 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:39:14.376193    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821a9389_d83c_466e_9d33_f2f9ba69400b.slice/crio-31678a1f22b66848cefd8fdbd00ceb65a6806ac23e00e13c6aece513d212277c WatchSource:0}: Error finding container 31678a1f22b66848cefd8fdbd00ceb65a6806ac23e00e13c6aece513d212277c: Status 404 returned error can't find the container with id 31678a1f22b66848cefd8fdbd00ceb65a6806ac23e00e13c6aece513d212277c
Sep 11 19:39:14.576722 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.576683    2580 generic.go:356] "Generic (PLEG): container finished" podID="a9950dba-e999-4d68-9c5b-01e6a491ed6f" containerID="45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b" exitCode=0
Sep 11 19:39:14.576909 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.576732    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"
Sep 11 19:39:14.576909 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.576768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr" event={"ID":"a9950dba-e999-4d68-9c5b-01e6a491ed6f","Type":"ContainerDied","Data":"45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b"}
Sep 11 19:39:14.576909 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.576817    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr" event={"ID":"a9950dba-e999-4d68-9c5b-01e6a491ed6f","Type":"ContainerDied","Data":"6afad176857cbc7b873512bc15e59ed54ffbb4213698f1949cbaa0b6efa58364"}
Sep 11 19:39:14.576909 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.576835    2580 scope.go:117] "RemoveContainer" containerID="45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b"
Sep 11 19:39:14.578568 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.578543    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x" event={"ID":"821a9389-d83c-466e-9d33-f2f9ba69400b","Type":"ContainerStarted","Data":"31678a1f22b66848cefd8fdbd00ceb65a6806ac23e00e13c6aece513d212277c"}
Sep 11 19:39:14.586578 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.586525    2580 scope.go:117] "RemoveContainer" containerID="45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b"
Sep 11 19:39:14.586859 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:39:14.586840    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b\": container with ID starting with 45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b not found: ID does not exist" containerID="45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b"
Sep 11 19:39:14.586920 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.586868    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b"} err="failed to get container status \"45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b\": rpc error: code = NotFound desc = could not find container \"45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b\": container with ID starting with 45c47e25289c2e1369a69ecc95dac1cd377f0fced8df24fd8b7c586c32d7087b not found: ID does not exist"
Sep 11 19:39:14.593113 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.593089    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"]
Sep 11 19:39:14.599843 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:14.599817    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-515a4f/test-model-515a4f-kserve-977556f7c-msjwr"]
Sep 11 19:39:15.596704 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:15.596668    2580 generic.go:356] "Generic (PLEG): container finished" podID="821a9389-d83c-466e-9d33-f2f9ba69400b" containerID="2b88863274194ea332043372e3d83227d0c801a4bbd859d0863c2a522cee3492" exitCode=0
Sep 11 19:39:15.597131 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:15.596759    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x" event={"ID":"821a9389-d83c-466e-9d33-f2f9ba69400b","Type":"ContainerDied","Data":"2b88863274194ea332043372e3d83227d0c801a4bbd859d0863c2a522cee3492"}
Sep 11 19:39:16.449775 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:16.449738    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9950dba-e999-4d68-9c5b-01e6a491ed6f" path="/var/lib/kubelet/pods/a9950dba-e999-4d68-9c5b-01e6a491ed6f/volumes"
Sep 11 19:39:16.733028 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:16.733000    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"
Sep 11 19:39:16.923210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:16.923177    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/821a9389-d83c-466e-9d33-f2f9ba69400b-maas-api-service-ca\") pod \"821a9389-d83c-466e-9d33-f2f9ba69400b\" (UID: \"821a9389-d83c-466e-9d33-f2f9ba69400b\") "
Sep 11 19:39:16.923563 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:16.923537    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/821a9389-d83c-466e-9d33-f2f9ba69400b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "821a9389-d83c-466e-9d33-f2f9ba69400b" (UID: "821a9389-d83c-466e-9d33-f2f9ba69400b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:39:17.024152 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:17.024066    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/821a9389-d83c-466e-9d33-f2f9ba69400b-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:17.611316 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:17.611264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x" event={"ID":"821a9389-d83c-466e-9d33-f2f9ba69400b","Type":"ContainerDied","Data":"31678a1f22b66848cefd8fdbd00ceb65a6806ac23e00e13c6aece513d212277c"}
Sep 11 19:39:17.611572 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:17.611551    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31678a1f22b66848cefd8fdbd00ceb65a6806ac23e00e13c6aece513d212277c"
Sep 11 19:39:17.611755 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:17.611733    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"
Sep 11 19:39:18.608899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.608839    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:39:18.618448 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.618420    2580 generic.go:356] "Generic (PLEG): container finished" podID="e84b3895-dc08-4831-923b-9000c7935d7a" containerID="cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e" exitCode=0
Sep 11 19:39:18.618597 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.618464    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"
Sep 11 19:39:18.618597 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.618509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" event={"ID":"e84b3895-dc08-4831-923b-9000c7935d7a","Type":"ContainerDied","Data":"cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e"}
Sep 11 19:39:18.618597 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.618558    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6" event={"ID":"e84b3895-dc08-4831-923b-9000c7935d7a","Type":"ContainerDied","Data":"ed7ae93da49cad27c93ee6eb7f1ea661b8b3893855495b331659112fcb186bb0"}
Sep 11 19:39:18.618597 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.618585    2580 scope.go:117] "RemoveContainer" containerID="cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e"
Sep 11 19:39:18.628499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.628475    2580 scope.go:117] "RemoveContainer" containerID="9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed"
Sep 11 19:39:18.638394 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.638372    2580 scope.go:117] "RemoveContainer" containerID="cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e"
Sep 11 19:39:18.638710 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:39:18.638685    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e\": container with ID starting with cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e not found: ID does not exist" containerID="cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e"
Sep 11 19:39:18.638811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.638722    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e"} err="failed to get container status \"cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e\": rpc error: code = NotFound desc = could not find container \"cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e\": container with ID starting with cfdd1a9446d71f4ffe7d52542f12f518bf4749080b5b7fd777495c9f468f5d3e not found: ID does not exist"
Sep 11 19:39:18.638811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.638746    2580 scope.go:117] "RemoveContainer" containerID="9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed"
Sep 11 19:39:18.639048 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:39:18.639031    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed\": container with ID starting with 9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed not found: ID does not exist" containerID="9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed"
Sep 11 19:39:18.639102 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.639055    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed"} err="failed to get container status \"9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed\": rpc error: code = NotFound desc = could not find container \"9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed\": container with ID starting with 9a2355a423b20e066be430d60e7fa7eadd0d723f7b4c9a6aa656b885a47f1bed not found: ID does not exist"
Sep 11 19:39:18.739251 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739197    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-credential-socket\") pod \"e84b3895-dc08-4831-923b-9000c7935d7a\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") "
Sep 11 19:39:18.739251 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739249    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e84b3895-dc08-4831-923b-9000c7935d7a-istio-podinfo\") pod \"e84b3895-dc08-4831-923b-9000c7935d7a\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") "
Sep 11 19:39:18.739251 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739272    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-certs\") pod \"e84b3895-dc08-4831-923b-9000c7935d7a\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") "
Sep 11 19:39:18.739598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739346    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-data\") pod \"e84b3895-dc08-4831-923b-9000c7935d7a\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") "
Sep 11 19:39:18.739598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739384    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e84b3895-dc08-4831-923b-9000c7935d7a-istiod-ca-cert\") pod \"e84b3895-dc08-4831-923b-9000c7935d7a\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") "
Sep 11 19:39:18.739598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739469    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttws9\" (UniqueName: \"kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-kube-api-access-ttws9\") pod \"e84b3895-dc08-4831-923b-9000c7935d7a\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") "
Sep 11 19:39:18.739598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739499    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-envoy\") pod \"e84b3895-dc08-4831-923b-9000c7935d7a\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") "
Sep 11 19:39:18.739598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739536    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-istio-token\") pod \"e84b3895-dc08-4831-923b-9000c7935d7a\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") "
Sep 11 19:39:18.739598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739550    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e84b3895-dc08-4831-923b-9000c7935d7a" (UID: "e84b3895-dc08-4831-923b-9000c7935d7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:18.739598 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739585    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-socket\") pod \"e84b3895-dc08-4831-923b-9000c7935d7a\" (UID: \"e84b3895-dc08-4831-923b-9000c7935d7a\") "
Sep 11 19:39:18.739950 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739795    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-data" (OuterVolumeSpecName: "istio-data") pod "e84b3895-dc08-4831-923b-9000c7935d7a" (UID: "e84b3895-dc08-4831-923b-9000c7935d7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:18.739950 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739898    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e84b3895-dc08-4831-923b-9000c7935d7a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e84b3895-dc08-4831-923b-9000c7935d7a" (UID: "e84b3895-dc08-4831-923b-9000c7935d7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:39:18.740080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739959    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e84b3895-dc08-4831-923b-9000c7935d7a" (UID: "e84b3895-dc08-4831-923b-9000c7935d7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:18.740080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.739991    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e84b3895-dc08-4831-923b-9000c7935d7a" (UID: "e84b3895-dc08-4831-923b-9000c7935d7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:18.740080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.740006    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:18.740080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.740023    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:18.740080 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.740035    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e84b3895-dc08-4831-923b-9000c7935d7a-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:18.741657 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.741637    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e84b3895-dc08-4831-923b-9000c7935d7a" (UID: "e84b3895-dc08-4831-923b-9000c7935d7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:18.741859 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.741841    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-kube-api-access-ttws9" (OuterVolumeSpecName: "kube-api-access-ttws9") pod "e84b3895-dc08-4831-923b-9000c7935d7a" (UID: "e84b3895-dc08-4831-923b-9000c7935d7a"). InnerVolumeSpecName "kube-api-access-ttws9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:39:18.742108 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.742085    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e84b3895-dc08-4831-923b-9000c7935d7a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e84b3895-dc08-4831-923b-9000c7935d7a" (UID: "e84b3895-dc08-4831-923b-9000c7935d7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:39:18.742108 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.742095    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-istio-token" (OuterVolumeSpecName: "istio-token") pod "e84b3895-dc08-4831-923b-9000c7935d7a" (UID: "e84b3895-dc08-4831-923b-9000c7935d7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:39:18.841110 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.841068    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttws9\" (UniqueName: \"kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-kube-api-access-ttws9\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:18.841110 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.841103    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:18.841110 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.841113    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e84b3895-dc08-4831-923b-9000c7935d7a-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:18.841110 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.841121    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:18.841408 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.841129    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e84b3895-dc08-4831-923b-9000c7935d7a-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:18.841408 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.841137    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e84b3895-dc08-4831-923b-9000c7935d7a-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:18.941984 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.941867    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"]
Sep 11 19:39:18.945087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:18.945064    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a0610b-openshift-default-56b66c948b-ftqz6"]
Sep 11 19:39:20.456069 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:20.456034    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" path="/var/lib/kubelet/pods/e84b3895-dc08-4831-923b-9000c7935d7a/volumes"
Sep 11 19:39:20.624825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:20.624788    2580 scope.go:117] "RemoveContainer" containerID="cc73a2af319b0bd39aba2af60e71a1d4138897f180107c4863ed2889279fbff8"
Sep 11 19:39:20.633767 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:20.633747    2580 scope.go:117] "RemoveContainer" containerID="956597142b19f7d740ed0059521de33f4702cfdbd00b5a24687d08e1fa36cc45"
Sep 11 19:39:24.248477 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.248442    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"]
Sep 11 19:39:24.249048 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.248692    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg" podUID="de8a409d-b983-4d80-9b23-16b4128daf6b" containerName="payload-pre-processing" containerID="cri-o://fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312" gracePeriod=30
Sep 11 19:39:24.424733 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.424687    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"]
Sep 11 19:39:24.427232 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.427204    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-515a4f-lvg8x"]
Sep 11 19:39:24.452720 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.452683    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="821a9389-d83c-466e-9d33-f2f9ba69400b" path="/var/lib/kubelet/pods/821a9389-d83c-466e-9d33-f2f9ba69400b/volumes"
Sep 11 19:39:24.518145 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.518120    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:39:24.595244 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.595205    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn8lh\" (UniqueName: \"kubernetes.io/projected/de8a409d-b983-4d80-9b23-16b4128daf6b-kube-api-access-xn8lh\") pod \"de8a409d-b983-4d80-9b23-16b4128daf6b\" (UID: \"de8a409d-b983-4d80-9b23-16b4128daf6b\") "
Sep 11 19:39:24.595452 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.595254    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8a409d-b983-4d80-9b23-16b4128daf6b-plugins-config-volume\") pod \"de8a409d-b983-4d80-9b23-16b4128daf6b\" (UID: \"de8a409d-b983-4d80-9b23-16b4128daf6b\") "
Sep 11 19:39:24.595681 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.595651    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de8a409d-b983-4d80-9b23-16b4128daf6b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de8a409d-b983-4d80-9b23-16b4128daf6b" (UID: "de8a409d-b983-4d80-9b23-16b4128daf6b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:39:24.597356 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.597337    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de8a409d-b983-4d80-9b23-16b4128daf6b-kube-api-access-xn8lh" (OuterVolumeSpecName: "kube-api-access-xn8lh") pod "de8a409d-b983-4d80-9b23-16b4128daf6b" (UID: "de8a409d-b983-4d80-9b23-16b4128daf6b"). InnerVolumeSpecName "kube-api-access-xn8lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:39:24.659866 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.659831    2580 generic.go:356] "Generic (PLEG): container finished" podID="de8a409d-b983-4d80-9b23-16b4128daf6b" containerID="fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312" exitCode=0
Sep 11 19:39:24.660058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.659884    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"
Sep 11 19:39:24.660058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.659913    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg" event={"ID":"de8a409d-b983-4d80-9b23-16b4128daf6b","Type":"ContainerDied","Data":"fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312"}
Sep 11 19:39:24.660058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.659964    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg" event={"ID":"de8a409d-b983-4d80-9b23-16b4128daf6b","Type":"ContainerDied","Data":"82a0ada02c35bd0ed75b9514ae247eacb472d7463a4ef9cc34e0dbb81756fd22"}
Sep 11 19:39:24.660058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.659988    2580 scope.go:117] "RemoveContainer" containerID="fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312"
Sep 11 19:39:24.669467 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.669448    2580 scope.go:117] "RemoveContainer" containerID="fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312"
Sep 11 19:39:24.669719 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:39:24.669701    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312\": container with ID starting with fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312 not found: ID does not exist" containerID="fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312"
Sep 11 19:39:24.669765 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.669727    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312"} err="failed to get container status \"fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312\": rpc error: code = NotFound desc = could not find container \"fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312\": container with ID starting with fe9df16f1e7afab9097381e1eec3fa04a6e42fb03d0a6689f344b85ba3af5312 not found: ID does not exist"
Sep 11 19:39:24.681429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.681402    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"]
Sep 11 19:39:24.685038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.685017    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-515a4f-c48c4c89d-7xlhg"]
Sep 11 19:39:24.696642 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.696621    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn8lh\" (UniqueName: \"kubernetes.io/projected/de8a409d-b983-4d80-9b23-16b4128daf6b-kube-api-access-xn8lh\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:24.696642 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:24.696641    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8a409d-b983-4d80-9b23-16b4128daf6b-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:26.452720 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:26.452676    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de8a409d-b983-4d80-9b23-16b4128daf6b" path="/var/lib/kubelet/pods/de8a409d-b983-4d80-9b23-16b4128daf6b/volumes"
Sep 11 19:39:38.747893 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.747859    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"]
Sep 11 19:39:38.749392 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.749364    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy"
Sep 11 19:39:38.749550 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.749539    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy"
Sep 11 19:39:38.749663 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.749652    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821a9389-d83c-466e-9d33-f2f9ba69400b" containerName="revoke-keys"
Sep 11 19:39:38.749733 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.749725    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="821a9389-d83c-466e-9d33-f2f9ba69400b" containerName="revoke-keys"
Sep 11 19:39:38.749827 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.749818    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de8a409d-b983-4d80-9b23-16b4128daf6b" containerName="payload-pre-processing"
Sep 11 19:39:38.749891 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.749883    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8a409d-b983-4d80-9b23-16b4128daf6b" containerName="payload-pre-processing"
Sep 11 19:39:38.749994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.749985    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9950dba-e999-4d68-9c5b-01e6a491ed6f" containerName="main"
Sep 11 19:39:38.750060 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.750052    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9950dba-e999-4d68-9c5b-01e6a491ed6f" containerName="main"
Sep 11 19:39:38.750354 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.750336    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy"
Sep 11 19:39:38.750485 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.750475    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="de8a409d-b983-4d80-9b23-16b4128daf6b" containerName="payload-pre-processing"
Sep 11 19:39:38.750562 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.750553    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="821a9389-d83c-466e-9d33-f2f9ba69400b" containerName="revoke-keys"
Sep 11 19:39:38.750638 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.750630    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9950dba-e999-4d68-9c5b-01e6a491ed6f" containerName="main"
Sep 11 19:39:38.756139 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.756117    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:39:38.758968 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.758933    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-19859a-dockercfg-4ncfh\""
Sep 11 19:39:38.759085 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.758970    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-19859a\""
Sep 11 19:39:38.765212 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.765188    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"]
Sep 11 19:39:38.855824 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.855790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9aded2c5-134b-4709-8fad-dc5fc4538fa9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7\" (UID: \"9aded2c5-134b-4709-8fad-dc5fc4538fa9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:39:38.855997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.855902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwglj\" (UniqueName: \"kubernetes.io/projected/9aded2c5-134b-4709-8fad-dc5fc4538fa9-kube-api-access-fwglj\") pod \"payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7\" (UID: \"9aded2c5-134b-4709-8fad-dc5fc4538fa9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:39:38.957045 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.957005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9aded2c5-134b-4709-8fad-dc5fc4538fa9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7\" (UID: \"9aded2c5-134b-4709-8fad-dc5fc4538fa9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:39:38.957221 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.957180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwglj\" (UniqueName: \"kubernetes.io/projected/9aded2c5-134b-4709-8fad-dc5fc4538fa9-kube-api-access-fwglj\") pod \"payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7\" (UID: \"9aded2c5-134b-4709-8fad-dc5fc4538fa9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:39:38.957798 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.957777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9aded2c5-134b-4709-8fad-dc5fc4538fa9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7\" (UID: \"9aded2c5-134b-4709-8fad-dc5fc4538fa9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:39:38.965193 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:38.965171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwglj\" (UniqueName: \"kubernetes.io/projected/9aded2c5-134b-4709-8fad-dc5fc4538fa9-kube-api-access-fwglj\") pod \"payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7\" (UID: \"9aded2c5-134b-4709-8fad-dc5fc4538fa9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:39:39.068586 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:39.068498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:39:39.342226 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:39.342192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"]
Sep 11 19:39:39.343157 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:39:39.343130    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aded2c5_134b_4709_8fad_dc5fc4538fa9.slice/crio-4854852ba5aede5ddd68194ea6b5509734b8769561b3980dc42eba1f467e8ced WatchSource:0}: Error finding container 4854852ba5aede5ddd68194ea6b5509734b8769561b3980dc42eba1f467e8ced: Status 404 returned error can't find the container with id 4854852ba5aede5ddd68194ea6b5509734b8769561b3980dc42eba1f467e8ced
Sep 11 19:39:39.752220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:39.752172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7" event={"ID":"9aded2c5-134b-4709-8fad-dc5fc4538fa9","Type":"ContainerStarted","Data":"6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9"}
Sep 11 19:39:39.752679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:39.752276    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:39:39.752679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:39.752320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7" event={"ID":"9aded2c5-134b-4709-8fad-dc5fc4538fa9","Type":"ContainerStarted","Data":"4854852ba5aede5ddd68194ea6b5509734b8769561b3980dc42eba1f467e8ced"}
Sep 11 19:39:39.767006 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:39.766937    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7" podStartSLOduration=1.766923765 podStartE2EDuration="1.766923765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:39:39.766659165 +0000 UTC m=+1279.787867326" watchObservedRunningTime="2026-09-11 19:39:39.766923765 +0000 UTC m=+1279.788131914"
Sep 11 19:39:40.103515 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.103430    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"]
Sep 11 19:39:40.103848 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.103835    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy"
Sep 11 19:39:40.103892 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.103849    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy"
Sep 11 19:39:40.103939 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.103930    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e84b3895-dc08-4831-923b-9000c7935d7a" containerName="istio-proxy"
Sep 11 19:39:40.107121 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.107099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"
Sep 11 19:39:40.109334 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.109313    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:39:40.109459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.109364    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:39:40.113674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.113653    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"]
Sep 11 19:39:40.169592 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.169552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cdc26dc-6123-4d29-b795-f748222b618c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-55586842-qwlbk\" (UID: \"5cdc26dc-6123-4d29-b795-f748222b618c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"
Sep 11 19:39:40.271098 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.271061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cdc26dc-6123-4d29-b795-f748222b618c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-55586842-qwlbk\" (UID: \"5cdc26dc-6123-4d29-b795-f748222b618c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"
Sep 11 19:39:40.271711 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.271688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cdc26dc-6123-4d29-b795-f748222b618c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-55586842-qwlbk\" (UID: \"5cdc26dc-6123-4d29-b795-f748222b618c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"
Sep 11 19:39:40.418835 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.418750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"
Sep 11 19:39:40.692023 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.691905    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"]
Sep 11 19:39:40.696267 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:39:40.696240    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cdc26dc_6123_4d29_b795_f748222b618c.slice/crio-8fd0382fe1088295ba4e9f49a364ecd52e796d6e68739499804f2c3dc8fc5a06 WatchSource:0}: Error finding container 8fd0382fe1088295ba4e9f49a364ecd52e796d6e68739499804f2c3dc8fc5a06: Status 404 returned error can't find the container with id 8fd0382fe1088295ba4e9f49a364ecd52e796d6e68739499804f2c3dc8fc5a06
Sep 11 19:39:40.759666 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:40.759635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk" event={"ID":"5cdc26dc-6123-4d29-b795-f748222b618c","Type":"ContainerStarted","Data":"8fd0382fe1088295ba4e9f49a364ecd52e796d6e68739499804f2c3dc8fc5a06"}
Sep 11 19:39:41.767629 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:41.767590    2580 generic.go:356] "Generic (PLEG): container finished" podID="5cdc26dc-6123-4d29-b795-f748222b618c" containerID="3e0187917b9a07c925f2a8267602d03ceb1b02587d1796e0f5bd5cde696b13a6" exitCode=0
Sep 11 19:39:41.768011 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:41.767657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk" event={"ID":"5cdc26dc-6123-4d29-b795-f748222b618c","Type":"ContainerDied","Data":"3e0187917b9a07c925f2a8267602d03ceb1b02587d1796e0f5bd5cde696b13a6"}
Sep 11 19:39:42.907679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:42.907650    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"
Sep 11 19:39:43.001492 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:43.001458    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cdc26dc-6123-4d29-b795-f748222b618c-maas-api-service-ca\") pod \"5cdc26dc-6123-4d29-b795-f748222b618c\" (UID: \"5cdc26dc-6123-4d29-b795-f748222b618c\") "
Sep 11 19:39:43.001841 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:43.001814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cdc26dc-6123-4d29-b795-f748222b618c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5cdc26dc-6123-4d29-b795-f748222b618c" (UID: "5cdc26dc-6123-4d29-b795-f748222b618c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:39:43.103321 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:43.103200    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cdc26dc-6123-4d29-b795-f748222b618c-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:39:43.782848 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:43.782818    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"
Sep 11 19:39:43.783051 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:43.782853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk" event={"ID":"5cdc26dc-6123-4d29-b795-f748222b618c","Type":"ContainerDied","Data":"8fd0382fe1088295ba4e9f49a364ecd52e796d6e68739499804f2c3dc8fc5a06"}
Sep 11 19:39:43.783051 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:43.782898    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fd0382fe1088295ba4e9f49a364ecd52e796d6e68739499804f2c3dc8fc5a06"
Sep 11 19:39:50.761604 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:50.761571    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:39:55.907187 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:55.907140    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"]
Sep 11 19:39:55.909955 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:55.909925    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-55586842-qwlbk"]
Sep 11 19:39:56.450113 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:39:56.450080    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cdc26dc-6123-4d29-b795-f748222b618c" path="/var/lib/kubelet/pods/5cdc26dc-6123-4d29-b795-f748222b618c/volumes"
Sep 11 19:40:03.955343 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:03.955303    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"]
Sep 11 19:40:10.142014 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.141979    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"]
Sep 11 19:40:10.142456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.142440    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdc26dc-6123-4d29-b795-f748222b618c" containerName="revoke-keys"
Sep 11 19:40:10.142456 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.142455    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdc26dc-6123-4d29-b795-f748222b618c" containerName="revoke-keys"
Sep 11 19:40:10.142555 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.142523    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cdc26dc-6123-4d29-b795-f748222b618c" containerName="revoke-keys"
Sep 11 19:40:10.145857 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.145833    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.148143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.148112    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-abcdff-openshift-default-dockercfg-6fqzf\""
Sep 11 19:40:10.158805 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.158779    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"]
Sep 11 19:40:10.257661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.257621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-credential-socket\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.257661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.257670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-token\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.257908 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.257771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-data\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.257965 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.257942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-certs\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.258061 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.258041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-envoy\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.258173 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.258102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-socket\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.258339 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.258186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istiod-ca-cert\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.258339 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.258231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2ck7\" (UniqueName: \"kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-kube-api-access-z2ck7\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.258339 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.258257    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-podinfo\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.359676 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.359637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-envoy\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.359676 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.359680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-socket\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.359964 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.359703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istiod-ca-cert\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.359964 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.359731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2ck7\" (UniqueName: \"kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-kube-api-access-z2ck7\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.359964 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.359751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-podinfo\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.359964 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.359795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-credential-socket\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.359964 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.359815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-token\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.359964 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.359843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-data\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.359964 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.359929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-certs\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.360352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.360325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-credential-socket\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.360352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.360343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-certs\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.360453 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.360407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-data\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.360499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.360469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-socket\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.360584 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.360566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istiod-ca-cert\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.362060 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.362035    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-envoy\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.362463 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.362444    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-podinfo\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.367767 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.367741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-token\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.367917 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.367895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2ck7\" (UniqueName: \"kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-kube-api-access-z2ck7\") pod \"e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") " pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.457600 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.457563    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:10.734470 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.734434    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"]
Sep 11 19:40:10.734845 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:40:10.734820    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2f287a_3576_43d2_93b6_a17eff72d6e1.slice/crio-746d593f8691fd14a0d7c1210348933eece6dbaafed7109c71783fbb16967af4 WatchSource:0}: Error finding container 746d593f8691fd14a0d7c1210348933eece6dbaafed7109c71783fbb16967af4: Status 404 returned error can't find the container with id 746d593f8691fd14a0d7c1210348933eece6dbaafed7109c71783fbb16967af4
Sep 11 19:40:10.737430 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.737385    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:40:10.737514 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.737482    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:40:10.737554 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.737529    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:40:10.953415 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.953368    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" event={"ID":"7f2f287a-3576-43d2-93b6-a17eff72d6e1","Type":"ContainerStarted","Data":"0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5"}
Sep 11 19:40:10.953613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.953432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" event={"ID":"7f2f287a-3576-43d2-93b6-a17eff72d6e1","Type":"ContainerStarted","Data":"746d593f8691fd14a0d7c1210348933eece6dbaafed7109c71783fbb16967af4"}
Sep 11 19:40:10.972885 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:10.972829    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" podStartSLOduration=0.972808595 podStartE2EDuration="972.808595ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:40:10.970527188 +0000 UTC m=+1310.991735348" watchObservedRunningTime="2026-09-11 19:40:10.972808595 +0000 UTC m=+1310.994016745"
Sep 11 19:40:11.458610 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:11.458568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:11.464010 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:11.463982    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:11.959570 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:11.959544    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:11.960586 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:11.960562    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:18.974919 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:18.974874    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n" podUID="2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" containerName="main" containerID="cri-o://9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246" gracePeriod=45
Sep 11 19:40:19.235191 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.235123    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:40:19.353975 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.353938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-model-cache\") pod \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") "
Sep 11 19:40:19.354164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.353997    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpd4m\" (UniqueName: \"kubernetes.io/projected/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-kube-api-access-dpd4m\") pod \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") "
Sep 11 19:40:19.354164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.354058    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tls-certs\") pod \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") "
Sep 11 19:40:19.354164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.354086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-dshm\") pod \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") "
Sep 11 19:40:19.354164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.354162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-home\") pod \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") "
Sep 11 19:40:19.354414 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.354189    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tmp-dir\") pod \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\" (UID: \"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a\") "
Sep 11 19:40:19.354414 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.354220    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-model-cache" (OuterVolumeSpecName: "model-cache") pod "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" (UID: "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:40:19.354545 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.354505    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" (UID: "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:40:19.354602 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.354561    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-model-cache\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:40:19.354674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.354644    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-home" (OuterVolumeSpecName: "home") pod "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" (UID: "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:40:19.356907 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.356872    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-dshm" (OuterVolumeSpecName: "dshm") pod "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" (UID: "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:40:19.357055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.356921    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" (UID: "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:40:19.357055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.356989    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-kube-api-access-dpd4m" (OuterVolumeSpecName: "kube-api-access-dpd4m") pod "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" (UID: "2ebf0f96-2d16-4c13-9ae3-75c5b79e665a"). InnerVolumeSpecName "kube-api-access-dpd4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:40:19.455940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.455899    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-home\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:40:19.455940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.455936    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tmp-dir\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:40:19.456145 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.455949    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpd4m\" (UniqueName: \"kubernetes.io/projected/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-kube-api-access-dpd4m\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:40:19.456145 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.455963    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-tls-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:40:19.456145 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:19.455974    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a-dshm\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:40:20.008828 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.008792    2580 generic.go:356] "Generic (PLEG): container finished" podID="2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" containerID="9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246" exitCode=0
Sep 11 19:40:20.009305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.008834    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"
Sep 11 19:40:20.009305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.008856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n" event={"ID":"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a","Type":"ContainerDied","Data":"9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246"}
Sep 11 19:40:20.009305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.008891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n" event={"ID":"2ebf0f96-2d16-4c13-9ae3-75c5b79e665a","Type":"ContainerDied","Data":"dd74047cbb82c622d7fcab86b44634097935967526b4b6195f436509187a2aaf"}
Sep 11 19:40:20.009305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.008909    2580 scope.go:117] "RemoveContainer" containerID="9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246"
Sep 11 19:40:20.019958 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.019940    2580 scope.go:117] "RemoveContainer" containerID="9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246"
Sep 11 19:40:20.020231 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:40:20.020212    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246\": container with ID starting with 9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246 not found: ID does not exist" containerID="9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246"
Sep 11 19:40:20.020306 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.020242    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246"} err="failed to get container status \"9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246\": rpc error: code = NotFound desc = could not find container \"9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246\": container with ID starting with 9db6bc1b30b629c569a50236e73b07af91ead0d53354517568e7654bc49b4246 not found: ID does not exist"
Sep 11 19:40:20.031599 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.031575    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"]
Sep 11 19:40:20.034842 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.034821    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-55586842/e2e-lifecycle-model-55586842-kserve-69b8cd9fd7-8qk7n"]
Sep 11 19:40:20.449748 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.449708    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" path="/var/lib/kubelet/pods/2ebf0f96-2d16-4c13-9ae3-75c5b79e665a/volumes"
Sep 11 19:40:20.671907 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.671799    2580 scope.go:117] "RemoveContainer" containerID="7115ee81f13f893c6a18f4f9817d66764e65868030a81ce0e5c57e033107a6ab"
Sep 11 19:40:20.694509 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:20.681369    2580 scope.go:117] "RemoveContainer" containerID="2cd7089ec36b9bcd8560d1a2777605b2228ab7fb6491b0cc8bb1fddc481ffbd7"
Sep 11 19:40:31.078608 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:31.078519    2580 generic.go:356] "Generic (PLEG): container finished" podID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerID="0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5" exitCode=0
Sep 11 19:40:31.078608 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:31.078594    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" event={"ID":"7f2f287a-3576-43d2-93b6-a17eff72d6e1","Type":"ContainerDied","Data":"0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5"}
Sep 11 19:40:31.079078 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:31.079064    2580 scope.go:117] "RemoveContainer" containerID="0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5"
Sep 11 19:40:31.080219 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:31.080186    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:40:31.080335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:31.080251    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:40:31.080335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:31.080308    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:40:32.086644 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:32.086608    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" event={"ID":"7f2f287a-3576-43d2-93b6-a17eff72d6e1","Type":"ContainerStarted","Data":"107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440"}
Sep 11 19:40:32.458570 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:32.458539    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:32.458750 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:32.458724    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:40:32.458803 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:32.458768    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 19:40:33.458507 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:33.458467    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:40:33.458921 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:33.458545    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 19:40:34.458209 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:34.458170    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:40:34.458410 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:34.458221    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 19:40:35.458493 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:35.458451    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:40:35.458979 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:35.458515    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 19:40:36.458686 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:36.458650    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:40:36.459089 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:36.458703    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 19:40:37.458657 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:37.458621    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:40:37.458871 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:37.458689    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 11 19:40:38.463058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:38.463027    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:38.463458 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:38.463312    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:40:38.464069 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:40:38.464052    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:41:55.015760 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.015723    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"]
Sep 11 19:41:55.016229 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.016134    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" containerName="main"
Sep 11 19:41:55.016229 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.016145    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" containerName="main"
Sep 11 19:41:55.016229 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.016221    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ebf0f96-2d16-4c13-9ae3-75c5b79e665a" containerName="main"
Sep 11 19:41:55.018142 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.018125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:41:55.020396 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.020368    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-bed9fb\""
Sep 11 19:41:55.031360 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.031335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"]
Sep 11 19:41:55.057495 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.057464    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"]
Sep 11 19:41:55.060164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.060147    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:41:55.064537 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.064521    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-bed9fb-dockercfg-j6vtm\""
Sep 11 19:41:55.072639 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.072614    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"]
Sep 11 19:41:55.138715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.138676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f65d215-ae78-4710-973c-c925e0c3cbf4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh\" (UID: \"8f65d215-ae78-4710-973c-c925e0c3cbf4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:41:55.139079 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.138978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/797999d1-fe1c-494d-9765-5daf8006eddc-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt\" (UID: \"797999d1-fe1c-494d-9765-5daf8006eddc\") " pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:41:55.139305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.139268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndmcc\" (UniqueName: \"kubernetes.io/projected/797999d1-fe1c-494d-9765-5daf8006eddc-kube-api-access-ndmcc\") pod \"payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt\" (UID: \"797999d1-fe1c-494d-9765-5daf8006eddc\") " pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:41:55.139497 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.139477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxrkf\" (UniqueName: \"kubernetes.io/projected/8f65d215-ae78-4710-973c-c925e0c3cbf4-kube-api-access-nxrkf\") pod \"payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh\" (UID: \"8f65d215-ae78-4710-973c-c925e0c3cbf4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:41:55.241141 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.241096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f65d215-ae78-4710-973c-c925e0c3cbf4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh\" (UID: \"8f65d215-ae78-4710-973c-c925e0c3cbf4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:41:55.241399 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.241154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/797999d1-fe1c-494d-9765-5daf8006eddc-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt\" (UID: \"797999d1-fe1c-494d-9765-5daf8006eddc\") " pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:41:55.241399 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.241274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndmcc\" (UniqueName: \"kubernetes.io/projected/797999d1-fe1c-494d-9765-5daf8006eddc-kube-api-access-ndmcc\") pod \"payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt\" (UID: \"797999d1-fe1c-494d-9765-5daf8006eddc\") " pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:41:55.241543 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.241398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxrkf\" (UniqueName: \"kubernetes.io/projected/8f65d215-ae78-4710-973c-c925e0c3cbf4-kube-api-access-nxrkf\") pod \"payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh\" (UID: \"8f65d215-ae78-4710-973c-c925e0c3cbf4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:41:55.241885 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.241857    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/797999d1-fe1c-494d-9765-5daf8006eddc-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt\" (UID: \"797999d1-fe1c-494d-9765-5daf8006eddc\") " pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:41:55.241970 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.241919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f65d215-ae78-4710-973c-c925e0c3cbf4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh\" (UID: \"8f65d215-ae78-4710-973c-c925e0c3cbf4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:41:55.249760 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.249732    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndmcc\" (UniqueName: \"kubernetes.io/projected/797999d1-fe1c-494d-9765-5daf8006eddc-kube-api-access-ndmcc\") pod \"payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt\" (UID: \"797999d1-fe1c-494d-9765-5daf8006eddc\") " pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:41:55.249932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.249910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxrkf\" (UniqueName: \"kubernetes.io/projected/8f65d215-ae78-4710-973c-c925e0c3cbf4-kube-api-access-nxrkf\") pod \"payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh\" (UID: \"8f65d215-ae78-4710-973c-c925e0c3cbf4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:41:55.330040 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.329940    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:41:55.371468 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.371420    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:41:55.605151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.605110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"]
Sep 11 19:41:55.605697 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:41:55.605672    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f65d215_ae78_4710_973c_c925e0c3cbf4.slice/crio-e02403c8ba1795806588d93564d78921a8f2ad35934eea3a541082bd2255006e WatchSource:0}: Error finding container e02403c8ba1795806588d93564d78921a8f2ad35934eea3a541082bd2255006e: Status 404 returned error can't find the container with id e02403c8ba1795806588d93564d78921a8f2ad35934eea3a541082bd2255006e
Sep 11 19:41:55.678559 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:55.678530    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"]
Sep 11 19:41:55.679629 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:41:55.679604    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod797999d1_fe1c_494d_9765_5daf8006eddc.slice/crio-fe89cb1879d1762a8465e78b66c5be5627d51a7ef60af415e86e91746d490809 WatchSource:0}: Error finding container fe89cb1879d1762a8465e78b66c5be5627d51a7ef60af415e86e91746d490809: Status 404 returned error can't find the container with id fe89cb1879d1762a8465e78b66c5be5627d51a7ef60af415e86e91746d490809
Sep 11 19:41:56.627096 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:56.627057    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt" event={"ID":"797999d1-fe1c-494d-9765-5daf8006eddc","Type":"ContainerStarted","Data":"dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8"}
Sep 11 19:41:56.627637 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:56.627126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt" event={"ID":"797999d1-fe1c-494d-9765-5daf8006eddc","Type":"ContainerStarted","Data":"fe89cb1879d1762a8465e78b66c5be5627d51a7ef60af415e86e91746d490809"}
Sep 11 19:41:56.627637 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:56.627427    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:41:56.629468 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:56.629440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh" event={"ID":"8f65d215-ae78-4710-973c-c925e0c3cbf4","Type":"ContainerStarted","Data":"6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2"}
Sep 11 19:41:56.629689 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:56.629658    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh" event={"ID":"8f65d215-ae78-4710-973c-c925e0c3cbf4","Type":"ContainerStarted","Data":"e02403c8ba1795806588d93564d78921a8f2ad35934eea3a541082bd2255006e"}
Sep 11 19:41:56.629825 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:56.629710    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:41:56.650856 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:56.650807    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt" podStartSLOduration=1.650788495 podStartE2EDuration="1.650788495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:41:56.648153424 +0000 UTC m=+1416.669361572" watchObservedRunningTime="2026-09-11 19:41:56.650788495 +0000 UTC m=+1416.671996645"
Sep 11 19:41:56.672193 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:41:56.672136    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh" podStartSLOduration=2.672116243 podStartE2EDuration="2.672116243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:41:56.670876893 +0000 UTC m=+1416.692085060" watchObservedRunningTime="2026-09-11 19:41:56.672116243 +0000 UTC m=+1416.693324394"
Sep 11 19:42:07.639931 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:07.639901    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:42:07.640393 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:07.639969    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:42:17.097078 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.096994    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"]
Sep 11 19:42:17.100812 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.100792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"
Sep 11 19:42:17.105875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.105850    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:42:17.105991 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.105871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:42:17.124222 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.124190    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"]
Sep 11 19:42:17.180049 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.180012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc470e5-5032-4ead-ab92-b346e68c22c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc\" (UID: \"1bc470e5-5032-4ead-ab92-b346e68c22c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"
Sep 11 19:42:17.280961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.280917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc470e5-5032-4ead-ab92-b346e68c22c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc\" (UID: \"1bc470e5-5032-4ead-ab92-b346e68c22c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"
Sep 11 19:42:17.281631 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.281608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc470e5-5032-4ead-ab92-b346e68c22c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc\" (UID: \"1bc470e5-5032-4ead-ab92-b346e68c22c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"
Sep 11 19:42:17.411781 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.411687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"
Sep 11 19:42:17.686855 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.686830    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"]
Sep 11 19:42:17.688928 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:42:17.688898    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc470e5_5032_4ead_ab92_b346e68c22c8.slice/crio-7cb9be30742604a99b79fc50be6b0191583cce9de54ba36a5fae703017cfb31d WatchSource:0}: Error finding container 7cb9be30742604a99b79fc50be6b0191583cce9de54ba36a5fae703017cfb31d: Status 404 returned error can't find the container with id 7cb9be30742604a99b79fc50be6b0191583cce9de54ba36a5fae703017cfb31d
Sep 11 19:42:17.757853 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:17.757823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc" event={"ID":"1bc470e5-5032-4ead-ab92-b346e68c22c8","Type":"ContainerStarted","Data":"7cb9be30742604a99b79fc50be6b0191583cce9de54ba36a5fae703017cfb31d"}
Sep 11 19:42:18.765511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:18.765471    2580 generic.go:356] "Generic (PLEG): container finished" podID="1bc470e5-5032-4ead-ab92-b346e68c22c8" containerID="1b134f9cf60ba4fc63aa353c427720b48db7c8a09d53d5485960f2586ffe7f0a" exitCode=0
Sep 11 19:42:18.765902 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:18.765554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc" event={"ID":"1bc470e5-5032-4ead-ab92-b346e68c22c8","Type":"ContainerDied","Data":"1b134f9cf60ba4fc63aa353c427720b48db7c8a09d53d5485960f2586ffe7f0a"}
Sep 11 19:42:19.920499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:19.920473    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"
Sep 11 19:42:20.009137 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:20.009105    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc470e5-5032-4ead-ab92-b346e68c22c8-maas-api-service-ca\") pod \"1bc470e5-5032-4ead-ab92-b346e68c22c8\" (UID: \"1bc470e5-5032-4ead-ab92-b346e68c22c8\") "
Sep 11 19:42:20.009544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:20.009518    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bc470e5-5032-4ead-ab92-b346e68c22c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1bc470e5-5032-4ead-ab92-b346e68c22c8" (UID: "1bc470e5-5032-4ead-ab92-b346e68c22c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:42:20.110186 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:20.110091    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc470e5-5032-4ead-ab92-b346e68c22c8-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:20.728625 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:20.728537    2580 scope.go:117] "RemoveContainer" containerID="98dec9350fd9b231d510405a91be78e838773c6bcdb8acd0ee0c1f9f76d1131f"
Sep 11 19:42:20.779752 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:20.779725    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"
Sep 11 19:42:20.779934 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:20.779753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc" event={"ID":"1bc470e5-5032-4ead-ab92-b346e68c22c8","Type":"ContainerDied","Data":"7cb9be30742604a99b79fc50be6b0191583cce9de54ba36a5fae703017cfb31d"}
Sep 11 19:42:20.779934 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:20.779802    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cb9be30742604a99b79fc50be6b0191583cce9de54ba36a5fae703017cfb31d"
Sep 11 19:42:21.952407 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:21.952363    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"]
Sep 11 19:42:21.958076 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:21.958047    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"]
Sep 11 19:42:21.980551 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:21.980521    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"]
Sep 11 19:42:30.265063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.265024    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"]
Sep 11 19:42:30.265613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.265474    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc470e5-5032-4ead-ab92-b346e68c22c8" containerName="revoke-keys"
Sep 11 19:42:30.265613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.265487    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc470e5-5032-4ead-ab92-b346e68c22c8" containerName="revoke-keys"
Sep 11 19:42:30.265613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.265569    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bc470e5-5032-4ead-ab92-b346e68c22c8" containerName="revoke-keys"
Sep 11 19:42:30.269980 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.269961    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:42:30.274390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.274368    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-491be8-dockercfg-g7bfg\""
Sep 11 19:42:30.275164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.275146    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-491be8\""
Sep 11 19:42:30.284018 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.283991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"]
Sep 11 19:42:30.288379 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.288356    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"]
Sep 11 19:42:30.292469 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.292453    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:42:30.301688 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.301663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"]
Sep 11 19:42:30.421466 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.421414    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66323d6a-5db6-4bb4-b657-f485673360df-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx\" (UID: \"66323d6a-5db6-4bb4-b657-f485673360df\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:42:30.421466 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.421478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd30780a-2210-4e38-b32a-c0857dfa55f7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-491be8-87f976dbc-jsck6\" (UID: \"cd30780a-2210-4e38-b32a-c0857dfa55f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:42:30.421692 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.421587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lcb4\" (UniqueName: \"kubernetes.io/projected/66323d6a-5db6-4bb4-b657-f485673360df-kube-api-access-7lcb4\") pod \"payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx\" (UID: \"66323d6a-5db6-4bb4-b657-f485673360df\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:42:30.421692 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.421688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbghf\" (UniqueName: \"kubernetes.io/projected/cd30780a-2210-4e38-b32a-c0857dfa55f7-kube-api-access-mbghf\") pod \"payload-processing-e2e-api-b-491be8-87f976dbc-jsck6\" (UID: \"cd30780a-2210-4e38-b32a-c0857dfa55f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:42:30.522863 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.522777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lcb4\" (UniqueName: \"kubernetes.io/projected/66323d6a-5db6-4bb4-b657-f485673360df-kube-api-access-7lcb4\") pod \"payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx\" (UID: \"66323d6a-5db6-4bb4-b657-f485673360df\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:42:30.523035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.522880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbghf\" (UniqueName: \"kubernetes.io/projected/cd30780a-2210-4e38-b32a-c0857dfa55f7-kube-api-access-mbghf\") pod \"payload-processing-e2e-api-b-491be8-87f976dbc-jsck6\" (UID: \"cd30780a-2210-4e38-b32a-c0857dfa55f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:42:30.523035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.522935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66323d6a-5db6-4bb4-b657-f485673360df-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx\" (UID: \"66323d6a-5db6-4bb4-b657-f485673360df\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:42:30.523035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.522991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd30780a-2210-4e38-b32a-c0857dfa55f7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-491be8-87f976dbc-jsck6\" (UID: \"cd30780a-2210-4e38-b32a-c0857dfa55f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:42:30.523800 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.523775    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66323d6a-5db6-4bb4-b657-f485673360df-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx\" (UID: \"66323d6a-5db6-4bb4-b657-f485673360df\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:42:30.523905 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.523892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd30780a-2210-4e38-b32a-c0857dfa55f7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-491be8-87f976dbc-jsck6\" (UID: \"cd30780a-2210-4e38-b32a-c0857dfa55f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:42:30.531130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.531107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbghf\" (UniqueName: \"kubernetes.io/projected/cd30780a-2210-4e38-b32a-c0857dfa55f7-kube-api-access-mbghf\") pod \"payload-processing-e2e-api-b-491be8-87f976dbc-jsck6\" (UID: \"cd30780a-2210-4e38-b32a-c0857dfa55f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:42:30.531130 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.531127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lcb4\" (UniqueName: \"kubernetes.io/projected/66323d6a-5db6-4bb4-b657-f485673360df-kube-api-access-7lcb4\") pod \"payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx\" (UID: \"66323d6a-5db6-4bb4-b657-f485673360df\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:42:30.581147 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.581111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:42:30.605321 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.605290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:42:30.856136 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.856109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"]
Sep 11 19:42:30.857404 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:42:30.857383    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66323d6a_5db6_4bb4_b657_f485673360df.slice/crio-c4fa2b03d0afb9d63529084421a0c664f52b6f53608d82a89662795903450c23 WatchSource:0}: Error finding container c4fa2b03d0afb9d63529084421a0c664f52b6f53608d82a89662795903450c23: Status 404 returned error can't find the container with id c4fa2b03d0afb9d63529084421a0c664f52b6f53608d82a89662795903450c23
Sep 11 19:42:30.887748 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:30.887724    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"]
Sep 11 19:42:30.895590 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:42:30.895564    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd30780a_2210_4e38_b32a_c0857dfa55f7.slice/crio-a328b73e1f8616589f7c80b75067daa810d6365f86a440b7841fc412017ddac0 WatchSource:0}: Error finding container a328b73e1f8616589f7c80b75067daa810d6365f86a440b7841fc412017ddac0: Status 404 returned error can't find the container with id a328b73e1f8616589f7c80b75067daa810d6365f86a440b7841fc412017ddac0
Sep 11 19:42:31.855531 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:31.855486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6" event={"ID":"cd30780a-2210-4e38-b32a-c0857dfa55f7","Type":"ContainerStarted","Data":"9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba"}
Sep 11 19:42:31.856016 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:31.855554    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:42:31.856016 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:31.855576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6" event={"ID":"cd30780a-2210-4e38-b32a-c0857dfa55f7","Type":"ContainerStarted","Data":"a328b73e1f8616589f7c80b75067daa810d6365f86a440b7841fc412017ddac0"}
Sep 11 19:42:31.857082 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:31.857056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx" event={"ID":"66323d6a-5db6-4bb4-b657-f485673360df","Type":"ContainerStarted","Data":"60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7"}
Sep 11 19:42:31.857214 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:31.857110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx" event={"ID":"66323d6a-5db6-4bb4-b657-f485673360df","Type":"ContainerStarted","Data":"c4fa2b03d0afb9d63529084421a0c664f52b6f53608d82a89662795903450c23"}
Sep 11 19:42:31.857214 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:31.857141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:42:31.872645 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:31.872593    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6" podStartSLOduration=1.872578005 podStartE2EDuration="1.872578005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:31.871211457 +0000 UTC m=+1451.892419632" watchObservedRunningTime="2026-09-11 19:42:31.872578005 +0000 UTC m=+1451.893786155"
Sep 11 19:42:31.888588 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:31.888542    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx" podStartSLOduration=1.888527813 podStartE2EDuration="1.888527813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:31.886134834 +0000 UTC m=+1451.907343007" watchObservedRunningTime="2026-09-11 19:42:31.888527813 +0000 UTC m=+1451.909735962"
Sep 11 19:42:36.254740 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.254690    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"]
Sep 11 19:42:36.255521 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.255482    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626" podUID="8805746f-0407-416b-96fc-97dd53ecc444" containerName="payload-processing" containerID="cri-o://b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53" gracePeriod=30
Sep 11 19:42:36.264464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.263775    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"]
Sep 11 19:42:36.264464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.263997    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x" podUID="b0db72d7-d781-411e-9b96-7ad2a3bae024" containerName="payload-pre-processing" containerID="cri-o://fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb" gracePeriod=30
Sep 11 19:42:36.429193 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.429155    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"]
Sep 11 19:42:36.431954 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.431923    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-1fc808-j97pc"]
Sep 11 19:42:36.451382 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.451351    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bc470e5-5032-4ead-ab92-b346e68c22c8" path="/var/lib/kubelet/pods/1bc470e5-5032-4ead-ab92-b346e68c22c8/volumes"
Sep 11 19:42:36.545973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.545934    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:42:36.549005 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.548980    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:42:36.686305 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.686242    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8805746f-0407-416b-96fc-97dd53ecc444-plugins-config-volume\") pod \"8805746f-0407-416b-96fc-97dd53ecc444\" (UID: \"8805746f-0407-416b-96fc-97dd53ecc444\") "
Sep 11 19:42:36.686493 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.686311    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8stxk\" (UniqueName: \"kubernetes.io/projected/b0db72d7-d781-411e-9b96-7ad2a3bae024-kube-api-access-8stxk\") pod \"b0db72d7-d781-411e-9b96-7ad2a3bae024\" (UID: \"b0db72d7-d781-411e-9b96-7ad2a3bae024\") "
Sep 11 19:42:36.686493 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.686356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0db72d7-d781-411e-9b96-7ad2a3bae024-plugins-config-volume\") pod \"b0db72d7-d781-411e-9b96-7ad2a3bae024\" (UID: \"b0db72d7-d781-411e-9b96-7ad2a3bae024\") "
Sep 11 19:42:36.686493 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.686472    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frw64\" (UniqueName: \"kubernetes.io/projected/8805746f-0407-416b-96fc-97dd53ecc444-kube-api-access-frw64\") pod \"8805746f-0407-416b-96fc-97dd53ecc444\" (UID: \"8805746f-0407-416b-96fc-97dd53ecc444\") "
Sep 11 19:42:36.686708 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.686684    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8805746f-0407-416b-96fc-97dd53ecc444-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8805746f-0407-416b-96fc-97dd53ecc444" (UID: "8805746f-0407-416b-96fc-97dd53ecc444"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:42:36.686774 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.686755    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0db72d7-d781-411e-9b96-7ad2a3bae024-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b0db72d7-d781-411e-9b96-7ad2a3bae024" (UID: "b0db72d7-d781-411e-9b96-7ad2a3bae024"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:42:36.686882 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.686869    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8805746f-0407-416b-96fc-97dd53ecc444-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:36.686924 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.686885    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0db72d7-d781-411e-9b96-7ad2a3bae024-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:36.688544 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.688523    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0db72d7-d781-411e-9b96-7ad2a3bae024-kube-api-access-8stxk" (OuterVolumeSpecName: "kube-api-access-8stxk") pod "b0db72d7-d781-411e-9b96-7ad2a3bae024" (UID: "b0db72d7-d781-411e-9b96-7ad2a3bae024"). InnerVolumeSpecName "kube-api-access-8stxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:36.688609 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.688553    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8805746f-0407-416b-96fc-97dd53ecc444-kube-api-access-frw64" (OuterVolumeSpecName: "kube-api-access-frw64") pod "8805746f-0407-416b-96fc-97dd53ecc444" (UID: "8805746f-0407-416b-96fc-97dd53ecc444"). InnerVolumeSpecName "kube-api-access-frw64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:36.787927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.787843    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8stxk\" (UniqueName: \"kubernetes.io/projected/b0db72d7-d781-411e-9b96-7ad2a3bae024-kube-api-access-8stxk\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:36.787927 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.787875    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frw64\" (UniqueName: \"kubernetes.io/projected/8805746f-0407-416b-96fc-97dd53ecc444-kube-api-access-frw64\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:36.905465 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.905412    2580 generic.go:356] "Generic (PLEG): container finished" podID="8805746f-0407-416b-96fc-97dd53ecc444" containerID="b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53" exitCode=0
Sep 11 19:42:36.905770 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.905661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626" event={"ID":"8805746f-0407-416b-96fc-97dd53ecc444","Type":"ContainerDied","Data":"b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53"}
Sep 11 19:42:36.905770 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.905678    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"
Sep 11 19:42:36.905770 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.905742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626" event={"ID":"8805746f-0407-416b-96fc-97dd53ecc444","Type":"ContainerDied","Data":"6801c85493057bddecfc15f4adb97a5b779ed9b74c10e0250e36f42207c4d552"}
Sep 11 19:42:36.905978 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.905777    2580 scope.go:117] "RemoveContainer" containerID="b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53"
Sep 11 19:42:36.908880 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.908842    2580 generic.go:356] "Generic (PLEG): container finished" podID="b0db72d7-d781-411e-9b96-7ad2a3bae024" containerID="fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb" exitCode=0
Sep 11 19:42:36.909023 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.908877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x" event={"ID":"b0db72d7-d781-411e-9b96-7ad2a3bae024","Type":"ContainerDied","Data":"fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb"}
Sep 11 19:42:36.909023 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.908894    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"
Sep 11 19:42:36.909023 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.908950    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x" event={"ID":"b0db72d7-d781-411e-9b96-7ad2a3bae024","Type":"ContainerDied","Data":"60ade4672e79aa5882ef9b85faf2b1be20ae8cb18aa51a4a25e0c404ea691f60"}
Sep 11 19:42:36.918197 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.918150    2580 scope.go:117] "RemoveContainer" containerID="b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53"
Sep 11 19:42:36.918733 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:42:36.918703    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53\": container with ID starting with b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53 not found: ID does not exist" containerID="b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53"
Sep 11 19:42:36.918812 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.918743    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53"} err="failed to get container status \"b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53\": rpc error: code = NotFound desc = could not find container \"b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53\": container with ID starting with b9960594ddfdbce415e6d74cb8132cdd801096d87f660737b38a5e32b9d65d53 not found: ID does not exist"
Sep 11 19:42:36.918812 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.918768    2580 scope.go:117] "RemoveContainer" containerID="fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb"
Sep 11 19:42:36.929503 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.929483    2580 scope.go:117] "RemoveContainer" containerID="fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb"
Sep 11 19:42:36.929769 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:42:36.929749    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb\": container with ID starting with fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb not found: ID does not exist" containerID="fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb"
Sep 11 19:42:36.929815 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.929776    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb"} err="failed to get container status \"fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb\": rpc error: code = NotFound desc = could not find container \"fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb\": container with ID starting with fd0a95c8f45cde956beb0ab25aca00a5848cd3665cb6749110c782f3ff9122cb not found: ID does not exist"
Sep 11 19:42:36.941104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.941082    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"]
Sep 11 19:42:36.954506 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.954482    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-1fc808-6c45f795c5-44626"]
Sep 11 19:42:36.971038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.971003    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"]
Sep 11 19:42:36.972552 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.972521    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc" podUID="f9b14de1-4170-47e5-9dfd-04b934de024f" containerName="main" containerID="cri-o://63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104" gracePeriod=45
Sep 11 19:42:36.977227 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.977197    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5" podUID="cfdbc30c-ddc3-462d-9e65-a4c183a20c36" containerName="main" containerID="cri-o://de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d" gracePeriod=45
Sep 11 19:42:36.977338 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.977207    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-1fc808-65bb557c74-56t4x"]
Sep 11 19:42:36.999001 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:36.998974    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8" podUID="58bbd33d-130e-4e9c-8fa7-a39a896d1e08" containerName="main" containerID="cri-o://ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71" gracePeriod=45
Sep 11 19:42:37.296671 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.296650    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:42:37.299799 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.299778    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:42:37.303556 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.303536    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:42:37.393800 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.393712    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tls-certs\") pod \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") "
Sep 11 19:42:37.393800 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.393772    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-dshm\") pod \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") "
Sep 11 19:42:37.394031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.393802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnhgm\" (UniqueName: \"kubernetes.io/projected/f9b14de1-4170-47e5-9dfd-04b934de024f-kube-api-access-mnhgm\") pod \"f9b14de1-4170-47e5-9dfd-04b934de024f\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") "
Sep 11 19:42:37.394031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.393826    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9b14de1-4170-47e5-9dfd-04b934de024f-tls-certs\") pod \"f9b14de1-4170-47e5-9dfd-04b934de024f\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") "
Sep 11 19:42:37.394031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.393862    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-tmp-dir\") pod \"f9b14de1-4170-47e5-9dfd-04b934de024f\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") "
Sep 11 19:42:37.394031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.393887    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cthwp\" (UniqueName: \"kubernetes.io/projected/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-kube-api-access-cthwp\") pod \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") "
Sep 11 19:42:37.394031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.393923    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m2r9\" (UniqueName: \"kubernetes.io/projected/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-kube-api-access-8m2r9\") pod \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") "
Sep 11 19:42:37.394031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.393961    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tmp-dir\") pod \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") "
Sep 11 19:42:37.394031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.393991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-home\") pod \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") "
Sep 11 19:42:37.394031 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.394021    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-dshm\") pod \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") "
Sep 11 19:42:37.394573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.394043    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-dshm\") pod \"f9b14de1-4170-47e5-9dfd-04b934de024f\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") "
Sep 11 19:42:37.394573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.394078    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tls-certs\") pod \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") "
Sep 11 19:42:37.394573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.394102    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-model-cache\") pod \"f9b14de1-4170-47e5-9dfd-04b934de024f\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") "
Sep 11 19:42:37.394573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.394132    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-model-cache\") pod \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") "
Sep 11 19:42:37.394573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.394183    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-home\") pod \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") "
Sep 11 19:42:37.394573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.394314    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tmp-dir\") pod \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\" (UID: \"cfdbc30c-ddc3-462d-9e65-a4c183a20c36\") "
Sep 11 19:42:37.394573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.394342    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-home\") pod \"f9b14de1-4170-47e5-9dfd-04b934de024f\" (UID: \"f9b14de1-4170-47e5-9dfd-04b934de024f\") "
Sep 11 19:42:37.394573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.394381    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-model-cache\") pod \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\" (UID: \"58bbd33d-130e-4e9c-8fa7-a39a896d1e08\") "
Sep 11 19:42:37.395610 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.395018    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-model-cache" (OuterVolumeSpecName: "model-cache") pod "58bbd33d-130e-4e9c-8fa7-a39a896d1e08" (UID: "58bbd33d-130e-4e9c-8fa7-a39a896d1e08"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.395610 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.395226    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-home" (OuterVolumeSpecName: "home") pod "58bbd33d-130e-4e9c-8fa7-a39a896d1e08" (UID: "58bbd33d-130e-4e9c-8fa7-a39a896d1e08"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.395610 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.395252    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-model-cache" (OuterVolumeSpecName: "model-cache") pod "cfdbc30c-ddc3-462d-9e65-a4c183a20c36" (UID: "cfdbc30c-ddc3-462d-9e65-a4c183a20c36"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.395610 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.395421    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cfdbc30c-ddc3-462d-9e65-a4c183a20c36" (UID: "cfdbc30c-ddc3-462d-9e65-a4c183a20c36"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.395899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.395612    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-home" (OuterVolumeSpecName: "home") pod "f9b14de1-4170-47e5-9dfd-04b934de024f" (UID: "f9b14de1-4170-47e5-9dfd-04b934de024f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.395899 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.395790    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f9b14de1-4170-47e5-9dfd-04b934de024f" (UID: "f9b14de1-4170-47e5-9dfd-04b934de024f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.396014 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.395946    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58bbd33d-130e-4e9c-8fa7-a39a896d1e08" (UID: "58bbd33d-130e-4e9c-8fa7-a39a896d1e08"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.396685 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.396654    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-dshm" (OuterVolumeSpecName: "dshm") pod "cfdbc30c-ddc3-462d-9e65-a4c183a20c36" (UID: "cfdbc30c-ddc3-462d-9e65-a4c183a20c36"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.396913 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.396890    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-home" (OuterVolumeSpecName: "home") pod "cfdbc30c-ddc3-462d-9e65-a4c183a20c36" (UID: "cfdbc30c-ddc3-462d-9e65-a4c183a20c36"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.398197 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.397996    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cfdbc30c-ddc3-462d-9e65-a4c183a20c36" (UID: "cfdbc30c-ddc3-462d-9e65-a4c183a20c36"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:42:37.398423 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.398359    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-model-cache" (OuterVolumeSpecName: "model-cache") pod "f9b14de1-4170-47e5-9dfd-04b934de024f" (UID: "f9b14de1-4170-47e5-9dfd-04b934de024f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.398494 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.398457    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-dshm" (OuterVolumeSpecName: "dshm") pod "f9b14de1-4170-47e5-9dfd-04b934de024f" (UID: "f9b14de1-4170-47e5-9dfd-04b934de024f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.399447 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.399413    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9b14de1-4170-47e5-9dfd-04b934de024f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f9b14de1-4170-47e5-9dfd-04b934de024f" (UID: "f9b14de1-4170-47e5-9dfd-04b934de024f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:42:37.399793 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.399770    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-dshm" (OuterVolumeSpecName: "dshm") pod "58bbd33d-130e-4e9c-8fa7-a39a896d1e08" (UID: "58bbd33d-130e-4e9c-8fa7-a39a896d1e08"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:37.399916 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.399801    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-kube-api-access-cthwp" (OuterVolumeSpecName: "kube-api-access-cthwp") pod "58bbd33d-130e-4e9c-8fa7-a39a896d1e08" (UID: "58bbd33d-130e-4e9c-8fa7-a39a896d1e08"). InnerVolumeSpecName "kube-api-access-cthwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:37.399916 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.399822    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-kube-api-access-8m2r9" (OuterVolumeSpecName: "kube-api-access-8m2r9") pod "cfdbc30c-ddc3-462d-9e65-a4c183a20c36" (UID: "cfdbc30c-ddc3-462d-9e65-a4c183a20c36"). InnerVolumeSpecName "kube-api-access-8m2r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:37.399916 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.399855    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9b14de1-4170-47e5-9dfd-04b934de024f-kube-api-access-mnhgm" (OuterVolumeSpecName: "kube-api-access-mnhgm") pod "f9b14de1-4170-47e5-9dfd-04b934de024f" (UID: "f9b14de1-4170-47e5-9dfd-04b934de024f"). InnerVolumeSpecName "kube-api-access-mnhgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:37.400024 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.399943    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58bbd33d-130e-4e9c-8fa7-a39a896d1e08" (UID: "58bbd33d-130e-4e9c-8fa7-a39a896d1e08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:42:37.495893 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495844    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tls-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.495893 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495890    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-model-cache\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.495893 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495900    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-model-cache\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.495893 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495908    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-home\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495916    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tmp-dir\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495923    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-home\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495931    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-model-cache\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495938    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-tls-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495944    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-dshm\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495952    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnhgm\" (UniqueName: \"kubernetes.io/projected/f9b14de1-4170-47e5-9dfd-04b934de024f-kube-api-access-mnhgm\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495961    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9b14de1-4170-47e5-9dfd-04b934de024f-tls-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495969    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-tmp-dir\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495976    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cthwp\" (UniqueName: \"kubernetes.io/projected/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-kube-api-access-cthwp\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495985    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m2r9\" (UniqueName: \"kubernetes.io/projected/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-kube-api-access-8m2r9\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.495993    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-tmp-dir\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.496000    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfdbc30c-ddc3-462d-9e65-a4c183a20c36-home\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.496007    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bbd33d-130e-4e9c-8fa7-a39a896d1e08-dshm\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.496168 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.496014    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9b14de1-4170-47e5-9dfd-04b934de024f-dshm\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:37.916004 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.915965    2580 generic.go:356] "Generic (PLEG): container finished" podID="cfdbc30c-ddc3-462d-9e65-a4c183a20c36" containerID="de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d" exitCode=0
Sep 11 19:42:37.916187 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.916008    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"
Sep 11 19:42:37.916187 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.916042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5" event={"ID":"cfdbc30c-ddc3-462d-9e65-a4c183a20c36","Type":"ContainerDied","Data":"de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d"}
Sep 11 19:42:37.916187 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.916086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5" event={"ID":"cfdbc30c-ddc3-462d-9e65-a4c183a20c36","Type":"ContainerDied","Data":"2f7b6e006e65db8e238da1b60d9d3d4fee30d23f28828e450b923273d32fdf83"}
Sep 11 19:42:37.916187 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.916104    2580 scope.go:117] "RemoveContainer" containerID="de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d"
Sep 11 19:42:37.918619 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.918594    2580 generic.go:356] "Generic (PLEG): container finished" podID="58bbd33d-130e-4e9c-8fa7-a39a896d1e08" containerID="ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71" exitCode=0
Sep 11 19:42:37.918740 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.918624    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"
Sep 11 19:42:37.918740 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.918677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8" event={"ID":"58bbd33d-130e-4e9c-8fa7-a39a896d1e08","Type":"ContainerDied","Data":"ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71"}
Sep 11 19:42:37.918740 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.918718    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8" event={"ID":"58bbd33d-130e-4e9c-8fa7-a39a896d1e08","Type":"ContainerDied","Data":"4e8a4a15cd7f20cccc462ea0a727a419dfd99d3c9afbb43ba8d0642cafb5af56"}
Sep 11 19:42:37.921339 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.921310    2580 generic.go:356] "Generic (PLEG): container finished" podID="f9b14de1-4170-47e5-9dfd-04b934de024f" containerID="63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104" exitCode=0
Sep 11 19:42:37.921429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.921347    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"
Sep 11 19:42:37.921478 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.921342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc" event={"ID":"f9b14de1-4170-47e5-9dfd-04b934de024f","Type":"ContainerDied","Data":"63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104"}
Sep 11 19:42:37.921478 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.921463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc" event={"ID":"f9b14de1-4170-47e5-9dfd-04b934de024f","Type":"ContainerDied","Data":"1c84bcfd6e2d0cc501d1e84797f0d3307df99670daa702c29ad6077128e464d4"}
Sep 11 19:42:37.928934 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.928913    2580 scope.go:117] "RemoveContainer" containerID="de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d"
Sep 11 19:42:37.929239 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:42:37.929210    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d\": container with ID starting with de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d not found: ID does not exist" containerID="de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d"
Sep 11 19:42:37.929351 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.929250    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d"} err="failed to get container status \"de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d\": rpc error: code = NotFound desc = could not find container \"de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d\": container with ID starting with de3182a824565823681903a3af34625eb20e18acfb2644d82170e225d1cc047d not found: ID does not exist"
Sep 11 19:42:37.929351 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.929290    2580 scope.go:117] "RemoveContainer" containerID="ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71"
Sep 11 19:42:37.937974 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.937950    2580 scope.go:117] "RemoveContainer" containerID="ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71"
Sep 11 19:42:37.938246 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:42:37.938225    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71\": container with ID starting with ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71 not found: ID does not exist" containerID="ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71"
Sep 11 19:42:37.938350 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.938250    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71"} err="failed to get container status \"ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71\": rpc error: code = NotFound desc = could not find container \"ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71\": container with ID starting with ef22929bd9182b75ff30f8f406e0aa518585743418d7cf9a5619b7457356ea71 not found: ID does not exist"
Sep 11 19:42:37.938350 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.938275    2580 scope.go:117] "RemoveContainer" containerID="63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104"
Sep 11 19:42:37.939402 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.939382    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"]
Sep 11 19:42:37.945659 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.945636    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-w0-1fc808-kserve-674f85579-299g5"]
Sep 11 19:42:37.947683 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.947668    2580 scope.go:117] "RemoveContainer" containerID="63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104"
Sep 11 19:42:37.947929 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:42:37.947911    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104\": container with ID starting with 63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104 not found: ID does not exist" containerID="63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104"
Sep 11 19:42:37.947972 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.947936    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104"} err="failed to get container status \"63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104\": rpc error: code = NotFound desc = could not find container \"63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104\": container with ID starting with 63d7107ad74e76f255e9f66431eedff3fccf4f463aca4c8380aafbd794eba104 not found: ID does not exist"
Sep 11 19:42:37.958807 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.958785    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"]
Sep 11 19:42:37.961159 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.961140    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/premium-w0-1fc808-kserve-8d6dbb456-scxl8"]
Sep 11 19:42:37.969397 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.969369    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"]
Sep 11 19:42:37.971560 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:37.971541    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-1fc808/distinct-2-w0-1fc808-kserve-6f788f576d-9xxgc"]
Sep 11 19:42:38.449668 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:38.449636    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58bbd33d-130e-4e9c-8fa7-a39a896d1e08" path="/var/lib/kubelet/pods/58bbd33d-130e-4e9c-8fa7-a39a896d1e08/volumes"
Sep 11 19:42:38.450063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:38.450005    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8805746f-0407-416b-96fc-97dd53ecc444" path="/var/lib/kubelet/pods/8805746f-0407-416b-96fc-97dd53ecc444/volumes"
Sep 11 19:42:38.450343 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:38.450330    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0db72d7-d781-411e-9b96-7ad2a3bae024" path="/var/lib/kubelet/pods/b0db72d7-d781-411e-9b96-7ad2a3bae024/volumes"
Sep 11 19:42:38.450941 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:38.450926    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfdbc30c-ddc3-462d-9e65-a4c183a20c36" path="/var/lib/kubelet/pods/cfdbc30c-ddc3-462d-9e65-a4c183a20c36/volumes"
Sep 11 19:42:38.451339 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:38.451322    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9b14de1-4170-47e5-9dfd-04b934de024f" path="/var/lib/kubelet/pods/f9b14de1-4170-47e5-9dfd-04b934de024f/volumes"
Sep 11 19:42:42.871712 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:42.871678    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:42:42.872132 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:42.871756    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:42:43.174678 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:43.174582    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"]
Sep 11 19:42:43.174860 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:43.174830    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy" containerID="cri-o://061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0" gracePeriod=30
Sep 11 19:42:47.274497 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274461    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"]
Sep 11 19:42:47.274883 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274876    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b14de1-4170-47e5-9dfd-04b934de024f" containerName="main"
Sep 11 19:42:47.274930 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274887    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b14de1-4170-47e5-9dfd-04b934de024f" containerName="main"
Sep 11 19:42:47.274930 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274902    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8805746f-0407-416b-96fc-97dd53ecc444" containerName="payload-processing"
Sep 11 19:42:47.274930 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274908    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8805746f-0407-416b-96fc-97dd53ecc444" containerName="payload-processing"
Sep 11 19:42:47.274930 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274916    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58bbd33d-130e-4e9c-8fa7-a39a896d1e08" containerName="main"
Sep 11 19:42:47.274930 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274921    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="58bbd33d-130e-4e9c-8fa7-a39a896d1e08" containerName="main"
Sep 11 19:42:47.274930 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274931    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0db72d7-d781-411e-9b96-7ad2a3bae024" containerName="payload-pre-processing"
Sep 11 19:42:47.275104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274936    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0db72d7-d781-411e-9b96-7ad2a3bae024" containerName="payload-pre-processing"
Sep 11 19:42:47.275104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274944    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfdbc30c-ddc3-462d-9e65-a4c183a20c36" containerName="main"
Sep 11 19:42:47.275104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.274949    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfdbc30c-ddc3-462d-9e65-a4c183a20c36" containerName="main"
Sep 11 19:42:47.275104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.275013    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8805746f-0407-416b-96fc-97dd53ecc444" containerName="payload-processing"
Sep 11 19:42:47.275104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.275023    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0db72d7-d781-411e-9b96-7ad2a3bae024" containerName="payload-pre-processing"
Sep 11 19:42:47.275104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.275029    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="58bbd33d-130e-4e9c-8fa7-a39a896d1e08" containerName="main"
Sep 11 19:42:47.275104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.275034    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b14de1-4170-47e5-9dfd-04b934de024f" containerName="main"
Sep 11 19:42:47.275104 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.275040    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfdbc30c-ddc3-462d-9e65-a4c183a20c36" containerName="main"
Sep 11 19:42:47.279756 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.279738    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"
Sep 11 19:42:47.282274 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.282245    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:42:47.282414 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.282389    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:42:47.285911 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.285889    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"]
Sep 11 19:42:47.292570 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.292548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58e95d5-5633-44a5-9a16-8773b158a311-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q\" (UID: \"f58e95d5-5633-44a5-9a16-8773b158a311\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"
Sep 11 19:42:47.393945 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.393914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58e95d5-5633-44a5-9a16-8773b158a311-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q\" (UID: \"f58e95d5-5633-44a5-9a16-8773b158a311\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"
Sep 11 19:42:47.394588 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.394568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58e95d5-5633-44a5-9a16-8773b158a311-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q\" (UID: \"f58e95d5-5633-44a5-9a16-8773b158a311\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"
Sep 11 19:42:47.592040 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.591955    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"
Sep 11 19:42:47.867796 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.867767    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"]
Sep 11 19:42:47.869210 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:42:47.869180    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58e95d5_5633_44a5_9a16_8773b158a311.slice/crio-26ad41ac9918a025e6054451963f9742baf3a23d871471e56623c730170d5e79 WatchSource:0}: Error finding container 26ad41ac9918a025e6054451963f9742baf3a23d871471e56623c730170d5e79: Status 404 returned error can't find the container with id 26ad41ac9918a025e6054451963f9742baf3a23d871471e56623c730170d5e79
Sep 11 19:42:47.990686 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:47.990644    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q" event={"ID":"f58e95d5-5633-44a5-9a16-8773b158a311","Type":"ContainerStarted","Data":"26ad41ac9918a025e6054451963f9742baf3a23d871471e56623c730170d5e79"}
Sep 11 19:42:48.423698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.423673    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:42:48.501712 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.501626    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-podinfo\") pod \"651e7ec9-b53b-4291-9520-555c3b4e1a97\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") "
Sep 11 19:42:48.501712 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.501681    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-certs\") pod \"651e7ec9-b53b-4291-9520-555c3b4e1a97\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") "
Sep 11 19:42:48.501940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.501716    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/651e7ec9-b53b-4291-9520-555c3b4e1a97-istiod-ca-cert\") pod \"651e7ec9-b53b-4291-9520-555c3b4e1a97\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") "
Sep 11 19:42:48.501940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.501754    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-token\") pod \"651e7ec9-b53b-4291-9520-555c3b4e1a97\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") "
Sep 11 19:42:48.501940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.501785    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-socket\") pod \"651e7ec9-b53b-4291-9520-555c3b4e1a97\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") "
Sep 11 19:42:48.501940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.501830    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-credential-socket\") pod \"651e7ec9-b53b-4291-9520-555c3b4e1a97\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") "
Sep 11 19:42:48.501940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.501891    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-data\") pod \"651e7ec9-b53b-4291-9520-555c3b4e1a97\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") "
Sep 11 19:42:48.501940 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.501942    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-envoy\") pod \"651e7ec9-b53b-4291-9520-555c3b4e1a97\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") "
Sep 11 19:42:48.502263 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502053    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "651e7ec9-b53b-4291-9520-555c3b4e1a97" (UID: "651e7ec9-b53b-4291-9520-555c3b4e1a97"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:48.502263 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502092    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "651e7ec9-b53b-4291-9520-555c3b4e1a97" (UID: "651e7ec9-b53b-4291-9520-555c3b4e1a97"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:48.502263 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502147    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/651e7ec9-b53b-4291-9520-555c3b4e1a97-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "651e7ec9-b53b-4291-9520-555c3b4e1a97" (UID: "651e7ec9-b53b-4291-9520-555c3b4e1a97"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:42:48.502263 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502231    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-data" (OuterVolumeSpecName: "istio-data") pod "651e7ec9-b53b-4291-9520-555c3b4e1a97" (UID: "651e7ec9-b53b-4291-9520-555c3b4e1a97"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:48.502263 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502146    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "651e7ec9-b53b-4291-9520-555c3b4e1a97" (UID: "651e7ec9-b53b-4291-9520-555c3b4e1a97"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:48.502516 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502347    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pksp2\" (UniqueName: \"kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-kube-api-access-pksp2\") pod \"651e7ec9-b53b-4291-9520-555c3b4e1a97\" (UID: \"651e7ec9-b53b-4291-9520-555c3b4e1a97\") "
Sep 11 19:42:48.502715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502683    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:48.502715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502711    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:48.502873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502726    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/651e7ec9-b53b-4291-9520-555c3b4e1a97-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:48.502873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502740    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:48.502873 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.502753    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:48.504018 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.503993    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "651e7ec9-b53b-4291-9520-555c3b4e1a97" (UID: "651e7ec9-b53b-4291-9520-555c3b4e1a97"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:42:48.504220 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.504198    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-kube-api-access-pksp2" (OuterVolumeSpecName: "kube-api-access-pksp2") pod "651e7ec9-b53b-4291-9520-555c3b4e1a97" (UID: "651e7ec9-b53b-4291-9520-555c3b4e1a97"). InnerVolumeSpecName "kube-api-access-pksp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:48.504412 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.504392    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-token" (OuterVolumeSpecName: "istio-token") pod "651e7ec9-b53b-4291-9520-555c3b4e1a97" (UID: "651e7ec9-b53b-4291-9520-555c3b4e1a97"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:42:48.504464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.504397    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "651e7ec9-b53b-4291-9520-555c3b4e1a97" (UID: "651e7ec9-b53b-4291-9520-555c3b4e1a97"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:42:48.603694 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.603653    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:48.603845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.603696    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pksp2\" (UniqueName: \"kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-kube-api-access-pksp2\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:48.603845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.603712    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:48.603845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.603725    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/651e7ec9-b53b-4291-9520-555c3b4e1a97-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:48.998160 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.998115    2580 generic.go:356] "Generic (PLEG): container finished" podID="f58e95d5-5633-44a5-9a16-8773b158a311" containerID="5e896bb0e494d508985f9827983cb16a360f56954051bb7df2e4be5f5f6ca798" exitCode=0
Sep 11 19:42:48.998386 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.998206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q" event={"ID":"f58e95d5-5633-44a5-9a16-8773b158a311","Type":"ContainerDied","Data":"5e896bb0e494d508985f9827983cb16a360f56954051bb7df2e4be5f5f6ca798"}
Sep 11 19:42:48.999880 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.999854    2580 generic.go:356] "Generic (PLEG): container finished" podID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerID="061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0" exitCode=0
Sep 11 19:42:48.999996 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.999880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" event={"ID":"651e7ec9-b53b-4291-9520-555c3b4e1a97","Type":"ContainerDied","Data":"061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0"}
Sep 11 19:42:48.999996 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.999905    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"
Sep 11 19:42:48.999996 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.999927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp" event={"ID":"651e7ec9-b53b-4291-9520-555c3b4e1a97","Type":"ContainerDied","Data":"c7e1669bf4c3028055dad883d20aba6ca1904c9cfd2bddd98a0e2a6be2f5fbcb"}
Sep 11 19:42:48.999996 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:48.999950    2580 scope.go:117] "RemoveContainer" containerID="061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0"
Sep 11 19:42:49.012508 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:49.012490    2580 scope.go:117] "RemoveContainer" containerID="0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76"
Sep 11 19:42:49.022099 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:49.022079    2580 scope.go:117] "RemoveContainer" containerID="061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0"
Sep 11 19:42:49.022415 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:42:49.022362    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0\": container with ID starting with 061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0 not found: ID does not exist" containerID="061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0"
Sep 11 19:42:49.022493 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:49.022425    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0"} err="failed to get container status \"061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0\": rpc error: code = NotFound desc = could not find container \"061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0\": container with ID starting with 061e7e38ab32407b4e290bb91165a7b9205acec1a95f200cf303edf9f805faa0 not found: ID does not exist"
Sep 11 19:42:49.022493 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:49.022452    2580 scope.go:117] "RemoveContainer" containerID="0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76"
Sep 11 19:42:49.022957 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:42:49.022932    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76\": container with ID starting with 0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76 not found: ID does not exist" containerID="0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76"
Sep 11 19:42:49.023054 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:49.022961    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76"} err="failed to get container status \"0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76\": rpc error: code = NotFound desc = could not find container \"0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76\": container with ID starting with 0408d001ec5de97bbe51da97a5e84d2f3d93f1a79de6e1f9c333c8d5187b8e76 not found: ID does not exist"
Sep 11 19:42:49.026363 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:49.026341    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"]
Sep 11 19:42:49.029909 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:49.029887    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-1fc808-openshift-default-5df95644d-9chsp"]
Sep 11 19:42:50.141922 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:50.141897    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"
Sep 11 19:42:50.220547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:50.220506    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58e95d5-5633-44a5-9a16-8773b158a311-maas-api-service-ca\") pod \"f58e95d5-5633-44a5-9a16-8773b158a311\" (UID: \"f58e95d5-5633-44a5-9a16-8773b158a311\") "
Sep 11 19:42:50.220903 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:50.220884    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f58e95d5-5633-44a5-9a16-8773b158a311-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f58e95d5-5633-44a5-9a16-8773b158a311" (UID: "f58e95d5-5633-44a5-9a16-8773b158a311"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:42:50.322177 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:50.322081    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58e95d5-5633-44a5-9a16-8773b158a311-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:42:50.449181 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:50.449144    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" path="/var/lib/kubelet/pods/651e7ec9-b53b-4291-9520-555c3b4e1a97/volumes"
Sep 11 19:42:51.019851 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:51.019813    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"
Sep 11 19:42:51.020046 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:51.019844    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q" event={"ID":"f58e95d5-5633-44a5-9a16-8773b158a311","Type":"ContainerDied","Data":"26ad41ac9918a025e6054451963f9742baf3a23d871471e56623c730170d5e79"}
Sep 11 19:42:51.020046 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:42:51.019930    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26ad41ac9918a025e6054451963f9742baf3a23d871471e56623c730170d5e79"
Sep 11 19:43:03.061379 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.061333    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"]
Sep 11 19:43:03.062333 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.062256    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt" podUID="797999d1-fe1c-494d-9765-5daf8006eddc" containerName="payload-processing" containerID="cri-o://dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8" gracePeriod=30
Sep 11 19:43:03.071443 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.071415    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"]
Sep 11 19:43:03.072131 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.071908    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh" podUID="8f65d215-ae78-4710-973c-c925e0c3cbf4" containerName="payload-pre-processing" containerID="cri-o://6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2" gracePeriod=30
Sep 11 19:43:03.225055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.224990    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"]
Sep 11 19:43:03.227557 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.227530    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bed9fb-fnr5q"]
Sep 11 19:43:03.353840 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.353813    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:43:03.356624 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.356598    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:43:03.451976 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.451942    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxrkf\" (UniqueName: \"kubernetes.io/projected/8f65d215-ae78-4710-973c-c925e0c3cbf4-kube-api-access-nxrkf\") pod \"8f65d215-ae78-4710-973c-c925e0c3cbf4\" (UID: \"8f65d215-ae78-4710-973c-c925e0c3cbf4\") "
Sep 11 19:43:03.452173 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.452002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f65d215-ae78-4710-973c-c925e0c3cbf4-plugins-config-volume\") pod \"8f65d215-ae78-4710-973c-c925e0c3cbf4\" (UID: \"8f65d215-ae78-4710-973c-c925e0c3cbf4\") "
Sep 11 19:43:03.452173 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.452147    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/797999d1-fe1c-494d-9765-5daf8006eddc-plugins-config-volume\") pod \"797999d1-fe1c-494d-9765-5daf8006eddc\" (UID: \"797999d1-fe1c-494d-9765-5daf8006eddc\") "
Sep 11 19:43:03.452327 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.452181    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndmcc\" (UniqueName: \"kubernetes.io/projected/797999d1-fe1c-494d-9765-5daf8006eddc-kube-api-access-ndmcc\") pod \"797999d1-fe1c-494d-9765-5daf8006eddc\" (UID: \"797999d1-fe1c-494d-9765-5daf8006eddc\") "
Sep 11 19:43:03.452384 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.452323    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f65d215-ae78-4710-973c-c925e0c3cbf4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f65d215-ae78-4710-973c-c925e0c3cbf4" (UID: "8f65d215-ae78-4710-973c-c925e0c3cbf4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:03.452508 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.452486    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f65d215-ae78-4710-973c-c925e0c3cbf4-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:03.452549 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.452524    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/797999d1-fe1c-494d-9765-5daf8006eddc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "797999d1-fe1c-494d-9765-5daf8006eddc" (UID: "797999d1-fe1c-494d-9765-5daf8006eddc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:03.454103 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.454083    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f65d215-ae78-4710-973c-c925e0c3cbf4-kube-api-access-nxrkf" (OuterVolumeSpecName: "kube-api-access-nxrkf") pod "8f65d215-ae78-4710-973c-c925e0c3cbf4" (UID: "8f65d215-ae78-4710-973c-c925e0c3cbf4"). InnerVolumeSpecName "kube-api-access-nxrkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:03.454167 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.454137    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/797999d1-fe1c-494d-9765-5daf8006eddc-kube-api-access-ndmcc" (OuterVolumeSpecName: "kube-api-access-ndmcc") pod "797999d1-fe1c-494d-9765-5daf8006eddc" (UID: "797999d1-fe1c-494d-9765-5daf8006eddc"). InnerVolumeSpecName "kube-api-access-ndmcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:03.553222 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.553181    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/797999d1-fe1c-494d-9765-5daf8006eddc-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:03.553222 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.553218    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndmcc\" (UniqueName: \"kubernetes.io/projected/797999d1-fe1c-494d-9765-5daf8006eddc-kube-api-access-ndmcc\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:03.553222 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:03.553232    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxrkf\" (UniqueName: \"kubernetes.io/projected/8f65d215-ae78-4710-973c-c925e0c3cbf4-kube-api-access-nxrkf\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:04.104432 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.104397    2580 generic.go:356] "Generic (PLEG): container finished" podID="797999d1-fe1c-494d-9765-5daf8006eddc" containerID="dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8" exitCode=0
Sep 11 19:43:04.104800 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.104445    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"
Sep 11 19:43:04.104800 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.104490    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt" event={"ID":"797999d1-fe1c-494d-9765-5daf8006eddc","Type":"ContainerDied","Data":"dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8"}
Sep 11 19:43:04.104800 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.104541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt" event={"ID":"797999d1-fe1c-494d-9765-5daf8006eddc","Type":"ContainerDied","Data":"fe89cb1879d1762a8465e78b66c5be5627d51a7ef60af415e86e91746d490809"}
Sep 11 19:43:04.104800 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.104569    2580 scope.go:117] "RemoveContainer" containerID="dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8"
Sep 11 19:43:04.106028 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.106000    2580 generic.go:356] "Generic (PLEG): container finished" podID="8f65d215-ae78-4710-973c-c925e0c3cbf4" containerID="6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2" exitCode=0
Sep 11 19:43:04.106159 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.106041    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"
Sep 11 19:43:04.106159 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.106090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh" event={"ID":"8f65d215-ae78-4710-973c-c925e0c3cbf4","Type":"ContainerDied","Data":"6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2"}
Sep 11 19:43:04.106159 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.106148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh" event={"ID":"8f65d215-ae78-4710-973c-c925e0c3cbf4","Type":"ContainerDied","Data":"e02403c8ba1795806588d93564d78921a8f2ad35934eea3a541082bd2255006e"}
Sep 11 19:43:04.116004 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.115919    2580 scope.go:117] "RemoveContainer" containerID="dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8"
Sep 11 19:43:04.116250 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:43:04.116227    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8\": container with ID starting with dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8 not found: ID does not exist" containerID="dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8"
Sep 11 19:43:04.116338 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.116255    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8"} err="failed to get container status \"dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8\": rpc error: code = NotFound desc = could not find container \"dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8\": container with ID starting with dfdb524d6034dc2fc64cfe2ec70c6dc36b33a5dc1c6ef58839b9950512e719a8 not found: ID does not exist"
Sep 11 19:43:04.116338 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.116271    2580 scope.go:117] "RemoveContainer" containerID="6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2"
Sep 11 19:43:04.124729 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.124649    2580 scope.go:117] "RemoveContainer" containerID="6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2"
Sep 11 19:43:04.125030 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:43:04.125003    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2\": container with ID starting with 6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2 not found: ID does not exist" containerID="6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2"
Sep 11 19:43:04.125139 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.125039    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2"} err="failed to get container status \"6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2\": rpc error: code = NotFound desc = could not find container \"6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2\": container with ID starting with 6ef7de8d132438853a56f023340a8503047b85c0e47a6e686dca5bb859eb47c2 not found: ID does not exist"
Sep 11 19:43:04.128468 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.128446    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"]
Sep 11 19:43:04.131076 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.131055    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bed9fb-75d66d6bdc-sk4zt"]
Sep 11 19:43:04.139756 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.139735    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"]
Sep 11 19:43:04.141967 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.141947    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bed9fb-6c84775bdb-g5xrh"]
Sep 11 19:43:04.450225 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.450182    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="797999d1-fe1c-494d-9765-5daf8006eddc" path="/var/lib/kubelet/pods/797999d1-fe1c-494d-9765-5daf8006eddc/volumes"
Sep 11 19:43:04.450695 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.450673    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f65d215-ae78-4710-973c-c925e0c3cbf4" path="/var/lib/kubelet/pods/8f65d215-ae78-4710-973c-c925e0c3cbf4/volumes"
Sep 11 19:43:04.451067 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:04.451048    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f58e95d5-5633-44a5-9a16-8773b158a311" path="/var/lib/kubelet/pods/f58e95d5-5633-44a5-9a16-8773b158a311/volumes"
Sep 11 19:43:10.100621 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.100584    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"]
Sep 11 19:43:10.101001 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.100989    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f65d215-ae78-4710-973c-c925e0c3cbf4" containerName="payload-pre-processing"
Sep 11 19:43:10.101001 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101001    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f65d215-ae78-4710-973c-c925e0c3cbf4" containerName="payload-pre-processing"
Sep 11 19:43:10.101077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101011    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy"
Sep 11 19:43:10.101077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101017    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy"
Sep 11 19:43:10.101077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101023    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="797999d1-fe1c-494d-9765-5daf8006eddc" containerName="payload-processing"
Sep 11 19:43:10.101077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101030    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="797999d1-fe1c-494d-9765-5daf8006eddc" containerName="payload-processing"
Sep 11 19:43:10.101077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101041    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy"
Sep 11 19:43:10.101077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101047    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy"
Sep 11 19:43:10.101077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101058    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58e95d5-5633-44a5-9a16-8773b158a311" containerName="revoke-keys"
Sep 11 19:43:10.101077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101063    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58e95d5-5633-44a5-9a16-8773b158a311" containerName="revoke-keys"
Sep 11 19:43:10.101369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101135    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy"
Sep 11 19:43:10.101369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101143    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="797999d1-fe1c-494d-9765-5daf8006eddc" containerName="payload-processing"
Sep 11 19:43:10.101369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101150    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="651e7ec9-b53b-4291-9520-555c3b4e1a97" containerName="istio-proxy"
Sep 11 19:43:10.101369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101157    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58e95d5-5633-44a5-9a16-8773b158a311" containerName="revoke-keys"
Sep 11 19:43:10.101369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.101163    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f65d215-ae78-4710-973c-c925e0c3cbf4" containerName="payload-pre-processing"
Sep 11 19:43:10.105693 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.105674    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"
Sep 11 19:43:10.108182 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.108153    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:43:10.108338 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.108255    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:43:10.110669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.110644    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"]
Sep 11 19:43:10.219459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.219422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe28d87-da0d-4791-8843-33a874e24d94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-491be8-vgmb8\" (UID: \"afe28d87-da0d-4791-8843-33a874e24d94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"
Sep 11 19:43:10.320592 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.320546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe28d87-da0d-4791-8843-33a874e24d94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-491be8-vgmb8\" (UID: \"afe28d87-da0d-4791-8843-33a874e24d94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"
Sep 11 19:43:10.321207 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.321183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe28d87-da0d-4791-8843-33a874e24d94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-491be8-vgmb8\" (UID: \"afe28d87-da0d-4791-8843-33a874e24d94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"
Sep 11 19:43:10.418791 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.418701    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"
Sep 11 19:43:10.694378 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:10.694350    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"]
Sep 11 19:43:10.696042 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:43:10.696009    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe28d87_da0d_4791_8843_33a874e24d94.slice/crio-51dab4f0d31b84cb620d7c4ce67de5ab55278e9d5413991b17c6b3e1dd617fd8 WatchSource:0}: Error finding container 51dab4f0d31b84cb620d7c4ce67de5ab55278e9d5413991b17c6b3e1dd617fd8: Status 404 returned error can't find the container with id 51dab4f0d31b84cb620d7c4ce67de5ab55278e9d5413991b17c6b3e1dd617fd8
Sep 11 19:43:11.155251 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:11.155205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8" event={"ID":"afe28d87-da0d-4791-8843-33a874e24d94","Type":"ContainerStarted","Data":"ea122379a18c55eda18a40cc9ee9cdbfbd07e7f5a63a6990b962f9ed56e5025e"}
Sep 11 19:43:11.155725 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:11.155271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8" event={"ID":"afe28d87-da0d-4791-8843-33a874e24d94","Type":"ContainerStarted","Data":"51dab4f0d31b84cb620d7c4ce67de5ab55278e9d5413991b17c6b3e1dd617fd8"}
Sep 11 19:43:11.185298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:11.185225    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8" podStartSLOduration=1.185209263 podStartE2EDuration="1.185209263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:43:11.184622411 +0000 UTC m=+1491.205830562" watchObservedRunningTime="2026-09-11 19:43:11.185209263 +0000 UTC m=+1491.206417413"
Sep 11 19:43:12.162464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:12.162428    2580 generic.go:356] "Generic (PLEG): container finished" podID="afe28d87-da0d-4791-8843-33a874e24d94" containerID="ea122379a18c55eda18a40cc9ee9cdbfbd07e7f5a63a6990b962f9ed56e5025e" exitCode=0
Sep 11 19:43:12.162878 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:12.162514    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8" event={"ID":"afe28d87-da0d-4791-8843-33a874e24d94","Type":"ContainerDied","Data":"ea122379a18c55eda18a40cc9ee9cdbfbd07e7f5a63a6990b962f9ed56e5025e"}
Sep 11 19:43:13.304006 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:13.303981    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"
Sep 11 19:43:13.452725 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:13.452692    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe28d87-da0d-4791-8843-33a874e24d94-maas-api-service-ca\") pod \"afe28d87-da0d-4791-8843-33a874e24d94\" (UID: \"afe28d87-da0d-4791-8843-33a874e24d94\") "
Sep 11 19:43:13.453035 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:13.453013    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afe28d87-da0d-4791-8843-33a874e24d94-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "afe28d87-da0d-4791-8843-33a874e24d94" (UID: "afe28d87-da0d-4791-8843-33a874e24d94"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:13.554392 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:13.554356    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe28d87-da0d-4791-8843-33a874e24d94-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:14.175863 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:14.175829    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"
Sep 11 19:43:14.176034 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:14.175870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8" event={"ID":"afe28d87-da0d-4791-8843-33a874e24d94","Type":"ContainerDied","Data":"51dab4f0d31b84cb620d7c4ce67de5ab55278e9d5413991b17c6b3e1dd617fd8"}
Sep 11 19:43:14.176034 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:14.175917    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51dab4f0d31b84cb620d7c4ce67de5ab55278e9d5413991b17c6b3e1dd617fd8"
Sep 11 19:43:20.518438 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:20.518410    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:43:20.523854 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:20.523831    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:43:20.753233 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:20.753198    2580 scope.go:117] "RemoveContainer" containerID="9d763b4118bfc449ba6f9adb3b6934eaa98671d94324b366e22cd399133e59cf"
Sep 11 19:43:25.714573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:25.714531    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"]
Sep 11 19:43:25.715017 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:25.714792    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6" podUID="cd30780a-2210-4e38-b32a-c0857dfa55f7" containerName="payload-processing" containerID="cri-o://9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba" gracePeriod=30
Sep 11 19:43:25.724250 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:25.724223    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"]
Sep 11 19:43:25.724552 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:25.724504    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx" podUID="66323d6a-5db6-4bb4-b657-f485673360df" containerName="payload-pre-processing" containerID="cri-o://60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7" gracePeriod=30
Sep 11 19:43:25.879404 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:25.879369    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"]
Sep 11 19:43:25.881888 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:25.881845    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-491be8-vgmb8"]
Sep 11 19:43:26.005048 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.005023    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:43:26.007808 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.007791    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:43:26.078373 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.078341    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66323d6a-5db6-4bb4-b657-f485673360df-plugins-config-volume\") pod \"66323d6a-5db6-4bb4-b657-f485673360df\" (UID: \"66323d6a-5db6-4bb4-b657-f485673360df\") "
Sep 11 19:43:26.078541 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.078388    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lcb4\" (UniqueName: \"kubernetes.io/projected/66323d6a-5db6-4bb4-b657-f485673360df-kube-api-access-7lcb4\") pod \"66323d6a-5db6-4bb4-b657-f485673360df\" (UID: \"66323d6a-5db6-4bb4-b657-f485673360df\") "
Sep 11 19:43:26.078541 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.078416    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd30780a-2210-4e38-b32a-c0857dfa55f7-plugins-config-volume\") pod \"cd30780a-2210-4e38-b32a-c0857dfa55f7\" (UID: \"cd30780a-2210-4e38-b32a-c0857dfa55f7\") "
Sep 11 19:43:26.078541 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.078446    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbghf\" (UniqueName: \"kubernetes.io/projected/cd30780a-2210-4e38-b32a-c0857dfa55f7-kube-api-access-mbghf\") pod \"cd30780a-2210-4e38-b32a-c0857dfa55f7\" (UID: \"cd30780a-2210-4e38-b32a-c0857dfa55f7\") "
Sep 11 19:43:26.078716 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.078693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66323d6a-5db6-4bb4-b657-f485673360df-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "66323d6a-5db6-4bb4-b657-f485673360df" (UID: "66323d6a-5db6-4bb4-b657-f485673360df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:26.078802 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.078777    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd30780a-2210-4e38-b32a-c0857dfa55f7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd30780a-2210-4e38-b32a-c0857dfa55f7" (UID: "cd30780a-2210-4e38-b32a-c0857dfa55f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:26.078874 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.078787    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66323d6a-5db6-4bb4-b657-f485673360df-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:26.080590 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.080563    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd30780a-2210-4e38-b32a-c0857dfa55f7-kube-api-access-mbghf" (OuterVolumeSpecName: "kube-api-access-mbghf") pod "cd30780a-2210-4e38-b32a-c0857dfa55f7" (UID: "cd30780a-2210-4e38-b32a-c0857dfa55f7"). InnerVolumeSpecName "kube-api-access-mbghf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:26.080714 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.080612    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66323d6a-5db6-4bb4-b657-f485673360df-kube-api-access-7lcb4" (OuterVolumeSpecName: "kube-api-access-7lcb4") pod "66323d6a-5db6-4bb4-b657-f485673360df" (UID: "66323d6a-5db6-4bb4-b657-f485673360df"). InnerVolumeSpecName "kube-api-access-7lcb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:26.179406 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.179371    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lcb4\" (UniqueName: \"kubernetes.io/projected/66323d6a-5db6-4bb4-b657-f485673360df-kube-api-access-7lcb4\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:26.179406 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.179399    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd30780a-2210-4e38-b32a-c0857dfa55f7-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:26.179406 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.179408    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbghf\" (UniqueName: \"kubernetes.io/projected/cd30780a-2210-4e38-b32a-c0857dfa55f7-kube-api-access-mbghf\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:26.258785 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.258697    2580 generic.go:356] "Generic (PLEG): container finished" podID="cd30780a-2210-4e38-b32a-c0857dfa55f7" containerID="9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba" exitCode=0
Sep 11 19:43:26.258785 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.258735    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"
Sep 11 19:43:26.258978 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.258785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6" event={"ID":"cd30780a-2210-4e38-b32a-c0857dfa55f7","Type":"ContainerDied","Data":"9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba"}
Sep 11 19:43:26.258978 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.258833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6" event={"ID":"cd30780a-2210-4e38-b32a-c0857dfa55f7","Type":"ContainerDied","Data":"a328b73e1f8616589f7c80b75067daa810d6365f86a440b7841fc412017ddac0"}
Sep 11 19:43:26.258978 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.258859    2580 scope.go:117] "RemoveContainer" containerID="9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba"
Sep 11 19:43:26.260185 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.260162    2580 generic.go:356] "Generic (PLEG): container finished" podID="66323d6a-5db6-4bb4-b657-f485673360df" containerID="60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7" exitCode=0
Sep 11 19:43:26.260335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.260215    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"
Sep 11 19:43:26.260335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.260253    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx" event={"ID":"66323d6a-5db6-4bb4-b657-f485673360df","Type":"ContainerDied","Data":"60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7"}
Sep 11 19:43:26.260335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.260317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx" event={"ID":"66323d6a-5db6-4bb4-b657-f485673360df","Type":"ContainerDied","Data":"c4fa2b03d0afb9d63529084421a0c664f52b6f53608d82a89662795903450c23"}
Sep 11 19:43:26.269070 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.269053    2580 scope.go:117] "RemoveContainer" containerID="9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba"
Sep 11 19:43:26.269404 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:43:26.269383    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba\": container with ID starting with 9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba not found: ID does not exist" containerID="9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba"
Sep 11 19:43:26.269474 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.269419    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba"} err="failed to get container status \"9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba\": rpc error: code = NotFound desc = could not find container \"9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba\": container with ID starting with 9050b8f98030b43a8019901f678c1637c5bb31d6c2bb807bace35cc478191bba not found: ID does not exist"
Sep 11 19:43:26.269474 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.269444    2580 scope.go:117] "RemoveContainer" containerID="60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7"
Sep 11 19:43:26.278134 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.278118    2580 scope.go:117] "RemoveContainer" containerID="60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7"
Sep 11 19:43:26.278430 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:43:26.278409    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7\": container with ID starting with 60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7 not found: ID does not exist" containerID="60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7"
Sep 11 19:43:26.278494 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.278441    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7"} err="failed to get container status \"60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7\": rpc error: code = NotFound desc = could not find container \"60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7\": container with ID starting with 60731b7b71454f91c9cb3241e7745f6a6d75a713cf1502e8055b2d65a9d094a7 not found: ID does not exist"
Sep 11 19:43:26.285974 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.285949    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"]
Sep 11 19:43:26.292167 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.292146    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-491be8-85d5db99d-jbrdx"]
Sep 11 19:43:26.301121 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.301102    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"]
Sep 11 19:43:26.306746 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.306724    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-491be8-87f976dbc-jsck6"]
Sep 11 19:43:26.449515 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.449482    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66323d6a-5db6-4bb4-b657-f485673360df" path="/var/lib/kubelet/pods/66323d6a-5db6-4bb4-b657-f485673360df/volumes"
Sep 11 19:43:26.449883 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.449866    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afe28d87-da0d-4791-8843-33a874e24d94" path="/var/lib/kubelet/pods/afe28d87-da0d-4791-8843-33a874e24d94/volumes"
Sep 11 19:43:26.450229 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:26.450216    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd30780a-2210-4e38-b32a-c0857dfa55f7" path="/var/lib/kubelet/pods/cd30780a-2210-4e38-b32a-c0857dfa55f7/volumes"
Sep 11 19:43:33.019491 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.019455    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"]
Sep 11 19:43:33.019875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.019830    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe28d87-da0d-4791-8843-33a874e24d94" containerName="revoke-keys"
Sep 11 19:43:33.019875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.019841    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe28d87-da0d-4791-8843-33a874e24d94" containerName="revoke-keys"
Sep 11 19:43:33.019875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.019862    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd30780a-2210-4e38-b32a-c0857dfa55f7" containerName="payload-processing"
Sep 11 19:43:33.019875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.019868    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd30780a-2210-4e38-b32a-c0857dfa55f7" containerName="payload-processing"
Sep 11 19:43:33.019875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.019875    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66323d6a-5db6-4bb4-b657-f485673360df" containerName="payload-pre-processing"
Sep 11 19:43:33.020036 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.019881    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="66323d6a-5db6-4bb4-b657-f485673360df" containerName="payload-pre-processing"
Sep 11 19:43:33.020036 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.019939    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="66323d6a-5db6-4bb4-b657-f485673360df" containerName="payload-pre-processing"
Sep 11 19:43:33.020036 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.019946    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="afe28d87-da0d-4791-8843-33a874e24d94" containerName="revoke-keys"
Sep 11 19:43:33.020036 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.019953    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd30780a-2210-4e38-b32a-c0857dfa55f7" containerName="payload-processing"
Sep 11 19:43:33.024410 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.024393    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"
Sep 11 19:43:33.027245 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.027219    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:43:33.027427 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.027268    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:43:33.029608 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.029587    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"]
Sep 11 19:43:33.145027 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.144988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d42489d0-99d1-4ab0-a36e-c608d38956e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c\" (UID: \"d42489d0-99d1-4ab0-a36e-c608d38956e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"
Sep 11 19:43:33.246496 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.246442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d42489d0-99d1-4ab0-a36e-c608d38956e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c\" (UID: \"d42489d0-99d1-4ab0-a36e-c608d38956e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"
Sep 11 19:43:33.247090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.247066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d42489d0-99d1-4ab0-a36e-c608d38956e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c\" (UID: \"d42489d0-99d1-4ab0-a36e-c608d38956e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"
Sep 11 19:43:33.337045 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.336958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"
Sep 11 19:43:33.611088 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:33.611060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"]
Sep 11 19:43:33.612465 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:43:33.612437    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42489d0_99d1_4ab0_a36e_c608d38956e6.slice/crio-5d0598fdc7a7b7b72b10dc52bac175a310cdc05a63e5f9f53176b40e96e80d40 WatchSource:0}: Error finding container 5d0598fdc7a7b7b72b10dc52bac175a310cdc05a63e5f9f53176b40e96e80d40: Status 404 returned error can't find the container with id 5d0598fdc7a7b7b72b10dc52bac175a310cdc05a63e5f9f53176b40e96e80d40
Sep 11 19:43:34.310198 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:34.310169    2580 generic.go:356] "Generic (PLEG): container finished" podID="d42489d0-99d1-4ab0-a36e-c608d38956e6" containerID="4b63bf41b991e945f48de922c83d1646f3f3c80ef6269f0b16d24c27834387af" exitCode=0
Sep 11 19:43:34.310600 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:34.310253    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c" event={"ID":"d42489d0-99d1-4ab0-a36e-c608d38956e6","Type":"ContainerDied","Data":"4b63bf41b991e945f48de922c83d1646f3f3c80ef6269f0b16d24c27834387af"}
Sep 11 19:43:34.310600 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:34.310326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c" event={"ID":"d42489d0-99d1-4ab0-a36e-c608d38956e6","Type":"ContainerStarted","Data":"5d0598fdc7a7b7b72b10dc52bac175a310cdc05a63e5f9f53176b40e96e80d40"}
Sep 11 19:43:35.439567 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:35.439540    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"
Sep 11 19:43:35.571947 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:35.571864    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d42489d0-99d1-4ab0-a36e-c608d38956e6-maas-api-service-ca\") pod \"d42489d0-99d1-4ab0-a36e-c608d38956e6\" (UID: \"d42489d0-99d1-4ab0-a36e-c608d38956e6\") "
Sep 11 19:43:35.572257 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:35.572235    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42489d0-99d1-4ab0-a36e-c608d38956e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d42489d0-99d1-4ab0-a36e-c608d38956e6" (UID: "d42489d0-99d1-4ab0-a36e-c608d38956e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:35.673222 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:35.673183    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d42489d0-99d1-4ab0-a36e-c608d38956e6-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:36.323470 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:36.323430    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c" event={"ID":"d42489d0-99d1-4ab0-a36e-c608d38956e6","Type":"ContainerDied","Data":"5d0598fdc7a7b7b72b10dc52bac175a310cdc05a63e5f9f53176b40e96e80d40"}
Sep 11 19:43:36.323470 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:36.323465    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"
Sep 11 19:43:36.323693 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:36.323491    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d0598fdc7a7b7b72b10dc52bac175a310cdc05a63e5f9f53176b40e96e80d40"
Sep 11 19:43:43.688524 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:43.688435    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"]
Sep 11 19:43:43.688958 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:43.688708    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s" podUID="6264aa67-c496-490c-8b47-16cabffeb157" containerName="payload-processing" containerID="cri-o://c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959" gracePeriod=30
Sep 11 19:43:43.703027 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:43.702996    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"]
Sep 11 19:43:43.703236 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:43.703209    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4" podUID="93b00f44-75c2-4170-baaf-f48d77f9dae3" containerName="payload-pre-processing" containerID="cri-o://e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb" gracePeriod=30
Sep 11 19:43:43.855532 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:43.855458    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"]
Sep 11 19:43:43.857924 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:43.857864    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-b5bf35-cq97c"]
Sep 11 19:43:43.973495 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:43.973471    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:43:43.976183 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:43.976162    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:43:44.056488 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.056452    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt7lw\" (UniqueName: \"kubernetes.io/projected/6264aa67-c496-490c-8b47-16cabffeb157-kube-api-access-xt7lw\") pod \"6264aa67-c496-490c-8b47-16cabffeb157\" (UID: \"6264aa67-c496-490c-8b47-16cabffeb157\") "
Sep 11 19:43:44.056685 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.056532    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93b00f44-75c2-4170-baaf-f48d77f9dae3-plugins-config-volume\") pod \"93b00f44-75c2-4170-baaf-f48d77f9dae3\" (UID: \"93b00f44-75c2-4170-baaf-f48d77f9dae3\") "
Sep 11 19:43:44.056685 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.056584    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s92qw\" (UniqueName: \"kubernetes.io/projected/93b00f44-75c2-4170-baaf-f48d77f9dae3-kube-api-access-s92qw\") pod \"93b00f44-75c2-4170-baaf-f48d77f9dae3\" (UID: \"93b00f44-75c2-4170-baaf-f48d77f9dae3\") "
Sep 11 19:43:44.056685 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.056617    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6264aa67-c496-490c-8b47-16cabffeb157-plugins-config-volume\") pod \"6264aa67-c496-490c-8b47-16cabffeb157\" (UID: \"6264aa67-c496-490c-8b47-16cabffeb157\") "
Sep 11 19:43:44.056964 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.056938    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93b00f44-75c2-4170-baaf-f48d77f9dae3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "93b00f44-75c2-4170-baaf-f48d77f9dae3" (UID: "93b00f44-75c2-4170-baaf-f48d77f9dae3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:44.057072 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.057046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6264aa67-c496-490c-8b47-16cabffeb157-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6264aa67-c496-490c-8b47-16cabffeb157" (UID: "6264aa67-c496-490c-8b47-16cabffeb157"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:44.058823 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.058794    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b00f44-75c2-4170-baaf-f48d77f9dae3-kube-api-access-s92qw" (OuterVolumeSpecName: "kube-api-access-s92qw") pod "93b00f44-75c2-4170-baaf-f48d77f9dae3" (UID: "93b00f44-75c2-4170-baaf-f48d77f9dae3"). InnerVolumeSpecName "kube-api-access-s92qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:44.058941 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.058886    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6264aa67-c496-490c-8b47-16cabffeb157-kube-api-access-xt7lw" (OuterVolumeSpecName: "kube-api-access-xt7lw") pod "6264aa67-c496-490c-8b47-16cabffeb157" (UID: "6264aa67-c496-490c-8b47-16cabffeb157"). InnerVolumeSpecName "kube-api-access-xt7lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:44.157528 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.157480    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt7lw\" (UniqueName: \"kubernetes.io/projected/6264aa67-c496-490c-8b47-16cabffeb157-kube-api-access-xt7lw\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:44.157528 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.157522    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93b00f44-75c2-4170-baaf-f48d77f9dae3-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:44.157528 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.157532    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s92qw\" (UniqueName: \"kubernetes.io/projected/93b00f44-75c2-4170-baaf-f48d77f9dae3-kube-api-access-s92qw\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:44.157528 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.157540    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6264aa67-c496-490c-8b47-16cabffeb157-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:44.374303 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.374195    2580 generic.go:356] "Generic (PLEG): container finished" podID="6264aa67-c496-490c-8b47-16cabffeb157" containerID="c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959" exitCode=0
Sep 11 19:43:44.374303 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.374236    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"
Sep 11 19:43:44.374547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.374308    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s" event={"ID":"6264aa67-c496-490c-8b47-16cabffeb157","Type":"ContainerDied","Data":"c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959"}
Sep 11 19:43:44.374547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.374373    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s" event={"ID":"6264aa67-c496-490c-8b47-16cabffeb157","Type":"ContainerDied","Data":"567f3a9f2d4e4d895168e201e3b1fe917d9f633ab4149d6f1d0f93ab45e1ca54"}
Sep 11 19:43:44.374547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.374403    2580 scope.go:117] "RemoveContainer" containerID="c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959"
Sep 11 19:43:44.375796 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.375776    2580 generic.go:356] "Generic (PLEG): container finished" podID="93b00f44-75c2-4170-baaf-f48d77f9dae3" containerID="e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb" exitCode=0
Sep 11 19:43:44.375865 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.375826    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"
Sep 11 19:43:44.375943 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.375919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4" event={"ID":"93b00f44-75c2-4170-baaf-f48d77f9dae3","Type":"ContainerDied","Data":"e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb"}
Sep 11 19:43:44.375983 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.375973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4" event={"ID":"93b00f44-75c2-4170-baaf-f48d77f9dae3","Type":"ContainerDied","Data":"8cd5c625eb891d733e38ee52491f599cb49e1fdda6d0d8d8d007131c13b518d8"}
Sep 11 19:43:44.384000 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.383983    2580 scope.go:117] "RemoveContainer" containerID="c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959"
Sep 11 19:43:44.384368 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:43:44.384346    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959\": container with ID starting with c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959 not found: ID does not exist" containerID="c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959"
Sep 11 19:43:44.384474 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.384375    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959"} err="failed to get container status \"c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959\": rpc error: code = NotFound desc = could not find container \"c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959\": container with ID starting with c830842a80d1ad24e873386a89d90d2f340465f9b48b5f5f4bb30c5f7934c959 not found: ID does not exist"
Sep 11 19:43:44.384474 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.384393    2580 scope.go:117] "RemoveContainer" containerID="e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb"
Sep 11 19:43:44.392944 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.392923    2580 scope.go:117] "RemoveContainer" containerID="e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb"
Sep 11 19:43:44.393198 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:43:44.393180    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb\": container with ID starting with e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb not found: ID does not exist" containerID="e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb"
Sep 11 19:43:44.393261 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.393205    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb"} err="failed to get container status \"e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb\": rpc error: code = NotFound desc = could not find container \"e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb\": container with ID starting with e06eb1a87f0190752af66f735bf59df028a733c8951ef7ed1c014f3557cdffcb not found: ID does not exist"
Sep 11 19:43:44.400603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.400581    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"]
Sep 11 19:43:44.403008 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.402987    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-b5bf35-f7756b58c-qmr7s"]
Sep 11 19:43:44.412745 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.412724    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"]
Sep 11 19:43:44.416917 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.416898    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b5bf35-7f9578895d-gwtv4"]
Sep 11 19:43:44.448720 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.448686    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6264aa67-c496-490c-8b47-16cabffeb157" path="/var/lib/kubelet/pods/6264aa67-c496-490c-8b47-16cabffeb157/volumes"
Sep 11 19:43:44.449142 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.449120    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93b00f44-75c2-4170-baaf-f48d77f9dae3" path="/var/lib/kubelet/pods/93b00f44-75c2-4170-baaf-f48d77f9dae3/volumes"
Sep 11 19:43:44.449546 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:44.449526    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42489d0-99d1-4ab0-a36e-c608d38956e6" path="/var/lib/kubelet/pods/d42489d0-99d1-4ab0-a36e-c608d38956e6/volumes"
Sep 11 19:43:50.566489 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.566448    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"]
Sep 11 19:43:50.566858 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.566841    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6264aa67-c496-490c-8b47-16cabffeb157" containerName="payload-processing"
Sep 11 19:43:50.566858 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.566855    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6264aa67-c496-490c-8b47-16cabffeb157" containerName="payload-processing"
Sep 11 19:43:50.566929 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.566866    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42489d0-99d1-4ab0-a36e-c608d38956e6" containerName="revoke-keys"
Sep 11 19:43:50.566929 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.566871    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42489d0-99d1-4ab0-a36e-c608d38956e6" containerName="revoke-keys"
Sep 11 19:43:50.566929 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.566880    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b00f44-75c2-4170-baaf-f48d77f9dae3" containerName="payload-pre-processing"
Sep 11 19:43:50.566929 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.566887    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b00f44-75c2-4170-baaf-f48d77f9dae3" containerName="payload-pre-processing"
Sep 11 19:43:50.567055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.566955    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="93b00f44-75c2-4170-baaf-f48d77f9dae3" containerName="payload-pre-processing"
Sep 11 19:43:50.567055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.566965    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6264aa67-c496-490c-8b47-16cabffeb157" containerName="payload-processing"
Sep 11 19:43:50.567055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.566973    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42489d0-99d1-4ab0-a36e-c608d38956e6" containerName="revoke-keys"
Sep 11 19:43:50.571429 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.571410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"
Sep 11 19:43:50.573628 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.573607    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:43:50.573717 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.573625    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:43:50.578353 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.578330    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"]
Sep 11 19:43:50.717947 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.717912    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fa52a3-399d-4922-aa6e-a4919844ffee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv\" (UID: \"66fa52a3-399d-4922-aa6e-a4919844ffee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"
Sep 11 19:43:50.818768 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.818679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fa52a3-399d-4922-aa6e-a4919844ffee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv\" (UID: \"66fa52a3-399d-4922-aa6e-a4919844ffee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"
Sep 11 19:43:50.819384 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.819361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fa52a3-399d-4922-aa6e-a4919844ffee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv\" (UID: \"66fa52a3-399d-4922-aa6e-a4919844ffee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"
Sep 11 19:43:50.883999 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:50.883960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"
Sep 11 19:43:51.155051 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:51.154885    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"]
Sep 11 19:43:51.157745 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:43:51.157714    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fa52a3_399d_4922_aa6e_a4919844ffee.slice/crio-61e2b9d12b8296b7869470588ce37e96cfa44e9a1238f450ede3fd15685841fa WatchSource:0}: Error finding container 61e2b9d12b8296b7869470588ce37e96cfa44e9a1238f450ede3fd15685841fa: Status 404 returned error can't find the container with id 61e2b9d12b8296b7869470588ce37e96cfa44e9a1238f450ede3fd15685841fa
Sep 11 19:43:51.418915 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:51.418880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv" event={"ID":"66fa52a3-399d-4922-aa6e-a4919844ffee","Type":"ContainerStarted","Data":"61e2b9d12b8296b7869470588ce37e96cfa44e9a1238f450ede3fd15685841fa"}
Sep 11 19:43:52.425963 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:52.425923    2580 generic.go:356] "Generic (PLEG): container finished" podID="66fa52a3-399d-4922-aa6e-a4919844ffee" containerID="2de9e2a7462ff1b236bfbcc283f61c7a7c377e8d1b3def75568f6e747ae47be3" exitCode=0
Sep 11 19:43:52.426416 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:52.426003    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv" event={"ID":"66fa52a3-399d-4922-aa6e-a4919844ffee","Type":"ContainerDied","Data":"2de9e2a7462ff1b236bfbcc283f61c7a7c377e8d1b3def75568f6e747ae47be3"}
Sep 11 19:43:53.556994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:53.556967    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"
Sep 11 19:43:53.645095 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:53.645062    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fa52a3-399d-4922-aa6e-a4919844ffee-maas-api-service-ca\") pod \"66fa52a3-399d-4922-aa6e-a4919844ffee\" (UID: \"66fa52a3-399d-4922-aa6e-a4919844ffee\") "
Sep 11 19:43:53.645476 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:53.645454    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66fa52a3-399d-4922-aa6e-a4919844ffee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "66fa52a3-399d-4922-aa6e-a4919844ffee" (UID: "66fa52a3-399d-4922-aa6e-a4919844ffee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:53.746066 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:53.745989    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fa52a3-399d-4922-aa6e-a4919844ffee-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:43:54.438038 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:54.438007    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"
Sep 11 19:43:54.438205 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:54.438051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv" event={"ID":"66fa52a3-399d-4922-aa6e-a4919844ffee","Type":"ContainerDied","Data":"61e2b9d12b8296b7869470588ce37e96cfa44e9a1238f450ede3fd15685841fa"}
Sep 11 19:43:54.438205 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:43:54.438108    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61e2b9d12b8296b7869470588ce37e96cfa44e9a1238f450ede3fd15685841fa"
Sep 11 19:44:01.280036 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:01.279999    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"]
Sep 11 19:44:01.282160 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:01.282148    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b20815-p97rv"]
Sep 11 19:44:02.449293 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:02.449240    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66fa52a3-399d-4922-aa6e-a4919844ffee" path="/var/lib/kubelet/pods/66fa52a3-399d-4922-aa6e-a4919844ffee/volumes"
Sep 11 19:44:02.901251 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:02.901168    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7801-e3f537"]
Sep 11 19:44:02.901571 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:02.901558    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fa52a3-399d-4922-aa6e-a4919844ffee" containerName="revoke-keys"
Sep 11 19:44:02.901616 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:02.901572    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fa52a3-399d-4922-aa6e-a4919844ffee" containerName="revoke-keys"
Sep 11 19:44:02.901652 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:02.901640    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="66fa52a3-399d-4922-aa6e-a4919844ffee" containerName="revoke-keys"
Sep 11 19:44:02.904629 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:02.904611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-e3f537"
Sep 11 19:44:02.906815 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:02.906795    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-v69wf\""
Sep 11 19:44:02.910875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:02.910853    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7801-e3f537"]
Sep 11 19:44:02.929119 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:02.929089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvvl\" (UniqueName: \"kubernetes.io/projected/95dfe324-a7a4-4ab0-91da-87a832a4f982-kube-api-access-zmvvl\") pod \"test-curl-7801-e3f537\" (UID: \"95dfe324-a7a4-4ab0-91da-87a832a4f982\") " pod="opendatahub/test-curl-7801-e3f537"
Sep 11 19:44:03.030312 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:03.030261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvvl\" (UniqueName: \"kubernetes.io/projected/95dfe324-a7a4-4ab0-91da-87a832a4f982-kube-api-access-zmvvl\") pod \"test-curl-7801-e3f537\" (UID: \"95dfe324-a7a4-4ab0-91da-87a832a4f982\") " pod="opendatahub/test-curl-7801-e3f537"
Sep 11 19:44:03.037674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:03.037650    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvvl\" (UniqueName: \"kubernetes.io/projected/95dfe324-a7a4-4ab0-91da-87a832a4f982-kube-api-access-zmvvl\") pod \"test-curl-7801-e3f537\" (UID: \"95dfe324-a7a4-4ab0-91da-87a832a4f982\") " pod="opendatahub/test-curl-7801-e3f537"
Sep 11 19:44:03.214997 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:03.214967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-e3f537"
Sep 11 19:44:03.484058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:03.484030    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7801-e3f537"]
Sep 11 19:44:03.486080 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:44:03.486050    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95dfe324_a7a4_4ab0_91da_87a832a4f982.slice/crio-e22b5f95ae36d9e1600daffa18fe7c2cdf0be569df503b138e2f968ac703203f WatchSource:0}: Error finding container e22b5f95ae36d9e1600daffa18fe7c2cdf0be569df503b138e2f968ac703203f: Status 404 returned error can't find the container with id e22b5f95ae36d9e1600daffa18fe7c2cdf0be569df503b138e2f968ac703203f
Sep 11 19:44:03.488335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:03.488276    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:44:04.496698 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:04.496661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7801-e3f537" event={"ID":"95dfe324-a7a4-4ab0-91da-87a832a4f982","Type":"ContainerStarted","Data":"8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94"}
Sep 11 19:44:04.497042 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:04.496710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7801-e3f537" event={"ID":"95dfe324-a7a4-4ab0-91da-87a832a4f982","Type":"ContainerStarted","Data":"e22b5f95ae36d9e1600daffa18fe7c2cdf0be569df503b138e2f968ac703203f"}
Sep 11 19:44:04.513310 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:04.513242    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7801-e3f537" podStartSLOduration=1.583476606 podStartE2EDuration="2.513226488s" totalImagesPullingTime="929.749882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:44:04.511039434 +0000 UTC m=+1544.532247596" watchObservedRunningTime="2026-09-11 19:44:04.513226488 +0000 UTC m=+1544.534434637"
Sep 11 19:44:05.098932 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:05.098895    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7801-e3f537"]
Sep 11 19:44:05.102895 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:05.102867    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7801-e3f537"]
Sep 11 19:44:05.502519 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:44:05.502483    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7801-e3f537" container="test-curl-7801-e3f537"
Sep 11 19:44:06.508653 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:06.508615    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7801-e3f537" podUID="95dfe324-a7a4-4ab0-91da-87a832a4f982" containerName="test-curl-7801-e3f537" containerID="cri-o://8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94" gracePeriod=2
Sep 11 19:44:08.646070 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:08.646040    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-e3f537"
Sep 11 19:44:08.684908 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:08.684877    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmvvl\" (UniqueName: \"kubernetes.io/projected/95dfe324-a7a4-4ab0-91da-87a832a4f982-kube-api-access-zmvvl\") pod \"95dfe324-a7a4-4ab0-91da-87a832a4f982\" (UID: \"95dfe324-a7a4-4ab0-91da-87a832a4f982\") "
Sep 11 19:44:08.686904 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:08.686881    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95dfe324-a7a4-4ab0-91da-87a832a4f982-kube-api-access-zmvvl" (OuterVolumeSpecName: "kube-api-access-zmvvl") pod "95dfe324-a7a4-4ab0-91da-87a832a4f982" (UID: "95dfe324-a7a4-4ab0-91da-87a832a4f982"). InnerVolumeSpecName "kube-api-access-zmvvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:44:08.786108 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:08.786021    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmvvl\" (UniqueName: \"kubernetes.io/projected/95dfe324-a7a4-4ab0-91da-87a832a4f982-kube-api-access-zmvvl\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:44:09.528349 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:09.528316    2580 generic.go:356] "Generic (PLEG): container finished" podID="95dfe324-a7a4-4ab0-91da-87a832a4f982" containerID="8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94" exitCode=137
Sep 11 19:44:09.528543 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:09.528353    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-e3f537"
Sep 11 19:44:09.528543 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:09.528395    2580 scope.go:117] "RemoveContainer" containerID="8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94"
Sep 11 19:44:09.539751 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:44:09.539592    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7801-e3f537\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="95dfe324-a7a4-4ab0-91da-87a832a4f982" pod="opendatahub/test-curl-7801-e3f537"
Sep 11 19:44:09.539835 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:09.539812    2580 scope.go:117] "RemoveContainer" containerID="8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94"
Sep 11 19:44:09.540230 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:44:09.540211    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94\": container with ID starting with 8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94 not found: ID does not exist" containerID="8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94"
Sep 11 19:44:09.540341 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:09.540237    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94"} err="failed to get container status \"8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94\": rpc error: code = NotFound desc = could not find container \"8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94\": container with ID starting with 8e17a6454b555705f4adc37cd3f9942363dcc4c04fe5b6bb93861c1720424c94 not found: ID does not exist"
Sep 11 19:44:10.447948 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:44:10.447913    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7801-e3f537\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="95dfe324-a7a4-4ab0-91da-87a832a4f982" pod="opendatahub/test-curl-7801-e3f537"
Sep 11 19:44:10.448916 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:10.448886    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95dfe324-a7a4-4ab0-91da-87a832a4f982" path="/var/lib/kubelet/pods/95dfe324-a7a4-4ab0-91da-87a832a4f982/volumes"
Sep 11 19:44:18.214807 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.214772    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"]
Sep 11 19:44:18.215374 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.215353    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95dfe324-a7a4-4ab0-91da-87a832a4f982" containerName="test-curl-7801-e3f537"
Sep 11 19:44:18.215431 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.215378    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="95dfe324-a7a4-4ab0-91da-87a832a4f982" containerName="test-curl-7801-e3f537"
Sep 11 19:44:18.215507 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.215495    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="95dfe324-a7a4-4ab0-91da-87a832a4f982" containerName="test-curl-7801-e3f537"
Sep 11 19:44:18.220112 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.220088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.222843 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.222674    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-19859a\"/\"default-dockercfg-l7jwf\""
Sep 11 19:44:18.223342 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.223320    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-19859a\"/\"openshift-service-ca.crt\""
Sep 11 19:44:18.224058 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.224033    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-19859a\"/\"kube-root-ca.crt\""
Sep 11 19:44:18.224325 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.224275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-19859a\"/\"sub-test-model-19859a-kserve-self-signed-certs\""
Sep 11 19:44:18.225360 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.225335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"]
Sep 11 19:44:18.275994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.275961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmmvz\" (UniqueName: \"kubernetes.io/projected/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-kube-api-access-vmmvz\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.276139 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.276004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tmp-dir\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.276139 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.276060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-dshm\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.276139 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.276077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-home\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.276139 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.276098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tls-certs\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.276139 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.276123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-model-cache\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.377643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.377593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmmvz\" (UniqueName: \"kubernetes.io/projected/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-kube-api-access-vmmvz\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.377643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.377642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tmp-dir\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.377889 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.377678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-dshm\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.377889 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.377694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-home\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.377889 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.377716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tls-certs\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.377889 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.377738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-model-cache\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.378222 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.378177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tmp-dir\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.378222 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.378204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-model-cache\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.378416 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.378251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-home\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.379978 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.379957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-dshm\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.380178 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.380163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tls-certs\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.384634 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.384610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmmvz\" (UniqueName: \"kubernetes.io/projected/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-kube-api-access-vmmvz\") pod \"sub-test-model-19859a-kserve-67d9f4984f-ldr8c\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") " pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.531395 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.531308    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:18.804530 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:18.804503    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"]
Sep 11 19:44:18.805859 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:44:18.805831    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6190ba04_7b8c_470b_a79e_5cbee1ca9f0a.slice/crio-d9c6ebfe6c4e280404bd47846f1c8d09c368f55bb9b940992a442776316d101b WatchSource:0}: Error finding container d9c6ebfe6c4e280404bd47846f1c8d09c368f55bb9b940992a442776316d101b: Status 404 returned error can't find the container with id d9c6ebfe6c4e280404bd47846f1c8d09c368f55bb9b940992a442776316d101b
Sep 11 19:44:19.589599 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:19.589561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c" event={"ID":"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a","Type":"ContainerStarted","Data":"870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb"}
Sep 11 19:44:19.589599 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:19.589602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c" event={"ID":"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a","Type":"ContainerStarted","Data":"d9c6ebfe6c4e280404bd47846f1c8d09c368f55bb9b940992a442776316d101b"}
Sep 11 19:44:19.605473 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:19.605424    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c" podStartSLOduration=1.6054046739999999 podStartE2EDuration="1.605404674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:44:19.604835238 +0000 UTC m=+1559.626043409" watchObservedRunningTime="2026-09-11 19:44:19.605404674 +0000 UTC m=+1559.626612826"
Sep 11 19:44:28.532420 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:28.532370    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:28.532420 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:28.532429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:28.545061 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:28.545036    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:44:28.651631 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:44:28.651598    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:45:00.139492 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.139445    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn"]
Sep 11 19:45:00.143661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.143632    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b"]
Sep 11 19:45:00.143811 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.143750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn"
Sep 11 19:45:00.145818 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.145795    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:45:00.147787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.147730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b"
Sep 11 19:45:00.152315 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.151423    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn"]
Sep 11 19:45:00.155024 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.154998    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b"]
Sep 11 19:45:00.157015 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.156982    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn"
Sep 11 19:45:00.166147 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.166127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b"
Sep 11 19:45:00.440906 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.440877    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn"]
Sep 11 19:45:00.443852 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:45:00.442610    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a348b2_bf92_4ab1_85ed_f096cb9cd658.slice/crio-7f6dc5403747e0c0e5a231639b60161162648f701137b6f7ededd507040b9af3 WatchSource:0}: Error finding container 7f6dc5403747e0c0e5a231639b60161162648f701137b6f7ededd507040b9af3: Status 404 returned error can't find the container with id 7f6dc5403747e0c0e5a231639b60161162648f701137b6f7ededd507040b9af3
Sep 11 19:45:00.445228 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:45:00.445200    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5a6b3e_d06a_4aaa_b856_7d5ff1e3bde8.slice/crio-0fbe6e64cedffb5910e54ce57828b30999177166207bda86b9ed35eafbe28316 WatchSource:0}: Error finding container 0fbe6e64cedffb5910e54ce57828b30999177166207bda86b9ed35eafbe28316: Status 404 returned error can't find the container with id 0fbe6e64cedffb5910e54ce57828b30999177166207bda86b9ed35eafbe28316
Sep 11 19:45:00.450754 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.450733    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b"]
Sep 11 19:45:00.827973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.827935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b" event={"ID":"5c5a6b3e-d06a-4aaa-b856-7d5ff1e3bde8","Type":"ContainerStarted","Data":"47f6ade94e3dee9d77839a11e03f4f7f093efe483632d65dc80ef348fdaf2792"}
Sep 11 19:45:00.828158 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.827999    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b" event={"ID":"5c5a6b3e-d06a-4aaa-b856-7d5ff1e3bde8","Type":"ContainerStarted","Data":"0fbe6e64cedffb5910e54ce57828b30999177166207bda86b9ed35eafbe28316"}
Sep 11 19:45:00.829573 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.829541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn" event={"ID":"67a348b2-bf92-4ab1-85ed-f096cb9cd658","Type":"ContainerStarted","Data":"d3372926788c2ebda7c847deca531863d6f00e4e0d3e47da97694c2cf4ede3e0"}
Sep 11 19:45:00.829683 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.829593    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn" event={"ID":"67a348b2-bf92-4ab1-85ed-f096cb9cd658","Type":"ContainerStarted","Data":"7f6dc5403747e0c0e5a231639b60161162648f701137b6f7ededd507040b9af3"}
Sep 11 19:45:00.843340 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.843276    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b" podStartSLOduration=0.843260926 podStartE2EDuration="843.260926ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:45:00.841467081 +0000 UTC m=+1600.862675251" watchObservedRunningTime="2026-09-11 19:45:00.843260926 +0000 UTC m=+1600.864469076"
Sep 11 19:45:00.860395 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:00.860323    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn" podStartSLOduration=0.86030273 podStartE2EDuration="860.30273ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:45:00.854970838 +0000 UTC m=+1600.876178972" watchObservedRunningTime="2026-09-11 19:45:00.86030273 +0000 UTC m=+1600.881510880"
Sep 11 19:45:01.837382 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:01.837265    2580 generic.go:356] "Generic (PLEG): container finished" podID="5c5a6b3e-d06a-4aaa-b856-7d5ff1e3bde8" containerID="47f6ade94e3dee9d77839a11e03f4f7f093efe483632d65dc80ef348fdaf2792" exitCode=0
Sep 11 19:45:01.837382 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:01.837344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b" event={"ID":"5c5a6b3e-d06a-4aaa-b856-7d5ff1e3bde8","Type":"ContainerDied","Data":"47f6ade94e3dee9d77839a11e03f4f7f093efe483632d65dc80ef348fdaf2792"}
Sep 11 19:45:01.838994 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:01.838969    2580 generic.go:356] "Generic (PLEG): container finished" podID="67a348b2-bf92-4ab1-85ed-f096cb9cd658" containerID="d3372926788c2ebda7c847deca531863d6f00e4e0d3e47da97694c2cf4ede3e0" exitCode=0
Sep 11 19:45:01.839120 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:01.839008    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn" event={"ID":"67a348b2-bf92-4ab1-85ed-f096cb9cd658","Type":"ContainerDied","Data":"d3372926788c2ebda7c847deca531863d6f00e4e0d3e47da97694c2cf4ede3e0"}
Sep 11 19:45:02.978455 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:02.978423    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn"
Sep 11 19:45:03.007106 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:03.007075    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b"
Sep 11 19:45:03.852979 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:03.852951    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b"
Sep 11 19:45:03.853182 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:03.852989    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819265-nct4b" event={"ID":"5c5a6b3e-d06a-4aaa-b856-7d5ff1e3bde8","Type":"ContainerDied","Data":"0fbe6e64cedffb5910e54ce57828b30999177166207bda86b9ed35eafbe28316"}
Sep 11 19:45:03.853182 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:03.853038    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fbe6e64cedffb5910e54ce57828b30999177166207bda86b9ed35eafbe28316"
Sep 11 19:45:03.854510 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:03.854490    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn"
Sep 11 19:45:03.854510 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:03.854505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn" event={"ID":"67a348b2-bf92-4ab1-85ed-f096cb9cd658","Type":"ContainerDied","Data":"7f6dc5403747e0c0e5a231639b60161162648f701137b6f7ededd507040b9af3"}
Sep 11 19:45:03.854658 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:03.854543    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f6dc5403747e0c0e5a231639b60161162648f701137b6f7ededd507040b9af3"
Sep 11 19:45:20.837537 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:20.837464    2580 scope.go:117] "RemoveContainer" containerID="e3b28b1dc84d36073c21d0887db5e0493df4817cfaf26ebad7d6198137292d3d"
Sep 11 19:45:20.846336 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:20.846313    2580 scope.go:117] "RemoveContainer" containerID="2b88863274194ea332043372e3d83227d0c801a4bbd859d0863c2a522cee3492"
Sep 11 19:45:57.182715 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:45:57.182682    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"]
Sep 11 19:46:12.201796 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.201726    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c" podUID="6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" containerName="main" containerID="cri-o://870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb" gracePeriod=45
Sep 11 19:46:12.453234 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.453175    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:46:12.565297 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565251    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmmvz\" (UniqueName: \"kubernetes.io/projected/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-kube-api-access-vmmvz\") pod \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") "
Sep 11 19:46:12.565464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565311    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-model-cache\") pod \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") "
Sep 11 19:46:12.565464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565342    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tmp-dir\") pod \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") "
Sep 11 19:46:12.565464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565380    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-dshm\") pod \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") "
Sep 11 19:46:12.565464 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565421    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tls-certs\") pod \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") "
Sep 11 19:46:12.565642 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565472    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-home\") pod \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\" (UID: \"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a\") "
Sep 11 19:46:12.565704 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565662    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-model-cache" (OuterVolumeSpecName: "model-cache") pod "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" (UID: "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:46:12.565704 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565674    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" (UID: "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:46:12.565860 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565834    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-home" (OuterVolumeSpecName: "home") pod "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" (UID: "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:46:12.565925 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565866    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-model-cache\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:46:12.565925 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.565885    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tmp-dir\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:46:12.567718 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.567690    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-dshm" (OuterVolumeSpecName: "dshm") pod "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" (UID: "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:46:12.567718 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.567703    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-kube-api-access-vmmvz" (OuterVolumeSpecName: "kube-api-access-vmmvz") pod "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" (UID: "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a"). InnerVolumeSpecName "kube-api-access-vmmvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:46:12.567860 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.567695    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" (UID: "6190ba04-7b8c-470b-a79e-5cbee1ca9f0a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:46:12.667390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.667345    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-dshm\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:46:12.667390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.667383    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-tls-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:46:12.667390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.667393    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-home\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:46:12.667390 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:12.667402    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmmvz\" (UniqueName: \"kubernetes.io/projected/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a-kube-api-access-vmmvz\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:46:13.259357 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:13.259317    2580 generic.go:356] "Generic (PLEG): container finished" podID="6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" containerID="870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb" exitCode=0
Sep 11 19:46:13.259817 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:13.259366    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"
Sep 11 19:46:13.259817 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:13.259408    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c" event={"ID":"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a","Type":"ContainerDied","Data":"870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb"}
Sep 11 19:46:13.259817 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:13.259452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c" event={"ID":"6190ba04-7b8c-470b-a79e-5cbee1ca9f0a","Type":"ContainerDied","Data":"d9c6ebfe6c4e280404bd47846f1c8d09c368f55bb9b940992a442776316d101b"}
Sep 11 19:46:13.259817 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:13.259469    2580 scope.go:117] "RemoveContainer" containerID="870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb"
Sep 11 19:46:13.269170 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:13.269153    2580 scope.go:117] "RemoveContainer" containerID="870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb"
Sep 11 19:46:13.269483 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:46:13.269464    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb\": container with ID starting with 870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb not found: ID does not exist" containerID="870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb"
Sep 11 19:46:13.269540 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:13.269493    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb"} err="failed to get container status \"870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb\": rpc error: code = NotFound desc = could not find container \"870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb\": container with ID starting with 870c54cd8b4ac84f557c559901fb9955eee5b6da256bcbba0b45f5ca1d75baeb not found: ID does not exist"
Sep 11 19:46:13.280273 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:13.280245    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"]
Sep 11 19:46:13.283571 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:13.283548    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-19859a/sub-test-model-19859a-kserve-67d9f4984f-ldr8c"]
Sep 11 19:46:14.448335 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:14.448304    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" path="/var/lib/kubelet/pods/6190ba04-7b8c-470b-a79e-5cbee1ca9f0a/volumes"
Sep 11 19:46:20.873786 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:46:20.873750    2580 scope.go:117] "RemoveContainer" containerID="3e0187917b9a07c925f2a8267602d03ceb1b02587d1796e0f5bd5cde696b13a6"
Sep 11 19:47:06.571682 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.571645    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"]
Sep 11 19:47:06.572087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.572024    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67a348b2-bf92-4ab1-85ed-f096cb9cd658" containerName="cleanup"
Sep 11 19:47:06.572087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.572037    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="67a348b2-bf92-4ab1-85ed-f096cb9cd658" containerName="cleanup"
Sep 11 19:47:06.572087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.572046    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5a6b3e-d06a-4aaa-b856-7d5ff1e3bde8" containerName="cleanup"
Sep 11 19:47:06.572087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.572052    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5a6b3e-d06a-4aaa-b856-7d5ff1e3bde8" containerName="cleanup"
Sep 11 19:47:06.572087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.572061    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" containerName="main"
Sep 11 19:47:06.572087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.572067    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" containerName="main"
Sep 11 19:47:06.572354 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.572156    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6190ba04-7b8c-470b-a79e-5cbee1ca9f0a" containerName="main"
Sep 11 19:47:06.572354 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.572169    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c5a6b3e-d06a-4aaa-b856-7d5ff1e3bde8" containerName="cleanup"
Sep 11 19:47:06.572354 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.572178    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="67a348b2-bf92-4ab1-85ed-f096cb9cd658" containerName="cleanup"
Sep 11 19:47:06.575266 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.575244    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.577700 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.577672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-c0a42d-openshift-default-dockercfg-g7dvw\""
Sep 11 19:47:06.586547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.586525    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"]
Sep 11 19:47:06.672157 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.672104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-podinfo\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.672378 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.672181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-envoy\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.672378 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.672229    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-credential-socket\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.672378 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.672313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-token\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.672378 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.672346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-socket\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.672643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.672377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-data\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.672643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.672405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxd2l\" (UniqueName: \"kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-kube-api-access-lxd2l\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.672643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.672498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-certs\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.672643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.672547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istiod-ca-cert\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773068 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-envoy\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773068 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-credential-socket\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-token\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-socket\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-data\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxd2l\" (UniqueName: \"kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-kube-api-access-lxd2l\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-certs\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istiod-ca-cert\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773666 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-podinfo\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773666 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-credential-socket\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.773666 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-certs\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.774797 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.773791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-data\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.774797 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.774138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-socket\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.774797 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.774688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istiod-ca-cert\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.781711 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.781684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-envoy\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.782067 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.782045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-podinfo\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.783969 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.783947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-token\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.784082 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.784054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxd2l\" (UniqueName: \"kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-kube-api-access-lxd2l\") pod \"e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") " pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:06.887232 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:06.887139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:07.165623 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:07.165592    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"]
Sep 11 19:47:07.167064 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:47:07.167036    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b9760b6_90f0_46ca_98d5_e9a161f77a74.slice/crio-543493c78ec0ea0e8b2d1dc5bade15552935fec3f948b9f0c8589cd78fb27de6 WatchSource:0}: Error finding container 543493c78ec0ea0e8b2d1dc5bade15552935fec3f948b9f0c8589cd78fb27de6: Status 404 returned error can't find the container with id 543493c78ec0ea0e8b2d1dc5bade15552935fec3f948b9f0c8589cd78fb27de6
Sep 11 19:47:07.169298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:07.169244    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:07.169409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:07.169349    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:07.169409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:07.169399    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:07.568990 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:07.568946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" event={"ID":"7b9760b6-90f0-46ca-98d5-e9a161f77a74","Type":"ContainerStarted","Data":"d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d"}
Sep 11 19:47:07.569203 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:07.569018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" event={"ID":"7b9760b6-90f0-46ca-98d5-e9a161f77a74","Type":"ContainerStarted","Data":"543493c78ec0ea0e8b2d1dc5bade15552935fec3f948b9f0c8589cd78fb27de6"}
Sep 11 19:47:07.588192 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:07.588143    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" podStartSLOduration=1.588126551 podStartE2EDuration="1.588126551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:07.586413643 +0000 UTC m=+1727.607621820" watchObservedRunningTime="2026-09-11 19:47:07.588126551 +0000 UTC m=+1727.609334700"
Sep 11 19:47:07.887928 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:07.887838    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:08.892580 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:08.892550    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:09.581602 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:09.581566    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:09.582547 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:09.582521    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:12.016004 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.015962    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"]
Sep 11 19:47:12.019507 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.019488    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:47:12.021661 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.021638    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-c0a42d\""
Sep 11 19:47:12.031930 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.031905    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"]
Sep 11 19:47:12.056987 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.056946    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"]
Sep 11 19:47:12.060472 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.060457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:47:12.062877 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.062856    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-c0a42d-dockercfg-gdx6f\""
Sep 11 19:47:12.069926 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.069904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"]
Sep 11 19:47:12.123669 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.123637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr5qg\" (UniqueName: \"kubernetes.io/projected/9e363ca1-685d-40fb-976c-d3f1b2160bca-kube-api-access-sr5qg\") pod \"payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh\" (UID: \"9e363ca1-685d-40fb-976c-d3f1b2160bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:47:12.123839 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.123780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e363ca1-685d-40fb-976c-d3f1b2160bca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh\" (UID: \"9e363ca1-685d-40fb-976c-d3f1b2160bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:47:12.224454 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.224421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxvgn\" (UniqueName: \"kubernetes.io/projected/d0d718c8-7b4a-4626-975b-d05808d327d3-kube-api-access-pxvgn\") pod \"payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k\" (UID: \"d0d718c8-7b4a-4626-975b-d05808d327d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:47:12.224651 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.224471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e363ca1-685d-40fb-976c-d3f1b2160bca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh\" (UID: \"9e363ca1-685d-40fb-976c-d3f1b2160bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:47:12.224651 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.224530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr5qg\" (UniqueName: \"kubernetes.io/projected/9e363ca1-685d-40fb-976c-d3f1b2160bca-kube-api-access-sr5qg\") pod \"payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh\" (UID: \"9e363ca1-685d-40fb-976c-d3f1b2160bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:47:12.224771 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.224683    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0d718c8-7b4a-4626-975b-d05808d327d3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k\" (UID: \"d0d718c8-7b4a-4626-975b-d05808d327d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:47:12.225118 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.225101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e363ca1-685d-40fb-976c-d3f1b2160bca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh\" (UID: \"9e363ca1-685d-40fb-976c-d3f1b2160bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:47:12.232094 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.232064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr5qg\" (UniqueName: \"kubernetes.io/projected/9e363ca1-685d-40fb-976c-d3f1b2160bca-kube-api-access-sr5qg\") pod \"payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh\" (UID: \"9e363ca1-685d-40fb-976c-d3f1b2160bca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:47:12.325424 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.325358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0d718c8-7b4a-4626-975b-d05808d327d3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k\" (UID: \"d0d718c8-7b4a-4626-975b-d05808d327d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:47:12.325424 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.325412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxvgn\" (UniqueName: \"kubernetes.io/projected/d0d718c8-7b4a-4626-975b-d05808d327d3-kube-api-access-pxvgn\") pod \"payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k\" (UID: \"d0d718c8-7b4a-4626-975b-d05808d327d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:47:12.326007 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.325988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0d718c8-7b4a-4626-975b-d05808d327d3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k\" (UID: \"d0d718c8-7b4a-4626-975b-d05808d327d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:47:12.331053 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.331029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:47:12.332944 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.332925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxvgn\" (UniqueName: \"kubernetes.io/projected/d0d718c8-7b4a-4626-975b-d05808d327d3-kube-api-access-pxvgn\") pod \"payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k\" (UID: \"d0d718c8-7b4a-4626-975b-d05808d327d3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:47:12.372309 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.372116    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:47:12.604707 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.604681    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"]
Sep 11 19:47:12.606434 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:47:12.606402    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e363ca1_685d_40fb_976c_d3f1b2160bca.slice/crio-8cbd85ca697388fc1af55194070685705db0cf2ddd9aa7889e337fe46b602519 WatchSource:0}: Error finding container 8cbd85ca697388fc1af55194070685705db0cf2ddd9aa7889e337fe46b602519: Status 404 returned error can't find the container with id 8cbd85ca697388fc1af55194070685705db0cf2ddd9aa7889e337fe46b602519
Sep 11 19:47:12.653087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:12.653063    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"]
Sep 11 19:47:12.658317 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:47:12.658273    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d718c8_7b4a_4626_975b_d05808d327d3.slice/crio-d718c645e82c221ab4f5974cd55c5ab019a570df869918aa33f8631163a5a1c7 WatchSource:0}: Error finding container d718c645e82c221ab4f5974cd55c5ab019a570df869918aa33f8631163a5a1c7: Status 404 returned error can't find the container with id d718c645e82c221ab4f5974cd55c5ab019a570df869918aa33f8631163a5a1c7
Sep 11 19:47:13.608521 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:13.608465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh" event={"ID":"9e363ca1-685d-40fb-976c-d3f1b2160bca","Type":"ContainerStarted","Data":"d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9"}
Sep 11 19:47:13.608990 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:13.608538    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:47:13.608990 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:13.608563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh" event={"ID":"9e363ca1-685d-40fb-976c-d3f1b2160bca","Type":"ContainerStarted","Data":"8cbd85ca697388fc1af55194070685705db0cf2ddd9aa7889e337fe46b602519"}
Sep 11 19:47:13.610188 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:13.610162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k" event={"ID":"d0d718c8-7b4a-4626-975b-d05808d327d3","Type":"ContainerStarted","Data":"6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f"}
Sep 11 19:47:13.610318 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:13.610212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k" event={"ID":"d0d718c8-7b4a-4626-975b-d05808d327d3","Type":"ContainerStarted","Data":"d718c645e82c221ab4f5974cd55c5ab019a570df869918aa33f8631163a5a1c7"}
Sep 11 19:47:13.610318 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:13.610266    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:47:13.629512 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:13.629466    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh" podStartSLOduration=2.629450322 podStartE2EDuration="2.629450322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:13.626002658 +0000 UTC m=+1733.647210846" watchObservedRunningTime="2026-09-11 19:47:13.629450322 +0000 UTC m=+1733.650658474"
Sep 11 19:47:13.646526 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:13.646485    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k" podStartSLOduration=1.646471022 podStartE2EDuration="1.646471022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:13.644432704 +0000 UTC m=+1733.665640866" watchObservedRunningTime="2026-09-11 19:47:13.646471022 +0000 UTC m=+1733.667679172"
Sep 11 19:47:24.618606 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:24.618568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:47:24.619051 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:24.618758    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:47:25.623468 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:25.623429    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 19:47:25.623852 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:25.623492    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:47:26.688174 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:26.688141    2580 generic.go:356] "Generic (PLEG): container finished" podID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerID="d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d" exitCode=0
Sep 11 19:47:26.688667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:26.688192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" event={"ID":"7b9760b6-90f0-46ca-98d5-e9a161f77a74","Type":"ContainerDied","Data":"d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d"}
Sep 11 19:47:26.688667 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:26.688576    2580 scope.go:117] "RemoveContainer" containerID="d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d"
Sep 11 19:47:26.689726 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:26.689690    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:26.689808 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:26.689787    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:26.689847 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:26.689831    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:27.698212 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:27.698166    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" event={"ID":"7b9760b6-90f0-46ca-98d5-e9a161f77a74","Type":"ContainerStarted","Data":"2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393"}
Sep 11 19:47:27.887850 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:27.887806    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:27.888115 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:27.888088    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Sep 11 19:47:27.888199 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:27.888164    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Sep 11 19:47:28.888482 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:28.888441    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Sep 11 19:47:28.888944 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:28.888504    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Sep 11 19:47:29.888291 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:29.888248    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Sep 11 19:47:29.888472 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:29.888326    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Sep 11 19:47:30.888499 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:30.888461    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Sep 11 19:47:30.888887 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:30.888518    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Sep 11 19:47:31.888069 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:31.888035    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Sep 11 19:47:31.888248 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:31.888087    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Sep 11 19:47:32.891384 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:32.891351    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:32.891782 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:32.891617    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:32.892194 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:32.892176    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:47:41.338483 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.338441    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"]
Sep 11 19:47:41.342514 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.342492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:47:41.344613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.344590    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-904b94\""
Sep 11 19:47:41.351944 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.351916    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"]
Sep 11 19:47:41.392957 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.392928    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"]
Sep 11 19:47:41.396434 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.396418    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:47:41.398833 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.398815    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-904b94-dockercfg-44nwk\""
Sep 11 19:47:41.408774 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.408748    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"]
Sep 11 19:47:41.533904 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.533870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v54fb\" (UniqueName: \"kubernetes.io/projected/659ea779-1228-45b6-8ad3-9d3211bea306-kube-api-access-v54fb\") pod \"payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc\" (UID: \"659ea779-1228-45b6-8ad3-9d3211bea306\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:47:41.534073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.533928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/659ea779-1228-45b6-8ad3-9d3211bea306-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc\" (UID: \"659ea779-1228-45b6-8ad3-9d3211bea306\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:47:41.534073 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.533983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e75ad74-cb82-4fad-82ef-98ebf80c6643-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl\" (UID: \"1e75ad74-cb82-4fad-82ef-98ebf80c6643\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:47:41.534150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.534078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf7mp\" (UniqueName: \"kubernetes.io/projected/1e75ad74-cb82-4fad-82ef-98ebf80c6643-kube-api-access-wf7mp\") pod \"payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl\" (UID: \"1e75ad74-cb82-4fad-82ef-98ebf80c6643\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:47:41.634820 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.634737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v54fb\" (UniqueName: \"kubernetes.io/projected/659ea779-1228-45b6-8ad3-9d3211bea306-kube-api-access-v54fb\") pod \"payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc\" (UID: \"659ea779-1228-45b6-8ad3-9d3211bea306\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:47:41.634820 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.634793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/659ea779-1228-45b6-8ad3-9d3211bea306-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc\" (UID: \"659ea779-1228-45b6-8ad3-9d3211bea306\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:47:41.635044 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.635018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e75ad74-cb82-4fad-82ef-98ebf80c6643-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl\" (UID: \"1e75ad74-cb82-4fad-82ef-98ebf80c6643\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:47:41.635096 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.635072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf7mp\" (UniqueName: \"kubernetes.io/projected/1e75ad74-cb82-4fad-82ef-98ebf80c6643-kube-api-access-wf7mp\") pod \"payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl\" (UID: \"1e75ad74-cb82-4fad-82ef-98ebf80c6643\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:47:41.635528 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.635506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/659ea779-1228-45b6-8ad3-9d3211bea306-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc\" (UID: \"659ea779-1228-45b6-8ad3-9d3211bea306\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:47:41.635700 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.635681    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e75ad74-cb82-4fad-82ef-98ebf80c6643-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl\" (UID: \"1e75ad74-cb82-4fad-82ef-98ebf80c6643\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:47:41.642345 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.642325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v54fb\" (UniqueName: \"kubernetes.io/projected/659ea779-1228-45b6-8ad3-9d3211bea306-kube-api-access-v54fb\") pod \"payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc\" (UID: \"659ea779-1228-45b6-8ad3-9d3211bea306\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:47:41.642514 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.642494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf7mp\" (UniqueName: \"kubernetes.io/projected/1e75ad74-cb82-4fad-82ef-98ebf80c6643-kube-api-access-wf7mp\") pod \"payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl\" (UID: \"1e75ad74-cb82-4fad-82ef-98ebf80c6643\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:47:41.655245 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.655219    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:47:41.706759 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.706720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:47:41.926660 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.926630    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"]
Sep 11 19:47:41.927052 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:47:41.927030    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e75ad74_cb82_4fad_82ef_98ebf80c6643.slice/crio-27ae2ac4350fc35686bc2a280634139109fc776d317e060a1dfb056312af29a2 WatchSource:0}: Error finding container 27ae2ac4350fc35686bc2a280634139109fc776d317e060a1dfb056312af29a2: Status 404 returned error can't find the container with id 27ae2ac4350fc35686bc2a280634139109fc776d317e060a1dfb056312af29a2
Sep 11 19:47:41.994204 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:41.994178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"]
Sep 11 19:47:41.995192 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:47:41.995163    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod659ea779_1228_45b6_8ad3_9d3211bea306.slice/crio-9c10d60b64b669b1ebd3737b9f0d2f72771d14e459e54a51ec250e0149bd9d0b WatchSource:0}: Error finding container 9c10d60b64b669b1ebd3737b9f0d2f72771d14e459e54a51ec250e0149bd9d0b: Status 404 returned error can't find the container with id 9c10d60b64b669b1ebd3737b9f0d2f72771d14e459e54a51ec250e0149bd9d0b
Sep 11 19:47:42.802013 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:42.801979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc" event={"ID":"659ea779-1228-45b6-8ad3-9d3211bea306","Type":"ContainerStarted","Data":"1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05"}
Sep 11 19:47:42.802485 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:42.802037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc" event={"ID":"659ea779-1228-45b6-8ad3-9d3211bea306","Type":"ContainerStarted","Data":"9c10d60b64b669b1ebd3737b9f0d2f72771d14e459e54a51ec250e0149bd9d0b"}
Sep 11 19:47:42.802485 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:42.802067    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:47:42.803891 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:42.803859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl" event={"ID":"1e75ad74-cb82-4fad-82ef-98ebf80c6643","Type":"ContainerStarted","Data":"195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a"}
Sep 11 19:47:42.804003 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:42.803905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl" event={"ID":"1e75ad74-cb82-4fad-82ef-98ebf80c6643","Type":"ContainerStarted","Data":"27ae2ac4350fc35686bc2a280634139109fc776d317e060a1dfb056312af29a2"}
Sep 11 19:47:42.804003 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:42.803944    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:47:42.820790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:42.820738    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc" podStartSLOduration=1.820723367 podStartE2EDuration="1.820723367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:42.817910313 +0000 UTC m=+1762.839118485" watchObservedRunningTime="2026-09-11 19:47:42.820723367 +0000 UTC m=+1762.841931512"
Sep 11 19:47:42.834427 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:42.834373    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl" podStartSLOduration=1.8343584019999999 podStartE2EDuration="1.834358402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:42.832877269 +0000 UTC m=+1762.854085440" watchObservedRunningTime="2026-09-11 19:47:42.834358402 +0000 UTC m=+1762.855566551"
Sep 11 19:47:53.813175 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:53.813139    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:47:53.813587 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:47:53.813349    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:48:08.329751 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:08.329719    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc_659ea779-1228-45b6-8ad3-9d3211bea306/payload-processing/0.log"
Sep 11 19:48:20.562366 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:20.562326    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:48:20.570369 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:20.570348    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:48:20.919757 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:20.919658    2580 scope.go:117] "RemoveContainer" containerID="1b134f9cf60ba4fc63aa353c427720b48db7c8a09d53d5485960f2586ffe7f0a"
Sep 11 19:48:49.177214 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:49.177182    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k_d0d718c8-7b4a-4626-975b-d05808d327d3/payload-processing/0.log"
Sep 11 19:48:49.407495 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:49.407468    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc_659ea779-1228-45b6-8ad3-9d3211bea306/payload-processing/0.log"
Sep 11 19:48:56.478239 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.478200    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"]
Sep 11 19:48:56.481651 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.481631    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:48:56.484226 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.484202    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-40573d-dockercfg-vr46f\""
Sep 11 19:48:56.484395 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.484247    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-40573d\""
Sep 11 19:48:56.490255 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.490229    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"]
Sep 11 19:48:56.558491 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.558452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4cjp\" (UniqueName: \"kubernetes.io/projected/b37370b6-070c-4b75-b5d2-cd3d20c904ad-kube-api-access-l4cjp\") pod \"payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph\" (UID: \"b37370b6-070c-4b75-b5d2-cd3d20c904ad\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:48:56.558805 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.558777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b37370b6-070c-4b75-b5d2-cd3d20c904ad-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph\" (UID: \"b37370b6-070c-4b75-b5d2-cd3d20c904ad\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:48:56.660100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.660070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4cjp\" (UniqueName: \"kubernetes.io/projected/b37370b6-070c-4b75-b5d2-cd3d20c904ad-kube-api-access-l4cjp\") pod \"payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph\" (UID: \"b37370b6-070c-4b75-b5d2-cd3d20c904ad\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:48:56.660262 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.660122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b37370b6-070c-4b75-b5d2-cd3d20c904ad-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph\" (UID: \"b37370b6-070c-4b75-b5d2-cd3d20c904ad\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:48:56.660837 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.660816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b37370b6-070c-4b75-b5d2-cd3d20c904ad-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph\" (UID: \"b37370b6-070c-4b75-b5d2-cd3d20c904ad\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:48:56.668973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.668946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4cjp\" (UniqueName: \"kubernetes.io/projected/b37370b6-070c-4b75-b5d2-cd3d20c904ad-kube-api-access-l4cjp\") pod \"payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph\" (UID: \"b37370b6-070c-4b75-b5d2-cd3d20c904ad\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:48:56.794406 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:56.794268    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:48:57.066063 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:57.066033    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"]
Sep 11 19:48:57.067716 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:48:57.067688    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37370b6_070c_4b75_b5d2_cd3d20c904ad.slice/crio-8af21f25740860a6ee08f85b5328d662919be7b239c36f98c36d8169fe1a0a97 WatchSource:0}: Error finding container 8af21f25740860a6ee08f85b5328d662919be7b239c36f98c36d8169fe1a0a97: Status 404 returned error can't find the container with id 8af21f25740860a6ee08f85b5328d662919be7b239c36f98c36d8169fe1a0a97
Sep 11 19:48:57.259040 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:57.259005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph" event={"ID":"b37370b6-070c-4b75-b5d2-cd3d20c904ad","Type":"ContainerStarted","Data":"db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f"}
Sep 11 19:48:57.259209 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:57.259068    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph" event={"ID":"b37370b6-070c-4b75-b5d2-cd3d20c904ad","Type":"ContainerStarted","Data":"8af21f25740860a6ee08f85b5328d662919be7b239c36f98c36d8169fe1a0a97"}
Sep 11 19:48:57.259209 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:57.259102    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:48:57.276077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:48:57.276022    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph" podStartSLOduration=1.27600803 podStartE2EDuration="1.27600803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:48:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:48:57.273931676 +0000 UTC m=+1837.295139823" watchObservedRunningTime="2026-09-11 19:48:57.27600803 +0000 UTC m=+1837.297216239"
Sep 11 19:49:08.267461 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:08.267427    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:49:20.944674 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:20.944641    2580 scope.go:117] "RemoveContainer" containerID="ea122379a18c55eda18a40cc9ee9cdbfbd07e7f5a63a6990b962f9ed56e5025e"
Sep 11 19:49:20.954913 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:20.954888    2580 scope.go:117] "RemoveContainer" containerID="5e896bb0e494d508985f9827983cb16a360f56954051bb7df2e4be5f5f6ca798"
Sep 11 19:49:23.584077 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:23.584038    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"]
Sep 11 19:49:23.587579 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:23.587560    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"
Sep 11 19:49:23.589850 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:23.589825    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:49:23.589977 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:23.589825    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:49:23.597360 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:23.597329    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"]
Sep 11 19:49:23.613806 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:23.613776    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8843bbab-4fdb-40fb-aeec-5eeeddbd03e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd\" (UID: \"8843bbab-4fdb-40fb-aeec-5eeeddbd03e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"
Sep 11 19:49:23.714497 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:23.714463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8843bbab-4fdb-40fb-aeec-5eeeddbd03e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd\" (UID: \"8843bbab-4fdb-40fb-aeec-5eeeddbd03e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"
Sep 11 19:49:23.715055 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:23.715033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8843bbab-4fdb-40fb-aeec-5eeeddbd03e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd\" (UID: \"8843bbab-4fdb-40fb-aeec-5eeeddbd03e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"
Sep 11 19:49:23.899449 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:23.899360    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"
Sep 11 19:49:24.176382 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:24.176356    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"]
Sep 11 19:49:24.178123 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:49:24.178093    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8843bbab_4fdb_40fb_aeec_5eeeddbd03e9.slice/crio-960e15c801450798fa4e922b3da39b6e05a6692c70c42cdcc44f5ca4d24cbaaf WatchSource:0}: Error finding container 960e15c801450798fa4e922b3da39b6e05a6692c70c42cdcc44f5ca4d24cbaaf: Status 404 returned error can't find the container with id 960e15c801450798fa4e922b3da39b6e05a6692c70c42cdcc44f5ca4d24cbaaf
Sep 11 19:49:24.431618 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:24.431586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd" event={"ID":"8843bbab-4fdb-40fb-aeec-5eeeddbd03e9","Type":"ContainerStarted","Data":"960e15c801450798fa4e922b3da39b6e05a6692c70c42cdcc44f5ca4d24cbaaf"}
Sep 11 19:49:25.445936 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:25.445904    2580 generic.go:356] "Generic (PLEG): container finished" podID="8843bbab-4fdb-40fb-aeec-5eeeddbd03e9" containerID="b1d13749bed8161943492f73fd96968f0faac05ef8cd13f3f4f7693bc32edf97" exitCode=0
Sep 11 19:49:25.446334 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:25.445962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd" event={"ID":"8843bbab-4fdb-40fb-aeec-5eeeddbd03e9","Type":"ContainerDied","Data":"b1d13749bed8161943492f73fd96968f0faac05ef8cd13f3f4f7693bc32edf97"}
Sep 11 19:49:26.588812 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:26.588788    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"
Sep 11 19:49:26.641115 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:26.641087    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8843bbab-4fdb-40fb-aeec-5eeeddbd03e9-maas-api-service-ca\") pod \"8843bbab-4fdb-40fb-aeec-5eeeddbd03e9\" (UID: \"8843bbab-4fdb-40fb-aeec-5eeeddbd03e9\") "
Sep 11 19:49:26.641511 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:26.641485    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8843bbab-4fdb-40fb-aeec-5eeeddbd03e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8843bbab-4fdb-40fb-aeec-5eeeddbd03e9" (UID: "8843bbab-4fdb-40fb-aeec-5eeeddbd03e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:49:26.742085 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:26.742003    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8843bbab-4fdb-40fb-aeec-5eeeddbd03e9-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:49:27.458097 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:27.458058    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"
Sep 11 19:49:27.458321 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:27.458101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd" event={"ID":"8843bbab-4fdb-40fb-aeec-5eeeddbd03e9","Type":"ContainerDied","Data":"960e15c801450798fa4e922b3da39b6e05a6692c70c42cdcc44f5ca4d24cbaaf"}
Sep 11 19:49:27.458321 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:27.458147    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="960e15c801450798fa4e922b3da39b6e05a6692c70c42cdcc44f5ca4d24cbaaf"
Sep 11 19:49:34.476412 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.476372    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"]
Sep 11 19:49:34.477259 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.477226    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph" podUID="b37370b6-070c-4b75-b5d2-cd3d20c904ad" containerName="payload-pre-processing" containerID="cri-o://db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f" gracePeriod=30
Sep 11 19:49:34.637749 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.637715    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"]
Sep 11 19:49:34.643180 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.643149    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-40573d-96qfd"]
Sep 11 19:49:34.753749 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.753715    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:49:34.821425 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.821394    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b37370b6-070c-4b75-b5d2-cd3d20c904ad-plugins-config-volume\") pod \"b37370b6-070c-4b75-b5d2-cd3d20c904ad\" (UID: \"b37370b6-070c-4b75-b5d2-cd3d20c904ad\") "
Sep 11 19:49:34.821580 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.821474    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4cjp\" (UniqueName: \"kubernetes.io/projected/b37370b6-070c-4b75-b5d2-cd3d20c904ad-kube-api-access-l4cjp\") pod \"b37370b6-070c-4b75-b5d2-cd3d20c904ad\" (UID: \"b37370b6-070c-4b75-b5d2-cd3d20c904ad\") "
Sep 11 19:49:34.821854 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.821829    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b37370b6-070c-4b75-b5d2-cd3d20c904ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b37370b6-070c-4b75-b5d2-cd3d20c904ad" (UID: "b37370b6-070c-4b75-b5d2-cd3d20c904ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:49:34.823582 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.823562    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b37370b6-070c-4b75-b5d2-cd3d20c904ad-kube-api-access-l4cjp" (OuterVolumeSpecName: "kube-api-access-l4cjp") pod "b37370b6-070c-4b75-b5d2-cd3d20c904ad" (UID: "b37370b6-070c-4b75-b5d2-cd3d20c904ad"). InnerVolumeSpecName "kube-api-access-l4cjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:49:34.922654 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.922619    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b37370b6-070c-4b75-b5d2-cd3d20c904ad-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:49:34.922654 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:34.922645    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4cjp\" (UniqueName: \"kubernetes.io/projected/b37370b6-070c-4b75-b5d2-cd3d20c904ad-kube-api-access-l4cjp\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:49:35.508538 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:35.508501    2580 generic.go:356] "Generic (PLEG): container finished" podID="b37370b6-070c-4b75-b5d2-cd3d20c904ad" containerID="db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f" exitCode=0
Sep 11 19:49:35.508987 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:35.508543    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"
Sep 11 19:49:35.508987 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:35.508536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph" event={"ID":"b37370b6-070c-4b75-b5d2-cd3d20c904ad","Type":"ContainerDied","Data":"db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f"}
Sep 11 19:49:35.508987 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:35.508669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph" event={"ID":"b37370b6-070c-4b75-b5d2-cd3d20c904ad","Type":"ContainerDied","Data":"8af21f25740860a6ee08f85b5328d662919be7b239c36f98c36d8169fe1a0a97"}
Sep 11 19:49:35.508987 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:35.508692    2580 scope.go:117] "RemoveContainer" containerID="db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f"
Sep 11 19:49:35.518621 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:35.518604    2580 scope.go:117] "RemoveContainer" containerID="db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f"
Sep 11 19:49:35.518880 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:49:35.518863    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f\": container with ID starting with db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f not found: ID does not exist" containerID="db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f"
Sep 11 19:49:35.518918 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:35.518889    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f"} err="failed to get container status \"db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f\": rpc error: code = NotFound desc = could not find container \"db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f\": container with ID starting with db2a5b6cea5c59489a71fc0a3ea57c084011e1507ef8cf27752bc23cc807ec1f not found: ID does not exist"
Sep 11 19:49:35.529845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:35.529821    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"]
Sep 11 19:49:35.533596 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:35.533574    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40573d-55c7d5c9c4-x6sph"]
Sep 11 19:49:36.449187 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:36.449151    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8843bbab-4fdb-40fb-aeec-5eeeddbd03e9" path="/var/lib/kubelet/pods/8843bbab-4fdb-40fb-aeec-5eeeddbd03e9/volumes"
Sep 11 19:49:36.449603 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:36.449587    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b37370b6-070c-4b75-b5d2-cd3d20c904ad" path="/var/lib/kubelet/pods/b37370b6-070c-4b75-b5d2-cd3d20c904ad/volumes"
Sep 11 19:49:44.785560 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.785462    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"]
Sep 11 19:49:44.786013 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.785994    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b37370b6-070c-4b75-b5d2-cd3d20c904ad" containerName="payload-pre-processing"
Sep 11 19:49:44.786069 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.786015    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37370b6-070c-4b75-b5d2-cd3d20c904ad" containerName="payload-pre-processing"
Sep 11 19:49:44.786069 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.786041    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8843bbab-4fdb-40fb-aeec-5eeeddbd03e9" containerName="revoke-keys"
Sep 11 19:49:44.786069 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.786048    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8843bbab-4fdb-40fb-aeec-5eeeddbd03e9" containerName="revoke-keys"
Sep 11 19:49:44.786173 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.786150    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b37370b6-070c-4b75-b5d2-cd3d20c904ad" containerName="payload-pre-processing"
Sep 11 19:49:44.786173 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.786164    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8843bbab-4fdb-40fb-aeec-5eeeddbd03e9" containerName="revoke-keys"
Sep 11 19:49:44.790604 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.790585    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"
Sep 11 19:49:44.792908 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.792880    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:49:44.793024 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.792882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:49:44.796129 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.796106    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"]
Sep 11 19:49:44.921129 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:44.921097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb09b90-f827-4ee6-92bb-445a7cf4e337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5\" (UID: \"aeb09b90-f827-4ee6-92bb-445a7cf4e337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"
Sep 11 19:49:45.022182 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:45.022141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb09b90-f827-4ee6-92bb-445a7cf4e337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5\" (UID: \"aeb09b90-f827-4ee6-92bb-445a7cf4e337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"
Sep 11 19:49:45.022793 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:45.022770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb09b90-f827-4ee6-92bb-445a7cf4e337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5\" (UID: \"aeb09b90-f827-4ee6-92bb-445a7cf4e337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"
Sep 11 19:49:45.103226 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:45.103134    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"
Sep 11 19:49:45.376246 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:45.376210    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"]
Sep 11 19:49:45.377819 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:49:45.377792    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb09b90_f827_4ee6_92bb_445a7cf4e337.slice/crio-1e655fa57cd49c373db796ce694c974236f63897136d0647abf6eceab3ef74c0 WatchSource:0}: Error finding container 1e655fa57cd49c373db796ce694c974236f63897136d0647abf6eceab3ef74c0: Status 404 returned error can't find the container with id 1e655fa57cd49c373db796ce694c974236f63897136d0647abf6eceab3ef74c0
Sep 11 19:49:45.573227 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:45.573191    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5" event={"ID":"aeb09b90-f827-4ee6-92bb-445a7cf4e337","Type":"ContainerStarted","Data":"1e655fa57cd49c373db796ce694c974236f63897136d0647abf6eceab3ef74c0"}
Sep 11 19:49:46.580129 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:46.580091    2580 generic.go:356] "Generic (PLEG): container finished" podID="aeb09b90-f827-4ee6-92bb-445a7cf4e337" containerID="e7ffc92e9b5107dd5002d0ff73934ef05ce14630dfe564d7d20a592df3d6c5cf" exitCode=0
Sep 11 19:49:46.580552 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:46.580177    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5" event={"ID":"aeb09b90-f827-4ee6-92bb-445a7cf4e337","Type":"ContainerDied","Data":"e7ffc92e9b5107dd5002d0ff73934ef05ce14630dfe564d7d20a592df3d6c5cf"}
Sep 11 19:49:47.732923 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:47.732896    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"
Sep 11 19:49:47.850708 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:47.850612    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb09b90-f827-4ee6-92bb-445a7cf4e337-maas-api-service-ca\") pod \"aeb09b90-f827-4ee6-92bb-445a7cf4e337\" (UID: \"aeb09b90-f827-4ee6-92bb-445a7cf4e337\") "
Sep 11 19:49:47.850982 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:47.850959    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeb09b90-f827-4ee6-92bb-445a7cf4e337-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aeb09b90-f827-4ee6-92bb-445a7cf4e337" (UID: "aeb09b90-f827-4ee6-92bb-445a7cf4e337"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:49:47.951654 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:47.951602    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb09b90-f827-4ee6-92bb-445a7cf4e337-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:49:48.593609 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:48.593579    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"
Sep 11 19:49:48.593824 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:48.593620    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5" event={"ID":"aeb09b90-f827-4ee6-92bb-445a7cf4e337","Type":"ContainerDied","Data":"1e655fa57cd49c373db796ce694c974236f63897136d0647abf6eceab3ef74c0"}
Sep 11 19:49:48.593824 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:49:48.593674    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e655fa57cd49c373db796ce694c974236f63897136d0647abf6eceab3ef74c0"
Sep 11 19:50:00.353821 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.353783    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"]
Sep 11 19:50:00.354395 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.354020    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k" podUID="d0d718c8-7b4a-4626-975b-d05808d327d3" containerName="payload-processing" containerID="cri-o://6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f" gracePeriod=30
Sep 11 19:50:00.362160 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.362125    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"]
Sep 11 19:50:00.362393 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.362365    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh" podUID="9e363ca1-685d-40fb-976c-d3f1b2160bca" containerName="payload-pre-processing" containerID="cri-o://d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9" gracePeriod=30
Sep 11 19:50:00.530961 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.530904    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"]
Sep 11 19:50:00.536770 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.536699    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c0a42d-xjnw5"]
Sep 11 19:50:00.605147 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.605086    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:50:00.643273 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.643248    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:50:00.675424 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.675381    2580 generic.go:356] "Generic (PLEG): container finished" podID="d0d718c8-7b4a-4626-975b-d05808d327d3" containerID="6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f" exitCode=0
Sep 11 19:50:00.675718 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.675685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k" event={"ID":"d0d718c8-7b4a-4626-975b-d05808d327d3","Type":"ContainerDied","Data":"6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f"}
Sep 11 19:50:00.675824 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.675779    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k" event={"ID":"d0d718c8-7b4a-4626-975b-d05808d327d3","Type":"ContainerDied","Data":"d718c645e82c221ab4f5974cd55c5ab019a570df869918aa33f8631163a5a1c7"}
Sep 11 19:50:00.675888 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.675846    2580 scope.go:117] "RemoveContainer" containerID="6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f"
Sep 11 19:50:00.676095 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.676076    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"
Sep 11 19:50:00.678442 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.678413    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxvgn\" (UniqueName: \"kubernetes.io/projected/d0d718c8-7b4a-4626-975b-d05808d327d3-kube-api-access-pxvgn\") pod \"d0d718c8-7b4a-4626-975b-d05808d327d3\" (UID: \"d0d718c8-7b4a-4626-975b-d05808d327d3\") "
Sep 11 19:50:00.678556 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.678502    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr5qg\" (UniqueName: \"kubernetes.io/projected/9e363ca1-685d-40fb-976c-d3f1b2160bca-kube-api-access-sr5qg\") pod \"9e363ca1-685d-40fb-976c-d3f1b2160bca\" (UID: \"9e363ca1-685d-40fb-976c-d3f1b2160bca\") "
Sep 11 19:50:00.678627 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.678617    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0d718c8-7b4a-4626-975b-d05808d327d3-plugins-config-volume\") pod \"d0d718c8-7b4a-4626-975b-d05808d327d3\" (UID: \"d0d718c8-7b4a-4626-975b-d05808d327d3\") "
Sep 11 19:50:00.678691 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.678654    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e363ca1-685d-40fb-976c-d3f1b2160bca-plugins-config-volume\") pod \"9e363ca1-685d-40fb-976c-d3f1b2160bca\" (UID: \"9e363ca1-685d-40fb-976c-d3f1b2160bca\") "
Sep 11 19:50:00.679516 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.679488    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e363ca1-685d-40fb-976c-d3f1b2160bca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9e363ca1-685d-40fb-976c-d3f1b2160bca" (UID: "9e363ca1-685d-40fb-976c-d3f1b2160bca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:50:00.680006 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.679981    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d718c8-7b4a-4626-975b-d05808d327d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d0d718c8-7b4a-4626-975b-d05808d327d3" (UID: "d0d718c8-7b4a-4626-975b-d05808d327d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:50:00.681719 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.681691    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e363ca1-685d-40fb-976c-d3f1b2160bca-kube-api-access-sr5qg" (OuterVolumeSpecName: "kube-api-access-sr5qg") pod "9e363ca1-685d-40fb-976c-d3f1b2160bca" (UID: "9e363ca1-685d-40fb-976c-d3f1b2160bca"). InnerVolumeSpecName "kube-api-access-sr5qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:50:00.684535 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.682943    2580 generic.go:356] "Generic (PLEG): container finished" podID="9e363ca1-685d-40fb-976c-d3f1b2160bca" containerID="d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9" exitCode=0
Sep 11 19:50:00.684535 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.682983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh" event={"ID":"9e363ca1-685d-40fb-976c-d3f1b2160bca","Type":"ContainerDied","Data":"d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9"}
Sep 11 19:50:00.684535 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.683026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh" event={"ID":"9e363ca1-685d-40fb-976c-d3f1b2160bca","Type":"ContainerDied","Data":"8cbd85ca697388fc1af55194070685705db0cf2ddd9aa7889e337fe46b602519"}
Sep 11 19:50:00.684535 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.683066    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d718c8-7b4a-4626-975b-d05808d327d3-kube-api-access-pxvgn" (OuterVolumeSpecName: "kube-api-access-pxvgn") pod "d0d718c8-7b4a-4626-975b-d05808d327d3" (UID: "d0d718c8-7b4a-4626-975b-d05808d327d3"). InnerVolumeSpecName "kube-api-access-pxvgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:50:00.684535 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.683097    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"
Sep 11 19:50:00.708374 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.708348    2580 scope.go:117] "RemoveContainer" containerID="6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f"
Sep 11 19:50:00.708826 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:50:00.708775    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f\": container with ID starting with 6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f not found: ID does not exist" containerID="6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f"
Sep 11 19:50:00.708945 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.708835    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f"} err="failed to get container status \"6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f\": rpc error: code = NotFound desc = could not find container \"6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f\": container with ID starting with 6780aaabf4c6156ca97bd88a0157a1e0bdac06243d14c921fa7c50e23847664f not found: ID does not exist"
Sep 11 19:50:00.708945 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.708858    2580 scope.go:117] "RemoveContainer" containerID="d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9"
Sep 11 19:50:00.717219 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.717194    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"]
Sep 11 19:50:00.718461 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.718430    2580 scope.go:117] "RemoveContainer" containerID="d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9"
Sep 11 19:50:00.718757 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:50:00.718736    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9\": container with ID starting with d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9 not found: ID does not exist" containerID="d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9"
Sep 11 19:50:00.718821 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.718770    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9"} err="failed to get container status \"d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9\": rpc error: code = NotFound desc = could not find container \"d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9\": container with ID starting with d0c1dd4f708f2d6e392e24e748903ea4692de9a4ff735abc03965662bf1f15c9 not found: ID does not exist"
Sep 11 19:50:00.723343 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.723322    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c0a42d-84766fd866-kb2nh"]
Sep 11 19:50:00.780156 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.780128    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr5qg\" (UniqueName: \"kubernetes.io/projected/9e363ca1-685d-40fb-976c-d3f1b2160bca-kube-api-access-sr5qg\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:00.780156 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.780150    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0d718c8-7b4a-4626-975b-d05808d327d3-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:00.780156 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.780162    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e363ca1-685d-40fb-976c-d3f1b2160bca-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:00.780382 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:00.780171    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxvgn\" (UniqueName: \"kubernetes.io/projected/d0d718c8-7b4a-4626-975b-d05808d327d3-kube-api-access-pxvgn\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:01.004376 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:01.004343    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"]
Sep 11 19:50:01.006821 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:01.006796    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c0a42d-5fdcfd67bf-4h94k"]
Sep 11 19:50:02.450098 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:02.450065    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e363ca1-685d-40fb-976c-d3f1b2160bca" path="/var/lib/kubelet/pods/9e363ca1-685d-40fb-976c-d3f1b2160bca/volumes"
Sep 11 19:50:02.450495 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:02.450464    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeb09b90-f827-4ee6-92bb-445a7cf4e337" path="/var/lib/kubelet/pods/aeb09b90-f827-4ee6-92bb-445a7cf4e337/volumes"
Sep 11 19:50:02.450787 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:02.450774    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d718c8-7b4a-4626-975b-d05808d327d3" path="/var/lib/kubelet/pods/d0d718c8-7b4a-4626-975b-d05808d327d3/volumes"
Sep 11 19:50:20.981006 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:20.980971    2580 scope.go:117] "RemoveContainer" containerID="4b63bf41b991e945f48de922c83d1646f3f3c80ef6269f0b16d24c27834387af"
Sep 11 19:50:20.990034 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:20.990011    2580 scope.go:117] "RemoveContainer" containerID="2de9e2a7462ff1b236bfbcc283f61c7a7c377e8d1b3def75568f6e747ae47be3"
Sep 11 19:50:54.345894 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.345859    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"]
Sep 11 19:50:54.346554 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.346090    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy" containerID="cri-o://2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393" gracePeriod=30
Sep 11 19:50:54.679613 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.679584    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"]
Sep 11 19:50:54.680004 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.679990    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d718c8-7b4a-4626-975b-d05808d327d3" containerName="payload-processing"
Sep 11 19:50:54.680052 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.680006    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d718c8-7b4a-4626-975b-d05808d327d3" containerName="payload-processing"
Sep 11 19:50:54.680052 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.680027    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e363ca1-685d-40fb-976c-d3f1b2160bca" containerName="payload-pre-processing"
Sep 11 19:50:54.680052 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.680033    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e363ca1-685d-40fb-976c-d3f1b2160bca" containerName="payload-pre-processing"
Sep 11 19:50:54.680052 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.680041    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb09b90-f827-4ee6-92bb-445a7cf4e337" containerName="revoke-keys"
Sep 11 19:50:54.680052 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.680048    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb09b90-f827-4ee6-92bb-445a7cf4e337" containerName="revoke-keys"
Sep 11 19:50:54.680212 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.680113    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e363ca1-685d-40fb-976c-d3f1b2160bca" containerName="payload-pre-processing"
Sep 11 19:50:54.680212 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.680125    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d718c8-7b4a-4626-975b-d05808d327d3" containerName="payload-processing"
Sep 11 19:50:54.680212 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.680133    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeb09b90-f827-4ee6-92bb-445a7cf4e337" containerName="revoke-keys"
Sep 11 19:50:54.683149 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.683131    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"
Sep 11 19:50:54.685374 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.685348    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:50:54.685505 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.685348    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:50:54.690814 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.690788    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"]
Sep 11 19:50:54.803752 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.803714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82008aa-e676-4336-bccd-5d3ea18ac3e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg\" (UID: \"b82008aa-e676-4336-bccd-5d3ea18ac3e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"
Sep 11 19:50:54.904620 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.904576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82008aa-e676-4336-bccd-5d3ea18ac3e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg\" (UID: \"b82008aa-e676-4336-bccd-5d3ea18ac3e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"
Sep 11 19:50:54.905193 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.905169    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82008aa-e676-4336-bccd-5d3ea18ac3e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg\" (UID: \"b82008aa-e676-4336-bccd-5d3ea18ac3e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"
Sep 11 19:50:54.994897 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:54.994808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"
Sep 11 19:50:55.272676 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:55.272648    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"]
Sep 11 19:50:55.273735 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:50:55.273712    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82008aa_e676_4336_bccd_5d3ea18ac3e1.slice/crio-60009fad94ab411b4f1f0f5dde86f24d9c24eb84ee7aaf7b33a60d7f45a3675b WatchSource:0}: Error finding container 60009fad94ab411b4f1f0f5dde86f24d9c24eb84ee7aaf7b33a60d7f45a3675b: Status 404 returned error can't find the container with id 60009fad94ab411b4f1f0f5dde86f24d9c24eb84ee7aaf7b33a60d7f45a3675b
Sep 11 19:50:56.013095 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:56.013066    2580 generic.go:356] "Generic (PLEG): container finished" podID="b82008aa-e676-4336-bccd-5d3ea18ac3e1" containerID="b7494acc6468a24e7723ec8780c2cb78c5d043484ab4b66aeb654d6fbd96c1c7" exitCode=0
Sep 11 19:50:56.013421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:56.013109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg" event={"ID":"b82008aa-e676-4336-bccd-5d3ea18ac3e1","Type":"ContainerDied","Data":"b7494acc6468a24e7723ec8780c2cb78c5d043484ab4b66aeb654d6fbd96c1c7"}
Sep 11 19:50:56.013421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:56.013162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg" event={"ID":"b82008aa-e676-4336-bccd-5d3ea18ac3e1","Type":"ContainerStarted","Data":"60009fad94ab411b4f1f0f5dde86f24d9c24eb84ee7aaf7b33a60d7f45a3675b"}
Sep 11 19:50:57.150926 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:57.150900    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"
Sep 11 19:50:57.226336 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:57.226305    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82008aa-e676-4336-bccd-5d3ea18ac3e1-maas-api-service-ca\") pod \"b82008aa-e676-4336-bccd-5d3ea18ac3e1\" (UID: \"b82008aa-e676-4336-bccd-5d3ea18ac3e1\") "
Sep 11 19:50:57.226670 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:57.226643    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82008aa-e676-4336-bccd-5d3ea18ac3e1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b82008aa-e676-4336-bccd-5d3ea18ac3e1" (UID: "b82008aa-e676-4336-bccd-5d3ea18ac3e1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:50:57.327889 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:57.327809    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82008aa-e676-4336-bccd-5d3ea18ac3e1-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:58.026743 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:58.026655    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"
Sep 11 19:50:58.026743 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:58.026691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg" event={"ID":"b82008aa-e676-4336-bccd-5d3ea18ac3e1","Type":"ContainerDied","Data":"60009fad94ab411b4f1f0f5dde86f24d9c24eb84ee7aaf7b33a60d7f45a3675b"}
Sep 11 19:50:58.026743 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:58.026742    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60009fad94ab411b4f1f0f5dde86f24d9c24eb84ee7aaf7b33a60d7f45a3675b"
Sep 11 19:50:59.601625 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.601600    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:50:59.751459 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751428    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-socket\") pod \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") "
Sep 11 19:50:59.751660 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751468    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-token\") pod \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") "
Sep 11 19:50:59.751660 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751574    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-credential-socket\") pod \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") "
Sep 11 19:50:59.751660 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751601    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istiod-ca-cert\") pod \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") "
Sep 11 19:50:59.751660 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751631    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-certs\") pod \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") "
Sep 11 19:50:59.751901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751665    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxd2l\" (UniqueName: \"kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-kube-api-access-lxd2l\") pod \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") "
Sep 11 19:50:59.751901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751689    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-data\") pod \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") "
Sep 11 19:50:59.751901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751720    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-podinfo\") pod \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") "
Sep 11 19:50:59.751901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751746    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-envoy\") pod \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\" (UID: \"7b9760b6-90f0-46ca-98d5-e9a161f77a74\") "
Sep 11 19:50:59.751901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751763    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b9760b6-90f0-46ca-98d5-e9a161f77a74" (UID: "7b9760b6-90f0-46ca-98d5-e9a161f77a74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:50:59.751901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751838    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b9760b6-90f0-46ca-98d5-e9a161f77a74" (UID: "7b9760b6-90f0-46ca-98d5-e9a161f77a74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:50:59.752214 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.751966    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b9760b6-90f0-46ca-98d5-e9a161f77a74" (UID: "7b9760b6-90f0-46ca-98d5-e9a161f77a74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:50:59.752214 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.752014    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b9760b6-90f0-46ca-98d5-e9a161f77a74" (UID: "7b9760b6-90f0-46ca-98d5-e9a161f77a74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:50:59.752214 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.752205    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b9760b6-90f0-46ca-98d5-e9a161f77a74" (UID: "7b9760b6-90f0-46ca-98d5-e9a161f77a74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:50:59.752409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.752258    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.752409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.752275    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.752409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.752311    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.752409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.752320    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.753829 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.753805    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b9760b6-90f0-46ca-98d5-e9a161f77a74" (UID: "7b9760b6-90f0-46ca-98d5-e9a161f77a74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:50:59.753946 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.753921    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-kube-api-access-lxd2l" (OuterVolumeSpecName: "kube-api-access-lxd2l") pod "7b9760b6-90f0-46ca-98d5-e9a161f77a74" (UID: "7b9760b6-90f0-46ca-98d5-e9a161f77a74"). InnerVolumeSpecName "kube-api-access-lxd2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:50:59.754195 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.754172    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b9760b6-90f0-46ca-98d5-e9a161f77a74" (UID: "7b9760b6-90f0-46ca-98d5-e9a161f77a74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:50:59.754323 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.754202    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b9760b6-90f0-46ca-98d5-e9a161f77a74" (UID: "7b9760b6-90f0-46ca-98d5-e9a161f77a74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:50:59.853569 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.853539    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.853569 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.853563    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.853569 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.853571    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.853775 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.853579    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b9760b6-90f0-46ca-98d5-e9a161f77a74-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.853775 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:50:59.853587    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxd2l\" (UniqueName: \"kubernetes.io/projected/7b9760b6-90f0-46ca-98d5-e9a161f77a74-kube-api-access-lxd2l\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:00.039363 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.039261    2580 generic.go:356] "Generic (PLEG): container finished" podID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerID="2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393" exitCode=0
Sep 11 19:51:00.039363 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.039328    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"
Sep 11 19:51:00.039363 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.039346    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" event={"ID":"7b9760b6-90f0-46ca-98d5-e9a161f77a74","Type":"ContainerDied","Data":"2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393"}
Sep 11 19:51:00.039579 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.039406    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx" event={"ID":"7b9760b6-90f0-46ca-98d5-e9a161f77a74","Type":"ContainerDied","Data":"543493c78ec0ea0e8b2d1dc5bade15552935fec3f948b9f0c8589cd78fb27de6"}
Sep 11 19:51:00.039579 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.039429    2580 scope.go:117] "RemoveContainer" containerID="2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393"
Sep 11 19:51:00.049361 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.049340    2580 scope.go:117] "RemoveContainer" containerID="d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d"
Sep 11 19:51:00.057650 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.057630    2580 scope.go:117] "RemoveContainer" containerID="2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393"
Sep 11 19:51:00.058077 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:51:00.058048    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393\": container with ID starting with 2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393 not found: ID does not exist" containerID="2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393"
Sep 11 19:51:00.058192 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.058087    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393"} err="failed to get container status \"2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393\": rpc error: code = NotFound desc = could not find container \"2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393\": container with ID starting with 2c037f8a66edd2a5abd0fbd8fb2849795565f09b9389a87413fce5fa7ae59393 not found: ID does not exist"
Sep 11 19:51:00.058192 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.058110    2580 scope.go:117] "RemoveContainer" containerID="d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d"
Sep 11 19:51:00.058645 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:51:00.058584    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d\": container with ID starting with d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d not found: ID does not exist" containerID="d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d"
Sep 11 19:51:00.058749 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.058640    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d"} err="failed to get container status \"d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d\": rpc error: code = NotFound desc = could not find container \"d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d\": container with ID starting with d5c349d1f50a353780318a9375cca716d5b1daabb9e84c4076b82869087c485d not found: ID does not exist"
Sep 11 19:51:00.061266 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.061239    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"]
Sep 11 19:51:00.066397 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.066376    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-c0a42d-openshift-default-584cb795bb-g5mvx"]
Sep 11 19:51:00.450468 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:00.450435    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" path="/var/lib/kubelet/pods/7b9760b6-90f0-46ca-98d5-e9a161f77a74/volumes"
Sep 11 19:51:05.300061 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.300016    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"]
Sep 11 19:51:05.300512 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.300355    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc" podUID="659ea779-1228-45b6-8ad3-9d3211bea306" containerName="payload-processing" containerID="cri-o://1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05" gracePeriod=30
Sep 11 19:51:05.307403 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.307375    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"]
Sep 11 19:51:05.307620 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.307593    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl" podUID="1e75ad74-cb82-4fad-82ef-98ebf80c6643" containerName="payload-pre-processing" containerID="cri-o://195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a" gracePeriod=30
Sep 11 19:51:05.468301 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.468252    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"]
Sep 11 19:51:05.470992 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.470954    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-904b94-wtjlg"]
Sep 11 19:51:05.560605 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.560544    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:51:05.592233 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.592208    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:51:05.703701 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.703663    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/659ea779-1228-45b6-8ad3-9d3211bea306-plugins-config-volume\") pod \"659ea779-1228-45b6-8ad3-9d3211bea306\" (UID: \"659ea779-1228-45b6-8ad3-9d3211bea306\") "
Sep 11 19:51:05.703901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.703721    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e75ad74-cb82-4fad-82ef-98ebf80c6643-plugins-config-volume\") pod \"1e75ad74-cb82-4fad-82ef-98ebf80c6643\" (UID: \"1e75ad74-cb82-4fad-82ef-98ebf80c6643\") "
Sep 11 19:51:05.703901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.703758    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf7mp\" (UniqueName: \"kubernetes.io/projected/1e75ad74-cb82-4fad-82ef-98ebf80c6643-kube-api-access-wf7mp\") pod \"1e75ad74-cb82-4fad-82ef-98ebf80c6643\" (UID: \"1e75ad74-cb82-4fad-82ef-98ebf80c6643\") "
Sep 11 19:51:05.703901 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.703849    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v54fb\" (UniqueName: \"kubernetes.io/projected/659ea779-1228-45b6-8ad3-9d3211bea306-kube-api-access-v54fb\") pod \"659ea779-1228-45b6-8ad3-9d3211bea306\" (UID: \"659ea779-1228-45b6-8ad3-9d3211bea306\") "
Sep 11 19:51:05.704112 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.704089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/659ea779-1228-45b6-8ad3-9d3211bea306-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "659ea779-1228-45b6-8ad3-9d3211bea306" (UID: "659ea779-1228-45b6-8ad3-9d3211bea306"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:05.704182 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.704125    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e75ad74-cb82-4fad-82ef-98ebf80c6643-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e75ad74-cb82-4fad-82ef-98ebf80c6643" (UID: "1e75ad74-cb82-4fad-82ef-98ebf80c6643"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:05.705989 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.705964    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/659ea779-1228-45b6-8ad3-9d3211bea306-kube-api-access-v54fb" (OuterVolumeSpecName: "kube-api-access-v54fb") pod "659ea779-1228-45b6-8ad3-9d3211bea306" (UID: "659ea779-1228-45b6-8ad3-9d3211bea306"). InnerVolumeSpecName "kube-api-access-v54fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:05.706060 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.705968    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e75ad74-cb82-4fad-82ef-98ebf80c6643-kube-api-access-wf7mp" (OuterVolumeSpecName: "kube-api-access-wf7mp") pod "1e75ad74-cb82-4fad-82ef-98ebf80c6643" (UID: "1e75ad74-cb82-4fad-82ef-98ebf80c6643"). InnerVolumeSpecName "kube-api-access-wf7mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:05.804984 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.804951    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf7mp\" (UniqueName: \"kubernetes.io/projected/1e75ad74-cb82-4fad-82ef-98ebf80c6643-kube-api-access-wf7mp\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:05.804984 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.804979    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v54fb\" (UniqueName: \"kubernetes.io/projected/659ea779-1228-45b6-8ad3-9d3211bea306-kube-api-access-v54fb\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:05.804984 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.804989    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/659ea779-1228-45b6-8ad3-9d3211bea306-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:05.805210 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:05.804997    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e75ad74-cb82-4fad-82ef-98ebf80c6643-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:06.076606 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.076573    2580 generic.go:356] "Generic (PLEG): container finished" podID="659ea779-1228-45b6-8ad3-9d3211bea306" containerID="1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05" exitCode=0
Sep 11 19:51:06.076790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.076620    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"
Sep 11 19:51:06.076790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.076663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc" event={"ID":"659ea779-1228-45b6-8ad3-9d3211bea306","Type":"ContainerDied","Data":"1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05"}
Sep 11 19:51:06.076790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.076716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc" event={"ID":"659ea779-1228-45b6-8ad3-9d3211bea306","Type":"ContainerDied","Data":"9c10d60b64b669b1ebd3737b9f0d2f72771d14e459e54a51ec250e0149bd9d0b"}
Sep 11 19:51:06.076790 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.076744    2580 scope.go:117] "RemoveContainer" containerID="1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05"
Sep 11 19:51:06.078266 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.078245    2580 generic.go:356] "Generic (PLEG): container finished" podID="1e75ad74-cb82-4fad-82ef-98ebf80c6643" containerID="195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a" exitCode=0
Sep 11 19:51:06.078423 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.078274    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl" event={"ID":"1e75ad74-cb82-4fad-82ef-98ebf80c6643","Type":"ContainerDied","Data":"195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a"}
Sep 11 19:51:06.078423 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.078318    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"
Sep 11 19:51:06.078423 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.078349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl" event={"ID":"1e75ad74-cb82-4fad-82ef-98ebf80c6643","Type":"ContainerDied","Data":"27ae2ac4350fc35686bc2a280634139109fc776d317e060a1dfb056312af29a2"}
Sep 11 19:51:06.087090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.087062    2580 scope.go:117] "RemoveContainer" containerID="1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05"
Sep 11 19:51:06.087432 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:51:06.087409    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05\": container with ID starting with 1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05 not found: ID does not exist" containerID="1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05"
Sep 11 19:51:06.087537 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.087437    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05"} err="failed to get container status \"1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05\": rpc error: code = NotFound desc = could not find container \"1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05\": container with ID starting with 1da46bf4c5b6fedf36a5d1756632e7d05b64a62391dddea7bc487df9ea92ae05 not found: ID does not exist"
Sep 11 19:51:06.087537 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.087455    2580 scope.go:117] "RemoveContainer" containerID="195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a"
Sep 11 19:51:06.095942 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.095923    2580 scope.go:117] "RemoveContainer" containerID="195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a"
Sep 11 19:51:06.096180 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:51:06.096160    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a\": container with ID starting with 195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a not found: ID does not exist" containerID="195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a"
Sep 11 19:51:06.096244 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.096189    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a"} err="failed to get container status \"195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a\": rpc error: code = NotFound desc = could not find container \"195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a\": container with ID starting with 195e7fcc4563202f0a6298fe37307813093e6b2b429ce5423911a501fc29735a not found: ID does not exist"
Sep 11 19:51:06.116025 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.115996    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"]
Sep 11 19:51:06.123632 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.123608    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-904b94-796b547d95-2shnc"]
Sep 11 19:51:06.141582 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.141533    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"]
Sep 11 19:51:06.144252 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.144232    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-904b94-79646c5d5d-m2bjl"]
Sep 11 19:51:06.449044 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.449005    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e75ad74-cb82-4fad-82ef-98ebf80c6643" path="/var/lib/kubelet/pods/1e75ad74-cb82-4fad-82ef-98ebf80c6643/volumes"
Sep 11 19:51:06.449439 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.449408    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="659ea779-1228-45b6-8ad3-9d3211bea306" path="/var/lib/kubelet/pods/659ea779-1228-45b6-8ad3-9d3211bea306/volumes"
Sep 11 19:51:06.449711 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:06.449698    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82008aa-e676-4336-bccd-5d3ea18ac3e1" path="/var/lib/kubelet/pods/b82008aa-e676-4336-bccd-5d3ea18ac3e1/volumes"
Sep 11 19:51:12.182009 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.181968    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"]
Sep 11 19:51:12.182421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182359    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy"
Sep 11 19:51:12.182421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182372    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy"
Sep 11 19:51:12.182421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182384    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e75ad74-cb82-4fad-82ef-98ebf80c6643" containerName="payload-pre-processing"
Sep 11 19:51:12.182421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182390    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e75ad74-cb82-4fad-82ef-98ebf80c6643" containerName="payload-pre-processing"
Sep 11 19:51:12.182421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182401    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy"
Sep 11 19:51:12.182421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182407    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy"
Sep 11 19:51:12.182421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182413    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82008aa-e676-4336-bccd-5d3ea18ac3e1" containerName="revoke-keys"
Sep 11 19:51:12.182421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182418    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82008aa-e676-4336-bccd-5d3ea18ac3e1" containerName="revoke-keys"
Sep 11 19:51:12.182679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182427    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="659ea779-1228-45b6-8ad3-9d3211bea306" containerName="payload-processing"
Sep 11 19:51:12.182679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182432    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="659ea779-1228-45b6-8ad3-9d3211bea306" containerName="payload-processing"
Sep 11 19:51:12.182679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182499    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy"
Sep 11 19:51:12.182679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182506    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="659ea779-1228-45b6-8ad3-9d3211bea306" containerName="payload-processing"
Sep 11 19:51:12.182679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182514    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82008aa-e676-4336-bccd-5d3ea18ac3e1" containerName="revoke-keys"
Sep 11 19:51:12.182679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182520    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b9760b6-90f0-46ca-98d5-e9a161f77a74" containerName="istio-proxy"
Sep 11 19:51:12.182679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.182525    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e75ad74-cb82-4fad-82ef-98ebf80c6643" containerName="payload-pre-processing"
Sep 11 19:51:12.187177 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.187158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"
Sep 11 19:51:12.189780 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.189751    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:51:12.189908 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.189765    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:51:12.192763 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.192734    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"]
Sep 11 19:51:12.373131 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.373092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/601a0980-927c-4f59-bff9-4fd77329c4c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9\" (UID: \"601a0980-927c-4f59-bff9-4fd77329c4c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"
Sep 11 19:51:12.474702 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.474611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/601a0980-927c-4f59-bff9-4fd77329c4c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9\" (UID: \"601a0980-927c-4f59-bff9-4fd77329c4c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"
Sep 11 19:51:12.475251 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.475231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/601a0980-927c-4f59-bff9-4fd77329c4c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9\" (UID: \"601a0980-927c-4f59-bff9-4fd77329c4c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"
Sep 11 19:51:12.500242 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.500193    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"
Sep 11 19:51:12.776118 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:12.776089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"]
Sep 11 19:51:12.777593 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:51:12.777557    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601a0980_927c_4f59_bff9_4fd77329c4c3.slice/crio-e1ffd5cf9102bd2ce0241ecccd66d7b407f696fc82565ddb0beb768a5f065248 WatchSource:0}: Error finding container e1ffd5cf9102bd2ce0241ecccd66d7b407f696fc82565ddb0beb768a5f065248: Status 404 returned error can't find the container with id e1ffd5cf9102bd2ce0241ecccd66d7b407f696fc82565ddb0beb768a5f065248
Sep 11 19:51:13.121959 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:13.121928    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9" event={"ID":"601a0980-927c-4f59-bff9-4fd77329c4c3","Type":"ContainerStarted","Data":"14c4bb140b5fdc55da9dccd262ba90f88f4f933927f8285473d8fad37265dff8"}
Sep 11 19:51:13.122083 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:13.121986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9" event={"ID":"601a0980-927c-4f59-bff9-4fd77329c4c3","Type":"ContainerStarted","Data":"e1ffd5cf9102bd2ce0241ecccd66d7b407f696fc82565ddb0beb768a5f065248"}
Sep 11 19:51:13.139914 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:13.139863    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9" podStartSLOduration=1.139849535 podStartE2EDuration="1.139849535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:51:13.136986441 +0000 UTC m=+1973.158194594" watchObservedRunningTime="2026-09-11 19:51:13.139849535 +0000 UTC m=+1973.161057684"
Sep 11 19:51:14.129298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:14.129233    2580 generic.go:356] "Generic (PLEG): container finished" podID="601a0980-927c-4f59-bff9-4fd77329c4c3" containerID="14c4bb140b5fdc55da9dccd262ba90f88f4f933927f8285473d8fad37265dff8" exitCode=0
Sep 11 19:51:14.129298 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:14.129291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9" event={"ID":"601a0980-927c-4f59-bff9-4fd77329c4c3","Type":"ContainerDied","Data":"14c4bb140b5fdc55da9dccd262ba90f88f4f933927f8285473d8fad37265dff8"}
Sep 11 19:51:15.262387 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:15.262361    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"
Sep 11 19:51:15.403640 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:15.403555    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/601a0980-927c-4f59-bff9-4fd77329c4c3-maas-api-service-ca\") pod \"601a0980-927c-4f59-bff9-4fd77329c4c3\" (UID: \"601a0980-927c-4f59-bff9-4fd77329c4c3\") "
Sep 11 19:51:15.403878 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:15.403854    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/601a0980-927c-4f59-bff9-4fd77329c4c3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "601a0980-927c-4f59-bff9-4fd77329c4c3" (UID: "601a0980-927c-4f59-bff9-4fd77329c4c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:15.505235 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:15.505200    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/601a0980-927c-4f59-bff9-4fd77329c4c3-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:16.140974 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:16.140945    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"
Sep 11 19:51:16.141151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:16.140982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9" event={"ID":"601a0980-927c-4f59-bff9-4fd77329c4c3","Type":"ContainerDied","Data":"e1ffd5cf9102bd2ce0241ecccd66d7b407f696fc82565ddb0beb768a5f065248"}
Sep 11 19:51:16.141151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:16.141035    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1ffd5cf9102bd2ce0241ecccd66d7b407f696fc82565ddb0beb768a5f065248"
Sep 11 19:51:22.728601 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:22.728564    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"]
Sep 11 19:51:22.729071 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:22.728776    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7" podUID="9aded2c5-134b-4709-8fad-dc5fc4538fa9" containerName="payload-processing" containerID="cri-o://6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9" gracePeriod=30
Sep 11 19:51:22.983728 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:22.983654    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:51:22.990986 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:22.990959    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"]
Sep 11 19:51:22.994178 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:22.994154    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-19859a-ttkb9"]
Sep 11 19:51:23.067067 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.067032    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9aded2c5-134b-4709-8fad-dc5fc4538fa9-plugins-config-volume\") pod \"9aded2c5-134b-4709-8fad-dc5fc4538fa9\" (UID: \"9aded2c5-134b-4709-8fad-dc5fc4538fa9\") "
Sep 11 19:51:23.067251 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.067124    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwglj\" (UniqueName: \"kubernetes.io/projected/9aded2c5-134b-4709-8fad-dc5fc4538fa9-kube-api-access-fwglj\") pod \"9aded2c5-134b-4709-8fad-dc5fc4538fa9\" (UID: \"9aded2c5-134b-4709-8fad-dc5fc4538fa9\") "
Sep 11 19:51:23.067442 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.067420    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aded2c5-134b-4709-8fad-dc5fc4538fa9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9aded2c5-134b-4709-8fad-dc5fc4538fa9" (UID: "9aded2c5-134b-4709-8fad-dc5fc4538fa9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:23.069117 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.069097    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aded2c5-134b-4709-8fad-dc5fc4538fa9-kube-api-access-fwglj" (OuterVolumeSpecName: "kube-api-access-fwglj") pod "9aded2c5-134b-4709-8fad-dc5fc4538fa9" (UID: "9aded2c5-134b-4709-8fad-dc5fc4538fa9"). InnerVolumeSpecName "kube-api-access-fwglj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:23.167926 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.167884    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9aded2c5-134b-4709-8fad-dc5fc4538fa9-plugins-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:23.167926 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.167919    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwglj\" (UniqueName: \"kubernetes.io/projected/9aded2c5-134b-4709-8fad-dc5fc4538fa9-kube-api-access-fwglj\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:23.181992 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.181959    2580 generic.go:356] "Generic (PLEG): container finished" podID="9aded2c5-134b-4709-8fad-dc5fc4538fa9" containerID="6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9" exitCode=0
Sep 11 19:51:23.182169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.182003    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"
Sep 11 19:51:23.182169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.182048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7" event={"ID":"9aded2c5-134b-4709-8fad-dc5fc4538fa9","Type":"ContainerDied","Data":"6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9"}
Sep 11 19:51:23.182169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.182116    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7" event={"ID":"9aded2c5-134b-4709-8fad-dc5fc4538fa9","Type":"ContainerDied","Data":"4854852ba5aede5ddd68194ea6b5509734b8769561b3980dc42eba1f467e8ced"}
Sep 11 19:51:23.182169 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.182146    2580 scope.go:117] "RemoveContainer" containerID="6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9"
Sep 11 19:51:23.191299 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.191263    2580 scope.go:117] "RemoveContainer" containerID="6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9"
Sep 11 19:51:23.191652 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:51:23.191634    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9\": container with ID starting with 6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9 not found: ID does not exist" containerID="6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9"
Sep 11 19:51:23.191697 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.191662    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9"} err="failed to get container status \"6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9\": rpc error: code = NotFound desc = could not find container \"6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9\": container with ID starting with 6be26643e13fe9f529b61a0a75444c532f2017e6c42102286146f4ba0c6498c9 not found: ID does not exist"
Sep 11 19:51:23.206480 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.206457    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"]
Sep 11 19:51:23.211555 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:23.211519    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-19859a-668f75885c-cr7m7"]
Sep 11 19:51:24.449276 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:24.449227    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="601a0980-927c-4f59-bff9-4fd77329c4c3" path="/var/lib/kubelet/pods/601a0980-927c-4f59-bff9-4fd77329c4c3/volumes"
Sep 11 19:51:24.449840 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:24.449817    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aded2c5-134b-4709-8fad-dc5fc4538fa9" path="/var/lib/kubelet/pods/9aded2c5-134b-4709-8fad-dc5fc4538fa9/volumes"
Sep 11 19:51:29.772686 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.772649    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"]
Sep 11 19:51:29.773143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.773022    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aded2c5-134b-4709-8fad-dc5fc4538fa9" containerName="payload-processing"
Sep 11 19:51:29.773143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.773033    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aded2c5-134b-4709-8fad-dc5fc4538fa9" containerName="payload-processing"
Sep 11 19:51:29.773143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.773055    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601a0980-927c-4f59-bff9-4fd77329c4c3" containerName="revoke-keys"
Sep 11 19:51:29.773143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.773061    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="601a0980-927c-4f59-bff9-4fd77329c4c3" containerName="revoke-keys"
Sep 11 19:51:29.773143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.773109    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aded2c5-134b-4709-8fad-dc5fc4538fa9" containerName="payload-processing"
Sep 11 19:51:29.773143 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.773122    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="601a0980-927c-4f59-bff9-4fd77329c4c3" containerName="revoke-keys"
Sep 11 19:51:29.776358 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.776339    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"
Sep 11 19:51:29.778608 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.778579    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:51:29.778699 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.778650    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:51:29.782765 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.782741    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"]
Sep 11 19:51:29.828971 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.828939    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef85283-1b07-4982-be54-ace89fdd447a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q\" (UID: \"bef85283-1b07-4982-be54-ace89fdd447a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"
Sep 11 19:51:29.929729 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.929691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef85283-1b07-4982-be54-ace89fdd447a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q\" (UID: \"bef85283-1b07-4982-be54-ace89fdd447a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"
Sep 11 19:51:29.930272 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:29.930252    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef85283-1b07-4982-be54-ace89fdd447a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q\" (UID: \"bef85283-1b07-4982-be54-ace89fdd447a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"
Sep 11 19:51:30.088514 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:30.088415    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"
Sep 11 19:51:30.361241 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:30.361209    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"]
Sep 11 19:51:30.362308 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:51:30.362267    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef85283_1b07_4982_be54_ace89fdd447a.slice/crio-2f39d421479c56cabcdadec46e427b5e99555e6b18e089d57e4089dc6300a572 WatchSource:0}: Error finding container 2f39d421479c56cabcdadec46e427b5e99555e6b18e089d57e4089dc6300a572: Status 404 returned error can't find the container with id 2f39d421479c56cabcdadec46e427b5e99555e6b18e089d57e4089dc6300a572
Sep 11 19:51:31.226900 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:31.226855    2580 generic.go:356] "Generic (PLEG): container finished" podID="bef85283-1b07-4982-be54-ace89fdd447a" containerID="302f96a1d5af000e68a56c98559ef35520a8ce499ae92406a847527ae312fc64" exitCode=0
Sep 11 19:51:31.227357 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:31.226949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q" event={"ID":"bef85283-1b07-4982-be54-ace89fdd447a","Type":"ContainerDied","Data":"302f96a1d5af000e68a56c98559ef35520a8ce499ae92406a847527ae312fc64"}
Sep 11 19:51:31.227357 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:31.227004    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q" event={"ID":"bef85283-1b07-4982-be54-ace89fdd447a","Type":"ContainerStarted","Data":"2f39d421479c56cabcdadec46e427b5e99555e6b18e089d57e4089dc6300a572"}
Sep 11 19:51:32.385030 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:32.385001    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"
Sep 11 19:51:32.454026 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:32.453998    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef85283-1b07-4982-be54-ace89fdd447a-maas-api-service-ca\") pod \"bef85283-1b07-4982-be54-ace89fdd447a\" (UID: \"bef85283-1b07-4982-be54-ace89fdd447a\") "
Sep 11 19:51:32.454323 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:32.454303    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bef85283-1b07-4982-be54-ace89fdd447a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bef85283-1b07-4982-be54-ace89fdd447a" (UID: "bef85283-1b07-4982-be54-ace89fdd447a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:32.555056 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:32.554973    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef85283-1b07-4982-be54-ace89fdd447a-maas-api-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:33.239663 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:33.239624    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"
Sep 11 19:51:33.239839 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:33.239622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q" event={"ID":"bef85283-1b07-4982-be54-ace89fdd447a","Type":"ContainerDied","Data":"2f39d421479c56cabcdadec46e427b5e99555e6b18e089d57e4089dc6300a572"}
Sep 11 19:51:33.239839 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:33.239762    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f39d421479c56cabcdadec46e427b5e99555e6b18e089d57e4089dc6300a572"
Sep 11 19:51:40.262486 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:40.262444    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn"]
Sep 11 19:51:40.266742 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:40.266702    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-abcdff-29819265-qg8pn"]
Sep 11 19:51:40.449198 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:40.449167    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67a348b2-bf92-4ab1-85ed-f096cb9cd658" path="/var/lib/kubelet/pods/67a348b2-bf92-4ab1-85ed-f096cb9cd658/volumes"
Sep 11 19:51:40.458291 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:40.458249    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"]
Sep 11 19:51:40.461939 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:40.461917    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-abcdff-v752q"]
Sep 11 19:51:42.449889 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:42.449848    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bef85283-1b07-4982-be54-ace89fdd447a" path="/var/lib/kubelet/pods/bef85283-1b07-4982-be54-ace89fdd447a/volumes"
Sep 11 19:51:46.958359 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:46.955401    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"]
Sep 11 19:51:46.958359 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:46.955770    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy" containerID="cri-o://107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440" gracePeriod=30
Sep 11 19:51:52.253136 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.253102    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:51:52.343182 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343142    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-credential-socket\") pod \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") "
Sep 11 19:51:52.343401 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343199    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2ck7\" (UniqueName: \"kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-kube-api-access-z2ck7\") pod \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") "
Sep 11 19:51:52.343401 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istiod-ca-cert\") pod \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") "
Sep 11 19:51:52.343401 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343352    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-certs\") pod \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") "
Sep 11 19:51:52.343401 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343381    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-podinfo\") pod \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") "
Sep 11 19:51:52.343630 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343496    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f2f287a-3576-43d2-93b6-a17eff72d6e1" (UID: "7f2f287a-3576-43d2-93b6-a17eff72d6e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:52.343630 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343505    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-envoy\") pod \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") "
Sep 11 19:51:52.343630 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343605    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-data\") pod \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") "
Sep 11 19:51:52.343796 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343654    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-socket\") pod \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") "
Sep 11 19:51:52.343796 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343691    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-token\") pod \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\" (UID: \"7f2f287a-3576-43d2-93b6-a17eff72d6e1\") "
Sep 11 19:51:52.343796 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343784    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f2f287a-3576-43d2-93b6-a17eff72d6e1" (UID: "7f2f287a-3576-43d2-93b6-a17eff72d6e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:52.343963 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.343859    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f2f287a-3576-43d2-93b6-a17eff72d6e1" (UID: "7f2f287a-3576-43d2-93b6-a17eff72d6e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:52.344215 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.344094    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f2f287a-3576-43d2-93b6-a17eff72d6e1" (UID: "7f2f287a-3576-43d2-93b6-a17eff72d6e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:52.344215 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.344192    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:52.344215 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.344212    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:52.344450 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.344225    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:52.344450 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.344239    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:52.344651 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.344613    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f2f287a-3576-43d2-93b6-a17eff72d6e1" (UID: "7f2f287a-3576-43d2-93b6-a17eff72d6e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:52.345986 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.345955    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-kube-api-access-z2ck7" (OuterVolumeSpecName: "kube-api-access-z2ck7") pod "7f2f287a-3576-43d2-93b6-a17eff72d6e1" (UID: "7f2f287a-3576-43d2-93b6-a17eff72d6e1"). InnerVolumeSpecName "kube-api-access-z2ck7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:52.345986 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.345977    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f2f287a-3576-43d2-93b6-a17eff72d6e1" (UID: "7f2f287a-3576-43d2-93b6-a17eff72d6e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:52.346147 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.346007    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f2f287a-3576-43d2-93b6-a17eff72d6e1" (UID: "7f2f287a-3576-43d2-93b6-a17eff72d6e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:52.346147 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.346047    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f2f287a-3576-43d2-93b6-a17eff72d6e1" (UID: "7f2f287a-3576-43d2-93b6-a17eff72d6e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:51:52.349004 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.348979    2580 generic.go:356] "Generic (PLEG): container finished" podID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerID="107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440" exitCode=0
Sep 11 19:51:52.349109 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.349048    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"
Sep 11 19:51:52.349109 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.349059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" event={"ID":"7f2f287a-3576-43d2-93b6-a17eff72d6e1","Type":"ContainerDied","Data":"107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440"}
Sep 11 19:51:52.349196 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.349117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65" event={"ID":"7f2f287a-3576-43d2-93b6-a17eff72d6e1","Type":"ContainerDied","Data":"746d593f8691fd14a0d7c1210348933eece6dbaafed7109c71783fbb16967af4"}
Sep 11 19:51:52.349196 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.349140    2580 scope.go:117] "RemoveContainer" containerID="107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440"
Sep 11 19:51:52.368844 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.368818    2580 scope.go:117] "RemoveContainer" containerID="0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5"
Sep 11 19:51:52.377865 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.377836    2580 scope.go:117] "RemoveContainer" containerID="107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440"
Sep 11 19:51:52.378184 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:51:52.378164    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440\": container with ID starting with 107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440 not found: ID does not exist" containerID="107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440"
Sep 11 19:51:52.378266 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.378196    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440"} err="failed to get container status \"107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440\": rpc error: code = NotFound desc = could not find container \"107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440\": container with ID starting with 107fa9a478d2a90e3226ad8e48fc2a4f1c686bdf46dc860bf782a63527bee440 not found: ID does not exist"
Sep 11 19:51:52.378266 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.378219    2580 scope.go:117] "RemoveContainer" containerID="0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5"
Sep 11 19:51:52.386076 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.386029    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"]
Sep 11 19:51:52.386667 ip-10-0-138-5 kubenswrapper[2580]: E0911 19:51:52.386635    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5\": container with ID starting with 0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5 not found: ID does not exist" containerID="0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5"
Sep 11 19:51:52.386817 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.386796    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5"} err="failed to get container status \"0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5\": rpc error: code = NotFound desc = could not find container \"0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5\": container with ID starting with 0cc1955ca5b3dcd228becd28c7a8f2e9b4ba07905c61d28f14e13dec238fc9f5 not found: ID does not exist"
Sep 11 19:51:52.387111 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.387091    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-abcdff-openshift-default-f5cc7894-kcg65"]
Sep 11 19:51:52.445089 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.445050    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:52.445089 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.445084    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2ck7\" (UniqueName: \"kubernetes.io/projected/7f2f287a-3576-43d2-93b6-a17eff72d6e1-kube-api-access-z2ck7\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:52.445089 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.445095    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:52.445380 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.445104    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:52.445380 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.445112    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f2f287a-3576-43d2-93b6-a17eff72d6e1-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 11 19:51:52.448805 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:51:52.448777    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" path="/var/lib/kubelet/pods/7f2f287a-3576-43d2-93b6-a17eff72d6e1/volumes"
Sep 11 19:52:21.046162 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:52:21.046129    2580 scope.go:117] "RemoveContainer" containerID="d3372926788c2ebda7c847deca531863d6f00e4e0d3e47da97694c2cf4ede3e0"
Sep 11 19:53:20.603741 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:53:20.603709    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:53:20.612594 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:53:20.612572    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:56:21.101087 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:56:21.101053    2580 scope.go:117] "RemoveContainer" containerID="b1d13749bed8161943492f73fd96968f0faac05ef8cd13f3f4f7693bc32edf97"
Sep 11 19:56:21.109540 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:56:21.109514    2580 scope.go:117] "RemoveContainer" containerID="e7ffc92e9b5107dd5002d0ff73934ef05ce14630dfe564d7d20a592df3d6c5cf"
Sep 11 19:57:21.133492 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:57:21.133415    2580 scope.go:117] "RemoveContainer" containerID="14c4bb140b5fdc55da9dccd262ba90f88f4f933927f8285473d8fad37265dff8"
Sep 11 19:57:21.141875 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:57:21.141855    2580 scope.go:117] "RemoveContainer" containerID="b7494acc6468a24e7723ec8780c2cb78c5d043484ab4b66aeb654d6fbd96c1c7"
Sep 11 19:58:04.153221 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:04.153186    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-j9dd6_a393ac47-2f3c-4851-9026-8c2e09f13ea5/server/0.log"
Sep 11 19:58:04.267529 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:04.267502    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4s49q_e04ee1d2-005c-460d-858e-2a2ab1e52798/manager/0.log"
Sep 11 19:58:04.379039 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:04.379010    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6474799d6-bd7rk_345ea90b-6123-47cd-9990-ac482ab3a475/copy-manifests/0.log"
Sep 11 19:58:04.385351 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:04.385322    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6474799d6-bd7rk_345ea90b-6123-47cd-9990-ac482ab3a475/manager/0.log"
Sep 11 19:58:05.189145 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:05.189112    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819250-k96th_525a974f-6f74-4712-95c9-6e5adda26523/cleanup/0.log"
Sep 11 19:58:05.295541 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:05.295508    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819265-nct4b_5c5a6b3e-d06a-4aaa-b856-7d5ff1e3bde8/cleanup/0.log"
Sep 11 19:58:07.144293 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:07.144258    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5_e4c7eb7f-60ca-437c-80ab-0bb748c0c87d/istio-proxy/0.log"
Sep 11 19:58:07.268409 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:07.268374    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-682g5_04363e6c-d7f8-49b9-b8b8-8ff9a52cad96/discovery/0.log"
Sep 11 19:58:07.594722 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:07.594692    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p95bv_cf82a5cc-f061-40d4-b53d-4a846340e52a/istio-proxy/1.log"
Sep 11 19:58:07.715518 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:07.715485    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wwdmv_185f142d-d0e8-48a5-acc4-0ed64d45f8f4/payload-pre-processing/0.log"
Sep 11 19:58:08.369644 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:08.369612    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hjmjn_46b898a2-5406-46a6-a91c-3157f2f6f74c/main/0.log"
Sep 11 19:58:08.692094 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:08.692060    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn5x5k_8ba52405-bbed-4fb6-9dc5-1ecb701a75b6/main/0.log"
Sep 11 19:58:14.599773 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.599730    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4pg49/must-gather-52zgk"]
Sep 11 19:58:14.600155 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.600083    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy"
Sep 11 19:58:14.600155 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.600094    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy"
Sep 11 19:58:14.600155 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.600105    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef85283-1b07-4982-be54-ace89fdd447a" containerName="revoke-keys"
Sep 11 19:58:14.600155 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.600111    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef85283-1b07-4982-be54-ace89fdd447a" containerName="revoke-keys"
Sep 11 19:58:14.600155 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.600125    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy"
Sep 11 19:58:14.600155 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.600130    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy"
Sep 11 19:58:14.600421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.600214    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bef85283-1b07-4982-be54-ace89fdd447a" containerName="revoke-keys"
Sep 11 19:58:14.600421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.600221    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy"
Sep 11 19:58:14.600421 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.600228    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f2f287a-3576-43d2-93b6-a17eff72d6e1" containerName="istio-proxy"
Sep 11 19:58:14.603366 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.603345    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4pg49/must-gather-52zgk"
Sep 11 19:58:14.605973 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.605944    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4pg49\"/\"default-dockercfg-nxwjj\""
Sep 11 19:58:14.606095 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.606078    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4pg49\"/\"kube-root-ca.crt\""
Sep 11 19:58:14.606176 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.606158    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4pg49\"/\"openshift-service-ca.crt\""
Sep 11 19:58:14.613156 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.613129    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4pg49/must-gather-52zgk"]
Sep 11 19:58:14.679934 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.679894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxkb9\" (UniqueName: \"kubernetes.io/projected/f90c7a1e-85b6-4c49-b680-6f9fa1560cc4-kube-api-access-zxkb9\") pod \"must-gather-52zgk\" (UID: \"f90c7a1e-85b6-4c49-b680-6f9fa1560cc4\") " pod="openshift-must-gather-4pg49/must-gather-52zgk"
Sep 11 19:58:14.680125 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.680026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f90c7a1e-85b6-4c49-b680-6f9fa1560cc4-must-gather-output\") pod \"must-gather-52zgk\" (UID: \"f90c7a1e-85b6-4c49-b680-6f9fa1560cc4\") " pod="openshift-must-gather-4pg49/must-gather-52zgk"
Sep 11 19:58:14.781311 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.781246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f90c7a1e-85b6-4c49-b680-6f9fa1560cc4-must-gather-output\") pod \"must-gather-52zgk\" (UID: \"f90c7a1e-85b6-4c49-b680-6f9fa1560cc4\") " pod="openshift-must-gather-4pg49/must-gather-52zgk"
Sep 11 19:58:14.781506 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.781345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxkb9\" (UniqueName: \"kubernetes.io/projected/f90c7a1e-85b6-4c49-b680-6f9fa1560cc4-kube-api-access-zxkb9\") pod \"must-gather-52zgk\" (UID: \"f90c7a1e-85b6-4c49-b680-6f9fa1560cc4\") " pod="openshift-must-gather-4pg49/must-gather-52zgk"
Sep 11 19:58:14.781643 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.781619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f90c7a1e-85b6-4c49-b680-6f9fa1560cc4-must-gather-output\") pod \"must-gather-52zgk\" (UID: \"f90c7a1e-85b6-4c49-b680-6f9fa1560cc4\") " pod="openshift-must-gather-4pg49/must-gather-52zgk"
Sep 11 19:58:14.790731 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.790707    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxkb9\" (UniqueName: \"kubernetes.io/projected/f90c7a1e-85b6-4c49-b680-6f9fa1560cc4-kube-api-access-zxkb9\") pod \"must-gather-52zgk\" (UID: \"f90c7a1e-85b6-4c49-b680-6f9fa1560cc4\") " pod="openshift-must-gather-4pg49/must-gather-52zgk"
Sep 11 19:58:14.914114 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:14.914024    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4pg49/must-gather-52zgk"
Sep 11 19:58:15.187252 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:15.187218    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4pg49/must-gather-52zgk"]
Sep 11 19:58:15.188797 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:58:15.188769    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf90c7a1e_85b6_4c49_b680_6f9fa1560cc4.slice/crio-99b8a1b817d6e07227ca9d86106779b627b916a6adddc68b28eb01a371976080 WatchSource:0}: Error finding container 99b8a1b817d6e07227ca9d86106779b627b916a6adddc68b28eb01a371976080: Status 404 returned error can't find the container with id 99b8a1b817d6e07227ca9d86106779b627b916a6adddc68b28eb01a371976080
Sep 11 19:58:15.190854 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:15.190839    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:58:15.458801 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:15.458704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4pg49/must-gather-52zgk" event={"ID":"f90c7a1e-85b6-4c49-b680-6f9fa1560cc4","Type":"ContainerStarted","Data":"99b8a1b817d6e07227ca9d86106779b627b916a6adddc68b28eb01a371976080"}
Sep 11 19:58:16.465969 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:16.465931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4pg49/must-gather-52zgk" event={"ID":"f90c7a1e-85b6-4c49-b680-6f9fa1560cc4","Type":"ContainerStarted","Data":"7a37376e9b0949b7585c3f5c60f531777830593879376a0435ba3a2fa9a288b8"}
Sep 11 19:58:16.466457 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:16.465979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4pg49/must-gather-52zgk" event={"ID":"f90c7a1e-85b6-4c49-b680-6f9fa1560cc4","Type":"ContainerStarted","Data":"ed69f18ade83ac470d0a9c75c8a3479f44c56f12dde4845f98f7ba880bfc1993"}
Sep 11 19:58:16.480274 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:16.480216    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4pg49/must-gather-52zgk" podStartSLOduration=1.664275617 podStartE2EDuration="2.480196162s" totalImagesPullingTime="815.920545ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:58:16.479669582 +0000 UTC m=+2396.500877734" watchObservedRunningTime="2026-09-11 19:58:16.480196162 +0000 UTC m=+2396.501404313"
Sep 11 19:58:17.725488 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:17.725450    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zgqpf_847a1b73-fa57-436a-9371-74ea6c11f96a/global-pull-secret-syncer/0.log"
Sep 11 19:58:17.842579 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:17.842543    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hdpt4_7fa2edcc-a4cc-4d1a-8a3b-d808d50b8681/konnectivity-agent/0.log"
Sep 11 19:58:17.888908 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:17.888877    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-5.ec2.internal_018f2dd0b968b4275775f115aced9005/haproxy/0.log"
Sep 11 19:58:20.707780 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:20.707748    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:58:20.724595 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:20.722053    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q82hf_29a74d9c-2b1e-4d15-ba98-bf16f42dbd65/ovn-acl-logging/0.log"
Sep 11 19:58:21.166541 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:21.166458    2580 scope.go:117] "RemoveContainer" containerID="302f96a1d5af000e68a56c98559ef35520a8ce499ae92406a847527ae312fc64"
Sep 11 19:58:24.053616 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.053583    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b61d33d-6794-4d34-8ef8-795585532be3/alertmanager/0.log"
Sep 11 19:58:24.075597 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.075563    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b61d33d-6794-4d34-8ef8-795585532be3/config-reloader/0.log"
Sep 11 19:58:24.103857 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.103817    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b61d33d-6794-4d34-8ef8-795585532be3/kube-rbac-proxy-web/0.log"
Sep 11 19:58:24.123763 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.123731    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b61d33d-6794-4d34-8ef8-795585532be3/kube-rbac-proxy/0.log"
Sep 11 19:58:24.143381 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.143340    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b61d33d-6794-4d34-8ef8-795585532be3/kube-rbac-proxy-metric/0.log"
Sep 11 19:58:24.163424 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.163394    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b61d33d-6794-4d34-8ef8-795585532be3/prom-label-proxy/0.log"
Sep 11 19:58:24.187472 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.187435    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b61d33d-6794-4d34-8ef8-795585532be3/init-config-reloader/0.log"
Sep 11 19:58:24.356738 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.356665    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-47tf6_6e0a7e3b-185c-4f96-9472-d01b8df9ce7b/monitoring-plugin/0.log"
Sep 11 19:58:24.385483 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.385449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mqgw_0eea0b7a-0603-484d-8b3a-e97d9a20c8f5/node-exporter/0.log"
Sep 11 19:58:24.406339 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.406313    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mqgw_0eea0b7a-0603-484d-8b3a-e97d9a20c8f5/kube-rbac-proxy/0.log"
Sep 11 19:58:24.428888 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.428850    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mqgw_0eea0b7a-0603-484d-8b3a-e97d9a20c8f5/init-textfile/0.log"
Sep 11 19:58:24.888458 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.888422    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-dp9gq_edab8b65-9034-4f75-87b0-f3e1af8aa1f8/prometheus-operator/0.log"
Sep 11 19:58:24.908260 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.908214    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-dp9gq_edab8b65-9034-4f75-87b0-f3e1af8aa1f8/kube-rbac-proxy/0.log"
Sep 11 19:58:24.974351 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:24.974318    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c7df65589-pvlq2_69ffd0ec-f29c-4cfa-968f-da59d1f403ad/telemeter-client/0.log"
Sep 11 19:58:25.003493 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:25.003458    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c7df65589-pvlq2_69ffd0ec-f29c-4cfa-968f-da59d1f403ad/reload/0.log"
Sep 11 19:58:25.029150 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:25.029113    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c7df65589-pvlq2_69ffd0ec-f29c-4cfa-968f-da59d1f403ad/kube-rbac-proxy/0.log"
Sep 11 19:58:27.982879 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:27.982848    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57b47bdb7c-sczv4_9142187c-d4a9-4bce-afd7-a3490a08f2dc/console/0.log"
Sep 11 19:58:28.021396 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.021359    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-75scj_284549c4-5036-4a74-b144-b265e34943b7/download-server/0.log"
Sep 11 19:58:28.312352 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.312230    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"]
Sep 11 19:58:28.320324 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.320272    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.325320 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.325271    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"]
Sep 11 19:58:28.437177 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.437144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-proc\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.437402 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.437185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-lib-modules\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.437402 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.437213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-podres\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.437402 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.437326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-sys\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.437527 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.437434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqrb9\" (UniqueName: \"kubernetes.io/projected/add4e299-9b1e-4859-ad69-38b328672062-kube-api-access-mqrb9\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.538164 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.538123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqrb9\" (UniqueName: \"kubernetes.io/projected/add4e299-9b1e-4859-ad69-38b328672062-kube-api-access-mqrb9\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.538556 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.538528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-proc\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.538725 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.538707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-lib-modules\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.538868 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.538850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-podres\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.539389 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.538947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-lib-modules\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.539389 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.539045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-sys\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.539389 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.539086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-podres\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.539389 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.538710    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-proc\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.539389 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.539308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/add4e299-9b1e-4859-ad69-38b328672062-sys\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.548796 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.548764    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqrb9\" (UniqueName: \"kubernetes.io/projected/add4e299-9b1e-4859-ad69-38b328672062-kube-api-access-mqrb9\") pod \"perf-node-gather-daemonset-tn6t6\" (UID: \"add4e299-9b1e-4859-ad69-38b328672062\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.635866 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.635760    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:28.932033 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:28.932006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"]
Sep 11 19:58:28.937879 ip-10-0-138-5 kubenswrapper[2580]: W0911 19:58:28.937846    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podadd4e299_9b1e_4859_ad69_38b328672062.slice/crio-2b656ec6dc5892da28356ede8d5579a7206630c498564e0130b2ad9a18e76148 WatchSource:0}: Error finding container 2b656ec6dc5892da28356ede8d5579a7206630c498564e0130b2ad9a18e76148: Status 404 returned error can't find the container with id 2b656ec6dc5892da28356ede8d5579a7206630c498564e0130b2ad9a18e76148
Sep 11 19:58:29.575858 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:29.575808    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6" event={"ID":"add4e299-9b1e-4859-ad69-38b328672062","Type":"ContainerStarted","Data":"66208bcc58d646e85c8bf1451c2957c617f8bc80a1813ad484de5e34d34d9785"}
Sep 11 19:58:29.576832 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:29.576716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6" event={"ID":"add4e299-9b1e-4859-ad69-38b328672062","Type":"ContainerStarted","Data":"2b656ec6dc5892da28356ede8d5579a7206630c498564e0130b2ad9a18e76148"}
Sep 11 19:58:29.577145 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:29.577114    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:29.595772 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:29.595715    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6" podStartSLOduration=1.595695789 podStartE2EDuration="1.595695789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:58:29.59271951 +0000 UTC m=+2409.613927658" watchObservedRunningTime="2026-09-11 19:58:29.595695789 +0000 UTC m=+2409.616903940"
Sep 11 19:58:29.958677 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:29.958645    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-56wnj_fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909/dns/0.log"
Sep 11 19:58:29.977725 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:29.977682    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-56wnj_fa482ecc-c1c1-4a8f-9ea3-73d0a8a13909/kube-rbac-proxy/0.log"
Sep 11 19:58:30.080679 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:30.080642    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rlj84_6c8ad17f-cdfd-42a3-8326-04d7894c0fc2/dns-node-resolver/0.log"
Sep 11 19:58:30.621010 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:30.620972    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-89fc5cdcf-6slx5_361c652f-40af-4416-b0e2-1e1eff66d0bd/registry/0.log"
Sep 11 19:58:30.669246 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:30.669212    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8z9xt_003a3202-e54d-4582-aa8b-052a1dbfcb51/node-ca/0.log"
Sep 11 19:58:31.600862 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:31.598973    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5_e4c7eb7f-60ca-437c-80ab-0bb748c0c87d/istio-proxy/0.log"
Sep 11 19:58:32.401319 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:32.401264    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-682g5_04363e6c-d7f8-49b9-b8b8-8ff9a52cad96/discovery/0.log"
Sep 11 19:58:32.471774 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:32.471734    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p95bv_cf82a5cc-f061-40d4-b53d-4a846340e52a/istio-proxy/0.log"
Sep 11 19:58:32.477090 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:32.477050    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p95bv_cf82a5cc-f061-40d4-b53d-4a846340e52a/istio-proxy/1.log"
Sep 11 19:58:32.516845 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:32.516805    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wwdmv_185f142d-d0e8-48a5-acc4-0ed64d45f8f4/payload-pre-processing/0.log"
Sep 11 19:58:33.442900 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:33.442869    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8mn9_54d0f78c-cc1a-4148-9a69-55dc9097f176/serve-healthcheck-canary/0.log"
Sep 11 19:58:34.065029 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:34.064993    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sx8dc_bece38e9-ee8b-4e74-ab87-e9216930c3b8/kube-rbac-proxy/0.log"
Sep 11 19:58:34.083190 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:34.083161    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sx8dc_bece38e9-ee8b-4e74-ab87-e9216930c3b8/exporter/0.log"
Sep 11 19:58:34.106565 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:34.106517    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sx8dc_bece38e9-ee8b-4e74-ab87-e9216930c3b8/extractor/0.log"
Sep 11 19:58:35.593517 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:35.593481    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-tn6t6"
Sep 11 19:58:36.487762 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:36.487708    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-j9dd6_a393ac47-2f3c-4851-9026-8c2e09f13ea5/server/0.log"
Sep 11 19:58:36.623100 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:36.623053    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4s49q_e04ee1d2-005c-460d-858e-2a2ab1e52798/manager/0.log"
Sep 11 19:58:36.646043 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:36.646007    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6474799d6-bd7rk_345ea90b-6123-47cd-9990-ac482ab3a475/manager/0.log"
Sep 11 19:58:36.664864 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:36.664832    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6474799d6-bd7rk_345ea90b-6123-47cd-9990-ac482ab3a475/copy-manifests/0.log"
Sep 11 19:58:38.315767 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:38.315735    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6df94f489d-g5l5g_3c6394c2-5a51-4d41-b6c4-8d539bc22b50/manager/0.log"
Sep 11 19:58:38.556477 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:38.556449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5_e4c7eb7f-60ca-437c-80ab-0bb748c0c87d/istio-proxy/0.log"
Sep 11 19:58:39.363574 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:39.363406    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-682g5_04363e6c-d7f8-49b9-b8b8-8ff9a52cad96/discovery/0.log"
Sep 11 19:58:39.421933 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:39.421898    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p95bv_cf82a5cc-f061-40d4-b53d-4a846340e52a/istio-proxy/0.log"
Sep 11 19:58:39.427292 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:39.427246    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p95bv_cf82a5cc-f061-40d4-b53d-4a846340e52a/istio-proxy/1.log"
Sep 11 19:58:39.457381 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:39.457344    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wwdmv_185f142d-d0e8-48a5-acc4-0ed64d45f8f4/payload-pre-processing/0.log"
Sep 11 19:58:41.072877 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:41.072833    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4sxk5_e4c7eb7f-60ca-437c-80ab-0bb748c0c87d/istio-proxy/0.log"
Sep 11 19:58:41.862431 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:41.862394    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-682g5_04363e6c-d7f8-49b9-b8b8-8ff9a52cad96/discovery/0.log"
Sep 11 19:58:41.929174 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:41.929138    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p95bv_cf82a5cc-f061-40d4-b53d-4a846340e52a/istio-proxy/0.log"
Sep 11 19:58:41.935330 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:41.935275    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p95bv_cf82a5cc-f061-40d4-b53d-4a846340e52a/istio-proxy/1.log"
Sep 11 19:58:41.977558 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:41.977524    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-wwdmv_185f142d-d0e8-48a5-acc4-0ed64d45f8f4/payload-pre-processing/0.log"
Sep 11 19:58:45.135624 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:45.135543    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7ls27_8b694796-3a09-4088-a92e-085fc3c797a0/kube-multus/0.log"
Sep 11 19:58:45.154888 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:45.154864    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9l7q7_987c1db4-8cff-46a0-b3df-41ed6a3418a3/kube-multus-additional-cni-plugins/0.log"
Sep 11 19:58:45.172508 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:45.172482    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9l7q7_987c1db4-8cff-46a0-b3df-41ed6a3418a3/egress-router-binary-copy/0.log"
Sep 11 19:58:45.189601 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:45.189577    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9l7q7_987c1db4-8cff-46a0-b3df-41ed6a3418a3/cni-plugins/0.log"
Sep 11 19:58:45.207228 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:45.207197    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9l7q7_987c1db4-8cff-46a0-b3df-41ed6a3418a3/bond-cni-plugin/0.log"
Sep 11 19:58:45.224582 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:45.224552    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9l7q7_987c1db4-8cff-46a0-b3df-41ed6a3418a3/routeoverride-cni/0.log"
Sep 11 19:58:45.242623 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:45.242582    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9l7q7_987c1db4-8cff-46a0-b3df-41ed6a3418a3/whereabouts-cni-bincopy/0.log"
Sep 11 19:58:45.259784 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:45.259762    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9l7q7_987c1db4-8cff-46a0-b3df-41ed6a3418a3/whereabouts-cni/0.log"
Sep 11 19:58:45.668151 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:45.668120    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rhpw5_7ad42a98-9354-4ba3-b14f-77e0c163a8d3/network-metrics-daemon/0.log"
Sep 11 19:58:45.682149 ip-10-0-138-5 kubenswrapper[2580]: I0911 19:58:45.682126    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rhpw5_7ad42a98-9354-4ba3-b14f-77e0c163a8d3/kube-rbac-proxy/0.log"