Sep 08 14:32:14.334517 ip-10-0-129-248 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 14:32:14.334528 ip-10-0-129-248 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 14:32:14.334536 ip-10-0-129-248 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 14:32:14.334793 ip-10-0-129-248 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 14:32:24.373985 ip-10-0-129-248 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 14:32:24.374002 ip-10-0-129-248 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot cb5b25dea7bc414297184337a9238c2d --
Sep 08 14:34:15.881478 ip-10-0-129-248 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 14:34:16.306419 ip-10-0-129-248 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:34:16.306419 ip-10-0-129-248 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 14:34:16.306419 ip-10-0-129-248 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:34:16.306419 ip-10-0-129-248 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 14:34:16.306419 ip-10-0-129-248 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:34:16.308913 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.308827    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 14:34:16.312315 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312139    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312315    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312321    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312324    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312326    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312330    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312333    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312336    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312339    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312341    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312344    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312346    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312349    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312352    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312354    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312357    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312361    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:34:16.312355 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312363    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312366    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312371    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312375    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312378    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312381    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312384    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312386    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312389    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312392    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312395    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312398    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312401    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312405    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312410    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312412    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312415    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312418    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312420    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:34:16.312754 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312423    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312425    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312428    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312430    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312433    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312435    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312438    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312440    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312443    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312445    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312449    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312451    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312454    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312456    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312459    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312463    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312466    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312468    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312471    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312473    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:34:16.313226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312476    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312478    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312481    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312483    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312486    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312488    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312491    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312494    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312496    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312498    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312501    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312503    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312506    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312508    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312510    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312516    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312519    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312523    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312526    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:34:16.313755 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312529    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312532    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312534    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312537    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312540    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312544    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312546    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312550    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312553    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312556    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312558    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312561    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312563    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312566    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312568    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312571    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312574    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312576    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312578    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312581    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:34:16.314240 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312583    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312586    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312588    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.312591    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313319    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313328    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313331    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313335    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313337    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313340    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313343    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313346    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313349    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313351    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313354    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313357    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313359    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313362    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313365    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313368    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:34:16.314719 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313371    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313373    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313376    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313378    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313380    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313383    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313385    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313388    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313391    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313394    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313396    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313398    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313401    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313413    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313416    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313418    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313422    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313424    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313427    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313429    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:34:16.315320 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313432    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313434    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313438    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313441    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313443    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313446    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313448    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313451    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313453    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313456    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313461    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313464    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313467    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313470    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313473    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313476    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313479    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313481    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313484    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:34:16.315803 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313487    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313489    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313492    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313494    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313497    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313499    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313501    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313504    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313509    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313511    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313514    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313516    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313519    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313521    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313524    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313526    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313529    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313532    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313534    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313537    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:34:16.316313 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313539    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313541    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313544    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313547    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313550    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313553    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313555    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313557    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313560    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313564    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313567    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313570    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313573    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313576    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313578    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313581    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313584    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313586    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313588    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:34:16.316798 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313591    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313596    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313598    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313601    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313603    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313994    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.313999    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314002    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314004    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314007    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314010    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314012    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314015    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314017    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314020    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314022    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314025    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314029    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314032    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314034    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:34:16.317261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314037    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314039    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314042    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314044    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314046    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314049    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314052    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314054    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314056    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314059    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314063    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314067    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314069    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314074    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314078    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314081    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314084    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314087    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314090    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:34:16.317747 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314093    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314096    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314099    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314102    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314104    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314107    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314109    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314112    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314114    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314117    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314119    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314122    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314125    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314127    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314129    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314132    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314134    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314138    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314155    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314157    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:34:16.318229 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314160    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314162    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314165    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314168    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314170    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314173    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314176    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314179    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314181    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314184    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314187    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314189    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314194    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314197    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314199    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314202    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314205    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314208    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314210    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314213    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:34:16.318710 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314215    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314218    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314221    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314225    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314229    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314232    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314234    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314237    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314239    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314242    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314244    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314247    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314250    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314252    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314255    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314257    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314260    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314262    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314266    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:34:16.319459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314268    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314271    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314274    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314276    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314279    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.314282    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314359    2561 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314395    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314401    2561 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314406    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314410    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314413    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314417    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314422    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314425    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314428    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314431    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314434    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314438    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314441    2561 flags.go:64] FLAG: --cgroup-root=""
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314444    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314447    2561 flags.go:64] FLAG: --client-ca-file=""
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314450    2561 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314453    2561 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 14:34:16.320097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314457    2561 flags.go:64] FLAG: --cluster-domain=""
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314460    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314463    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314466    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314469    2561 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314473    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314476    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314480    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314483    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314486    2561 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314489    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314492    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314495    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314500    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314503    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314506    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314509    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314512    2561 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314514    2561 flags.go:64] FLAG: --enable-server="true"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314517    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314522    2561 flags.go:64] FLAG: --event-burst="100"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314525    2561 flags.go:64] FLAG: --event-qps="50"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314527    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314531    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 14:34:16.320759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314534    2561 flags.go:64] FLAG: --eviction-hard=""
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314537    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314540    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314543    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314546    2561 flags.go:64] FLAG: --eviction-soft=""
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314549    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314552    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314555    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314558    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314561    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314564    2561 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314566    2561 flags.go:64] FLAG: --feature-gates=""
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314570    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314573    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314576    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314580    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314583    2561 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314586    2561 flags.go:64] FLAG: --help="false"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314589    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314592    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314595    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314599    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314602    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 14:34:16.321356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314605    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314608    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314610    2561 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314613    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314616    2561 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314619    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314622    2561 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314624    2561 flags.go:64] FLAG: --kube-reserved=""
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314627    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314630    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314632    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314635    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314638    2561 flags.go:64] FLAG: --lock-file=""
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314642    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314645    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314648    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314658    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314661    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314663    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314666    2561 flags.go:64] FLAG: --logging-format="text"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314669    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314672    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314674    2561 flags.go:64] FLAG: --manifest-url=""
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314677    2561 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314683    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 14:34:16.321982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314686    2561 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314690    2561 flags.go:64] FLAG: --max-pods="110"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314693    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314696    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314698    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314702    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314705    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314708    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314711    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314718    2561 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314721    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314724    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314727    2561 flags.go:64] FLAG: --pod-cidr=""
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314730    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314736    2561 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314739    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314742    2561 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314745    2561 flags.go:64] FLAG: --port="10250"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314748    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314751    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d00c16493815f060"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314754    2561 flags.go:64] FLAG: --qos-reserved=""
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314757    2561 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314760    2561 flags.go:64] FLAG: --register-node="true"
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314766    2561 flags.go:64] FLAG: --register-with-taints=""
Sep 08 14:34:16.322608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314770    2561 flags.go:64] FLAG: --registry-burst="10"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314773    2561 flags.go:64] FLAG: --registry-qps="5"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314775    2561 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314778    2561 flags.go:64] FLAG: --reserved-memory=""
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314782    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314785    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314788    2561 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314791    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314794    2561 flags.go:64] FLAG: --runonce="false"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314797    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314800    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314803    2561 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314806    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314808    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314812    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314815    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314818    2561 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314821    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314824    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314826    2561 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314829    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314833    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314835    2561 flags.go:64] FLAG: --system-cgroups=""
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314838    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314844    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 14:34:16.323199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314846    2561 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314849    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314857    2561 flags.go:64] FLAG: --tls-min-version=""
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314860    2561 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314862    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314866    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314869    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314872    2561 flags.go:64] FLAG: --v="2"
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314875    2561 flags.go:64] FLAG: --version="false"
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314879    2561 flags.go:64] FLAG: --vmodule=""
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314883    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.314886    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320498    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320513    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320517    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320521    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320524    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320526    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320529    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320532    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320535    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320537    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:34:16.323806 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320541    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320545    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320550    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320554    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320558    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320565    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320570    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320573    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320576    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320579    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320581    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320584    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320586    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320594    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320597    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320599    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320602    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320605    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320607    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:34:16.324366 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320610    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320612    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320616    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320618    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320622    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320626    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320632    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320637    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320641    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320644    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320646    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320649    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320651    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320655    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320657    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320661    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320665    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320667    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320669    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:34:16.324824 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320672    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320674    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320677    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320679    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320682    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320686    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320688    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320691    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320693    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320695    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320698    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320700    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320703    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320706    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320710    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320714    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320718    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320723    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320726    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320728    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:34:16.325306 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320731    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320734    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320737    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320739    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320742    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320744    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320747    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320749    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320752    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320754    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320756    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320759    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320762    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320765    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320768    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320772    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320775    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320778    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320780    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320784    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:34:16.325813 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320788    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320793    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320797    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320800    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320803    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320805    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320808    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320810    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320813    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320816    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.320819    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:34:16.326303 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.321615    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:34:16.329732 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.329705    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 14:34:16.329732 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.329732    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 14:34:16.330669 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.330659    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 14:34:16.330711 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.330670    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 14:34:16.330742 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330732    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:34:16.330742 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330738    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:34:16.330742 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330741    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330744    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330748    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330751    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330754    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330757    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330760    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330763    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330766    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330768    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330771    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330774    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330777    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330779    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330782    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330784    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330787    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330790    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330792    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330795    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:34:16.330819 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330798    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330800    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330803    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330806    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330809    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330812    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330814    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330818    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330821    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330823    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330826    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330829    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330832    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330835    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330837    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330840    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330843    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330845    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330848    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:34:16.331333 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330850    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330853    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330856    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330858    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330861    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330863    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330866    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330868    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330871    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330873    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330876    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330879    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330881    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330884    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330887    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330890    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330893    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330896    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330898    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330901    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:34:16.331790 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330904    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330907    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330910    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330912    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330917    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330920    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330923    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330926    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330929    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330931    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330934    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330936    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330939    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330941    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330943    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330946    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330948    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330951    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330953    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330956    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:34:16.332300 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330959    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330963    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330966    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330969    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330972    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330975    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330978    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330981    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330984    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330986    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330989    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330992    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330994    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.330997    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331000    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331003    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331007    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:34:16.332788 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331011    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.331016    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331134    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331139    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331156    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331159    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331162    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331164    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331167    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331170    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331173    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331175    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331178    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331180    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331183    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:34:16.333349 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331186    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331188    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331190    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331193    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331196    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331198    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331201    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331204    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331207    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331210    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331213    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331216    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331218    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331221    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331223    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331226    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331229    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331231    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331234    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331236    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:34:16.333731 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331239    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331241    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331244    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331246    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331249    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331251    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331253    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331256    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331259    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331261    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331264    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331267    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331269    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331272    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331274    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331283    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331285    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331288    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331291    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:34:16.334233 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331295    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331299    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331302    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331305    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331308    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331310    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331313    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331315    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331318    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331321    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331324    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331326    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331329    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331331    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331334    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331337    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331340    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331342    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331345    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331348    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:34:16.334761 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331350    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331354    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331356    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331359    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331362    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331365    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331367    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331370    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331373    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331375    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331378    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331380    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331383    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331386    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331390    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331393    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331396    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331399    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331402    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:34:16.335261 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331405    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331408    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331411    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331414    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331417    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331419    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331421    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:16.331424    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.331429    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.331574    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.334026    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.335175    2561 server.go:1019] "Starting client certificate rotation"
Sep 08 14:34:16.335741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.335280    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 14:34:16.336063 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.336020    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 14:34:16.337989 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.337974    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 14:34:16.339166 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.339131    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 14:34:16.351450 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.351426    2561 log.go:25] "Validated CRI v1 runtime API"
Sep 08 14:34:16.354876 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.354855    2561 log.go:25] "Validated CRI v1 image API"
Sep 08 14:34:16.355772 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.355755    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 14:34:16.360009 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.359988    2561 fs.go:135] Filesystem UUIDs: map[6ec60db3-4103-4fe4-94a8-a796a319cab6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f42f4483-f233-4d7f-91f7-2629c3c58926:/dev/nvme0n1p4]
Sep 08 14:34:16.360071 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.360009    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 14:34:16.366360 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.366243    2561 manager.go:216] Machine: {Timestamp:2026-09-08 14:34:16.364846075 +0000 UTC m=+0.375366064 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100014 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec296f5ce5c7ecb8f9ba80e9ca6b011f SystemUUID:ec296f5c-e5c7-ecb8-f9ba-80e9ca6b011f BootID:cb5b25de-a7bc-4142-9718-4337a9238c2d Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:9b:ea:57:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:9b:ea:57:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:45:7d:da:9b:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 14:34:16.366360 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.366350    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 14:34:16.366507 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.366480    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 14:34:16.370395 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.370365    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 14:34:16.370536 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.370396    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-248.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 14:34:16.371379 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.371358    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 14:34:16.371967 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.371955    2561 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 14:34:16.371967 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.371969    2561 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 14:34:16.372036 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.371978    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 14:34:16.372845 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.372835    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 14:34:16.374730 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.374718    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 14:34:16.379419 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.379408    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 14:34:16.379544 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.379534    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 14:34:16.379576 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.379567    2561 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 14:34:16.379603 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.379581    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 14:34:16.379630 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.379606    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 14:34:16.379630 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.379620    2561 kubelet.go:398] "Adding apiserver pod source"
Sep 08 14:34:16.379695 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.379633    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 14:34:16.380031 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.380019    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 14:34:16.380086 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.380039    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 14:34:16.382594 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.382577    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 14:34:16.385461 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.385444    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 14:34:16.385552 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.385483    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 14:34:16.385700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.385686    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 14:34:16.385759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.385707    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 14:34:16.385759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.385716    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 14:34:16.385759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.385725    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 14:34:16.385759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.385739    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 14:34:16.385759 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.385748    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 14:34:16.386299 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.386289    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 14:34:16.386355 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.386302    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 14:34:16.386355 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.386314    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 14:34:16.386355 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.386324    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 14:34:16.386355 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.386344    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 14:34:16.386484 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.386357    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 14:34:16.388242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.388232    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 14:34:16.388297 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.388246    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 14:34:16.392267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.392251    2561 server.go:1268] "Started kubelet"
Sep 08 14:34:16.392481 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.392417    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 14:34:16.392532 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.392462    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 14:34:16.392532 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.392508    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 14:34:16.393023 ip-10-0-129-248 systemd[1]: Started Kubernetes Kubelet.
Sep 08 14:34:16.395229 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.394713    2561 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 14:34:16.396231 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.396212    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-248.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 14:34:16.397261 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.397243    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 14:34:16.397375 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.397354    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 14:34:16.397435 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.397357    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 14:34:16.397857 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.397841    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvms6"
Sep 08 14:34:16.399731 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.399712    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 14:34:16.400726 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.399585    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-248.ec2.internal.18d35f1d49bfea49  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-248.ec2.internal,UID:ip-10-0-129-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-248.ec2.internal,},FirstTimestamp:2026-09-08 14:34:16.392223305 +0000 UTC m=+0.402743298,LastTimestamp:2026-09-08 14:34:16.392223305 +0000 UTC m=+0.402743298,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-248.ec2.internal,}"
Sep 08 14:34:16.402497 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.402479    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 14:34:16.403178 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.403164    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 14:34:16.403290 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.403276    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:16.403922 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.403906    2561 factory.go:55] Registering systemd factory
Sep 08 14:34:16.403987 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.403944    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 14:34:16.403987 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.403958    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 14:34:16.404082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.403948    2561 factory.go:223] Registration of the systemd container factory successfully
Sep 08 14:34:16.404082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.403944    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 14:34:16.404082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.404070    2561 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 14:34:16.404082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.404080    2561 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 14:34:16.404270 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.404257    2561 factory.go:153] Registering CRI-O factory
Sep 08 14:34:16.404322 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.404275    2561 factory.go:223] Registration of the crio container factory successfully
Sep 08 14:34:16.404322 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.404320    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 14:34:16.404414 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.404334    2561 factory.go:103] Registering Raw factory
Sep 08 14:34:16.404414 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.404347    2561 manager.go:1196] Started watching for new ooms in manager
Sep 08 14:34:16.404901 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.404790    2561 manager.go:349] Starting recovery of all containers
Sep 08 14:34:16.406774 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.406572    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 14:34:16.406774 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.406747    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 14:34:16.408657 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.408629    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvms6"
Sep 08 14:34:16.418123 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.418106    2561 manager.go:354] Recovery completed
Sep 08 14:34:16.422007 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.421987    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:34:16.424484 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.424466    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:34:16.424560 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.424502    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:34:16.424560 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.424525    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:34:16.425095 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.425082    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 14:34:16.425132 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.425096    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:34:16.425181 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.425096    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 14:34:16.425181 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.425176    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 14:34:16.425901 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.425887    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:34:16.425965 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.425912    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:34:16.425965 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.425922    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:34:16.427268 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.427253    2561 policy_none.go:49] "None policy: Start"
Sep 08 14:34:16.427268 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.427270    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 14:34:16.427268 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.427280    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 14:34:16.427402 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.427284    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-248.ec2.internal.18d35f1d4bac2ea4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-248.ec2.internal,UID:ip-10-0-129-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-248.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-248.ec2.internal,},FirstTimestamp:2026-09-08 14:34:16.424484516 +0000 UTC m=+0.435004510,LastTimestamp:2026-09-08 14:34:16.424484516 +0000 UTC m=+0.435004510,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-248.ec2.internal,}"
Sep 08 14:34:16.429265 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.429253    2561 policy_none.go:47] "Start"
Sep 08 14:34:16.469841 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.469822    2561 manager.go:337] "Starting Device Plugin manager"
Sep 08 14:34:16.487191 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.469870    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 14:34:16.487191 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.469882    2561 server.go:87] "Starting device plugin registration server"
Sep 08 14:34:16.487191 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.470171    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 14:34:16.487191 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.470184    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 14:34:16.487191 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.470260    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 14:34:16.487191 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.470352    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 14:34:16.487191 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.470360    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 14:34:16.487191 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.470919    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 14:34:16.487191 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.470960    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:16.512825 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.512791    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 14:34:16.514280 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.514260    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 14:34:16.514342 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.514333    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 14:34:16.514398 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.514364    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 14:34:16.514450 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.514412    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 14:34:16.517067 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.517045    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:34:16.570554 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.570424    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:34:16.572432 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.572413    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:34:16.572535 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.572448    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:34:16.572535 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.572461    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:34:16.572535 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.572486    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.581201 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.581181    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.581269 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.581210    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-248.ec2.internal\": node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:16.611546 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.611517    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:16.615540 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.615511    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"]
Sep 08 14:34:16.615604 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.615596    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:34:16.617790 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.617773    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:34:16.617898 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.617803    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:34:16.617898 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.617818    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:34:16.620179 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.620139    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:34:16.620291 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.620239    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.620291 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.620265    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:34:16.620993 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.620973    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:34:16.621088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.621003    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:34:16.621088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.621012    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:34:16.621088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.620976    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:34:16.621088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.621045    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:34:16.621088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.621060    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:34:16.623310 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.623297    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.623359 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.623321    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:34:16.624167 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.624132    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:34:16.624256 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.624178    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:34:16.624256 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.624193    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:34:16.641809 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.641778    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-248.ec2.internal\" not found" node="ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.645427 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.645400    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-248.ec2.internal\" not found" node="ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.711980 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.711944    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:16.805604 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.805565    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/795ff9d7ddaa3d074269b61192e23bdf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"795ff9d7ddaa3d074269b61192e23bdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.805745 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.805607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/795ff9d7ddaa3d074269b61192e23bdf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"795ff9d7ddaa3d074269b61192e23bdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.805745 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.805632    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aaee42d2e078b0aa5a0ca900ffc90198-config\") pod \"kube-apiserver-proxy-ip-10-0-129-248.ec2.internal\" (UID: \"aaee42d2e078b0aa5a0ca900ffc90198\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.813064 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.813035    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:16.905897 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.905822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/795ff9d7ddaa3d074269b61192e23bdf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"795ff9d7ddaa3d074269b61192e23bdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.905897 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.905780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/795ff9d7ddaa3d074269b61192e23bdf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"795ff9d7ddaa3d074269b61192e23bdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.905897 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.905887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/795ff9d7ddaa3d074269b61192e23bdf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"795ff9d7ddaa3d074269b61192e23bdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.906064 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.905908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aaee42d2e078b0aa5a0ca900ffc90198-config\") pod \"kube-apiserver-proxy-ip-10-0-129-248.ec2.internal\" (UID: \"aaee42d2e078b0aa5a0ca900ffc90198\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.906064 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.905935    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aaee42d2e078b0aa5a0ca900ffc90198-config\") pod \"kube-apiserver-proxy-ip-10-0-129-248.ec2.internal\" (UID: \"aaee42d2e078b0aa5a0ca900ffc90198\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.906064 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.905967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/795ff9d7ddaa3d074269b61192e23bdf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal\" (UID: \"795ff9d7ddaa3d074269b61192e23bdf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.913907 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:16.913875    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:16.944081 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.944049    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:16.948138 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:16.947995    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:17.014555 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:17.014506    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:17.115138 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:17.115101    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:17.215691 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:17.215605    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:17.316249 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:17.316206    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:17.335385 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.335354    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 14:34:17.335550 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.335531    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 14:34:17.388128 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.388096    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:34:17.413809 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.413761    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 14:29:17 +0000 UTC" deadline="2028-05-07 07:58:48.530179199 +0000 UTC"
Sep 08 14:34:17.413809 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.413798    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14561h24m31.116386251s"
Sep 08 14:34:17.417127 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:17.417100    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-248.ec2.internal\" not found"
Sep 08 14:34:17.459430 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.459261    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:34:17.504340 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.504255    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:17.514508 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.514486    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 14:34:17.515249 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.515235    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal"
Sep 08 14:34:17.527390 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.527364    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 14:34:17.538213 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:17.538182    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaee42d2e078b0aa5a0ca900ffc90198.slice/crio-6cd01cfd5db67013945e00115e87f9772cac6c36c4c026fdf04b8ed64bc5f2af WatchSource:0}: Error finding container 6cd01cfd5db67013945e00115e87f9772cac6c36c4c026fdf04b8ed64bc5f2af: Status 404 returned error can't find the container with id 6cd01cfd5db67013945e00115e87f9772cac6c36c4c026fdf04b8ed64bc5f2af
Sep 08 14:34:17.542215 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.542199    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:34:17.950922 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:17.950884    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:34:18.380238 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.380204    2561 apiserver.go:52] "Watching apiserver"
Sep 08 14:34:18.386137 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.386106    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 14:34:18.386731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.386706    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-g5n9d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn","openshift-dns/node-resolver-h672j","openshift-image-registry/node-ca-bx5tq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal","openshift-multus/multus-additional-cni-plugins-mjrhr","openshift-network-diagnostics/network-check-target-zvdsw","kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal","openshift-cluster-node-tuning-operator/tuned-n7568","openshift-multus/multus-rsz42","openshift-multus/network-metrics-daemon-qzw9s","openshift-network-operator/iptables-alerter-6chfl","openshift-ovn-kubernetes/ovnkube-node-nkmmk","kube-system/global-pull-secret-syncer-shnpn"]
Sep 08 14:34:18.389834 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.389521    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:18.389834 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.389619    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:18.392254 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.392200    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:18.392373 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.392310    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:18.394486 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.394336    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.396632 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.396610    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 14:34:18.396845 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.396828    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r4d8f\""
Sep 08 14:34:18.397064 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.397044    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.397196 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.397066    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 14:34:18.399082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.399058    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:18.399202 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.399134    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:18.399579 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.399558    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 14:34:18.399669 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.399559    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wbdgd\""
Sep 08 14:34:18.399731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.399675    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 14:34:18.399731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.399559    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 14:34:18.401585 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.401559    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.403767 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.403495    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 14:34:18.403767 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.403634    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 14:34:18.404904 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.404312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.404904 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.404457    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 14:34:18.404904 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.404576    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 14:34:18.404904 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.404806    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zwmt4\""
Sep 08 14:34:18.405418 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.404956    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 14:34:18.405418 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.404983    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 14:34:18.406675 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.406651    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.409788 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.409759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.409899 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.409859    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p84wr\""
Sep 08 14:34:18.410207 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.410183    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:34:18.410519 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.410501    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 14:34:18.411913 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.411890    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fhgpg\""
Sep 08 14:34:18.412170 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.412154    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 14:34:18.414373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.412642    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 14:34:18.414373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.412744    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 14:34:18.414373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.413002    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 14:34:18.414373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.413153    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 14:34:18.414373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.413609    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 14:34:18.414373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.413706    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bmhmz\""
Sep 08 14:34:18.414373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.413995    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 14:34:18.414373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.414328    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 14:34:18.414870 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.414754    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.417334 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-run-ovn-kubernetes\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.417445 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9np2h\" (UniqueName: \"kubernetes.io/projected/06012240-3a1e-44ac-baf8-4648f6b640cf-kube-api-access-9np2h\") pod \"node-ca-bx5tq\" (UID: \"06012240-3a1e-44ac-baf8-4648f6b640cf\") " pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.417445 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417375    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-etc-openvswitch\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.417445 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-cni-netd\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.417445 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417426    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.417654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417452    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-ovnkube-config\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.417654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pktv4\" (UniqueName: \"kubernetes.io/projected/63d7944c-15c0-4ff2-ac22-6cf9afdae1d2-kube-api-access-pktv4\") pod \"node-resolver-h672j\" (UID: \"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2\") " pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.417654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417500    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-kubelet-config\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:18.417654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-modprobe-d\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.417654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:18.417654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417563    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 14:34:18.417654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417574    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-slash\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.417654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-var-lib-openvswitch\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.417654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-log-socket\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-ovnkube-script-lib\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417688    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-dbus\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417726    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-sysctl-d\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417743    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-env-overrides\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417765    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-kubernetes\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417787    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-run\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-var-lib-kubelet\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-host\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d05c63d-d588-46ea-8b94-a76583420760-etc-tuned\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417875    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzdtx\" (UniqueName: \"kubernetes.io/projected/1d05c63d-d588-46ea-8b94-a76583420760-kube-api-access-dzdtx\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-kubelet\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417942    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6579\" (UniqueName: \"kubernetes.io/projected/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-kube-api-access-t6579\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.417986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-sysctl-conf\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418051    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-systemd\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418116    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-sys\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-lib-modules\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98985ec1-7b3c-4c2a-add7-be624aca2b36-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-run-openvswitch\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-run-ovn\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-ovn-node-metrics-cert\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-sysconfig\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98985ec1-7b3c-4c2a-add7-be624aca2b36-system-cni-dir\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418375    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98985ec1-7b3c-4c2a-add7-be624aca2b36-cni-binary-copy\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-run-netns\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418458    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-cni-bin\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418484    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/63d7944c-15c0-4ff2-ac22-6cf9afdae1d2-hosts-file\") pod \"node-resolver-h672j\" (UID: \"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2\") " pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418509    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwl9n\" (UniqueName: \"kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n\") pod \"network-check-target-zvdsw\" (UID: \"691234af-48f7-41c2-abf9-27428e7250c4\") " pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418538    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtvwx\" (UniqueName: \"kubernetes.io/projected/fc907ff2-af58-4c71-9031-fddfbd162573-kube-api-access-xtvwx\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06012240-3a1e-44ac-baf8-4648f6b640cf-host\") pod \"node-ca-bx5tq\" (UID: \"06012240-3a1e-44ac-baf8-4648f6b640cf\") " pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.418900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98985ec1-7b3c-4c2a-add7-be624aca2b36-cnibin\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.419731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98985ec1-7b3c-4c2a-add7-be624aca2b36-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.419731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-node-log\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.419731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63d7944c-15c0-4ff2-ac22-6cf9afdae1d2-tmp-dir\") pod \"node-resolver-h672j\" (UID: \"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2\") " pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.419731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d05c63d-d588-46ea-8b94-a76583420760-tmp\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.419731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06012240-3a1e-44ac-baf8-4648f6b640cf-serviceca\") pod \"node-ca-bx5tq\" (UID: \"06012240-3a1e-44ac-baf8-4648f6b640cf\") " pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.419731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418775    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98985ec1-7b3c-4c2a-add7-be624aca2b36-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.419731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7b4f\" (UniqueName: \"kubernetes.io/projected/98985ec1-7b3c-4c2a-add7-be624aca2b36-kube-api-access-k7b4f\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.419731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-systemd-units\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.419731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.418873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-run-systemd\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.419731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.419051    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7glpg\""
Sep 08 14:34:18.421300 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.421278    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.421669 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.421647    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 14:34:18.421831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.421809    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 14:34:18.422594 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.422571    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9s9wc\""
Sep 08 14:34:18.424390 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.424370    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-985fb\""
Sep 08 14:34:18.424493 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.424397    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:34:18.424493 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.424442    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 14:34:18.424657 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.424639    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 14:34:18.424737 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.424660    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 14:34:18.446303 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.446277    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p7ctg"
Sep 08 14:34:18.459197 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.459165    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p7ctg"
Sep 08 14:34:18.505362 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.505330    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 14:34:18.519058 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519025    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98985ec1-7b3c-4c2a-add7-be624aca2b36-system-cni-dir\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.519287 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-run-netns\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.519287 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519092    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-cni-bin\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.519287 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519171    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98985ec1-7b3c-4c2a-add7-be624aca2b36-system-cni-dir\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.519287 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-cnibin\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.519287 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519189    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-cni-bin\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.519287 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-daemon-config\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.519610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-run-netns\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.519610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06012240-3a1e-44ac-baf8-4648f6b640cf-host\") pod \"node-ca-bx5tq\" (UID: \"06012240-3a1e-44ac-baf8-4648f6b640cf\") " pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.519610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519356    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06012240-3a1e-44ac-baf8-4648f6b640cf-host\") pod \"node-ca-bx5tq\" (UID: \"06012240-3a1e-44ac-baf8-4648f6b640cf\") " pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.519610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-node-log\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.519610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63d7944c-15c0-4ff2-ac22-6cf9afdae1d2-tmp-dir\") pod \"node-resolver-h672j\" (UID: \"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2\") " pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.519610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519420    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-node-log\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.519610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d05c63d-d588-46ea-8b94-a76583420760-tmp\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.519610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-run\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.519610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzdtx\" (UniqueName: \"kubernetes.io/projected/1d05c63d-d588-46ea-8b94-a76583420760-kube-api-access-dzdtx\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98985ec1-7b3c-4c2a-add7-be624aca2b36-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7b4f\" (UniqueName: \"kubernetes.io/projected/98985ec1-7b3c-4c2a-add7-be624aca2b36-kube-api-access-k7b4f\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-systemd-units\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-run-systemd\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519751    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-run\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-run-systemd\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519845    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63d7944c-15c0-4ff2-ac22-6cf9afdae1d2-tmp-dir\") pod \"node-resolver-h672j\" (UID: \"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2\") " pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9np2h\" (UniqueName: \"kubernetes.io/projected/06012240-3a1e-44ac-baf8-4648f6b640cf-kube-api-access-9np2h\") pod \"node-ca-bx5tq\" (UID: \"06012240-3a1e-44ac-baf8-4648f6b640cf\") " pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-etc-openvswitch\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal" event={"ID":"aaee42d2e078b0aa5a0ca900ffc90198","Type":"ContainerStarted","Data":"6cd01cfd5db67013945e00115e87f9772cac6c36c4c026fdf04b8ed64bc5f2af"}
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-ovnkube-config\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.519908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-systemd-units\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-kubelet-config\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-etc-openvswitch\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520049    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8968fb9e-3383-4d8a-b2b1-56d39e60b8f9-host-slash\") pod \"iptables-alerter-6chfl\" (UID: \"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9\") " pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-kubelet-config\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520190    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-hostroot\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-run-multus-certs\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520343    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-slash\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-log-socket\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.520400    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-ovnkube-script-lib\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-dbus\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.520519    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs podName:fc907ff2-af58-4c71-9031-fddfbd162573 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:19.02048579 +0000 UTC m=+3.031005789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs") pod "network-metrics-daemon-qzw9s" (UID: "fc907ff2-af58-4c71-9031-fddfbd162573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-slash\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-log-socket\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520624    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-var-lib-kubelet\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-dbus\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.520743    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:18.520849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d05c63d-d588-46ea-8b94-a76583420760-etc-tuned\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-ovnkube-config\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.520848    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret podName:c3334c9c-8df4-4eef-a4e5-dfb55276c3f1 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:19.020787561 +0000 UTC m=+3.031307562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret") pod "global-pull-secret-syncer-shnpn" (UID: "c3334c9c-8df4-4eef-a4e5-dfb55276c3f1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-env-overrides\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520933    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.520950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-run-k8s-cni-cncf-io\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-var-lib-kubelet\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-conf-dir\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521039    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqqgn\" (UniqueName: \"kubernetes.io/projected/77f2080a-f31d-4b30-a798-33e9861d8a2e-kube-api-access-lqqgn\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-kubelet\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6579\" (UniqueName: \"kubernetes.io/projected/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-kube-api-access-t6579\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-sysctl-conf\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-ovnkube-script-lib\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98985ec1-7b3c-4c2a-add7-be624aca2b36-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-kubelet\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-system-cni-dir\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98985ec1-7b3c-4c2a-add7-be624aca2b36-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.521748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-run-openvswitch\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521324    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-sysctl-conf\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-ovn-node-metrics-cert\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-sysconfig\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-env-overrides\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521446    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-run-openvswitch\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-run-netns\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521505    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-sysconfig\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98985ec1-7b3c-4c2a-add7-be624aca2b36-cni-binary-copy\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/63d7944c-15c0-4ff2-ac22-6cf9afdae1d2-hosts-file\") pod \"node-resolver-h672j\" (UID: \"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2\") " pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-sys-fs\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521678    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/63d7944c-15c0-4ff2-ac22-6cf9afdae1d2-hosts-file\") pod \"node-resolver-h672j\" (UID: \"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2\") " pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-cni-dir\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwl9n\" (UniqueName: \"kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n\") pod \"network-check-target-zvdsw\" (UID: \"691234af-48f7-41c2-abf9-27428e7250c4\") " pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtvwx\" (UniqueName: \"kubernetes.io/projected/fc907ff2-af58-4c71-9031-fddfbd162573-kube-api-access-xtvwx\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98985ec1-7b3c-4c2a-add7-be624aca2b36-cnibin\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.522684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98985ec1-7b3c-4c2a-add7-be624aca2b36-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521885    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98985ec1-7b3c-4c2a-add7-be624aca2b36-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521940    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98985ec1-7b3c-4c2a-add7-be624aca2b36-cnibin\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.521973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-socket-dir-parent\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06012240-3a1e-44ac-baf8-4648f6b640cf-serviceca\") pod \"node-ca-bx5tq\" (UID: \"06012240-3a1e-44ac-baf8-4648f6b640cf\") " pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522201    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-run-ovn-kubernetes\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522227    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98985ec1-7b3c-4c2a-add7-be624aca2b36-cni-binary-copy\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pktv4\" (UniqueName: \"kubernetes.io/projected/63d7944c-15c0-4ff2-ac22-6cf9afdae1d2-kube-api-access-pktv4\") pod \"node-resolver-h672j\" (UID: \"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2\") " pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522314    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-run-ovn-kubernetes\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21ac6106-7a51-4276-8324-0645aa8a32f8-konnectivity-ca\") pod \"konnectivity-agent-g5n9d\" (UID: \"21ac6106-7a51-4276-8324-0645aa8a32f8\") " pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl24g\" (UniqueName: \"kubernetes.io/projected/8968fb9e-3383-4d8a-b2b1-56d39e60b8f9-kube-api-access-fl24g\") pod \"iptables-alerter-6chfl\" (UID: \"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9\") " pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-registration-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522459    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98985ec1-7b3c-4c2a-add7-be624aca2b36-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgp7j\" (UniqueName: \"kubernetes.io/projected/a707b303-8154-47fb-aa33-fa01c7a7ffc5-kube-api-access-jgp7j\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-systemd\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-lib-modules\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522610    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-systemd\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.523376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-cni-netd\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-modprobe-d\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06012240-3a1e-44ac-baf8-4648f6b640cf-serviceca\") pod \"node-ca-bx5tq\" (UID: \"06012240-3a1e-44ac-baf8-4648f6b640cf\") " pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522665    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-host-cni-netd\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8968fb9e-3383-4d8a-b2b1-56d39e60b8f9-iptables-alerter-script\") pod \"iptables-alerter-6chfl\" (UID: \"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9\") " pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522694    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-lib-modules\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-socket-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-var-lib-kubelet\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522754    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-modprobe-d\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-var-lib-openvswitch\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-sysctl-d\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522826    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-var-lib-openvswitch\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-device-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77f2080a-f31d-4b30-a798-33e9861d8a2e-cni-binary-copy\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-kubernetes\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-host\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522954    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-var-lib-cni-multus\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.524018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-etc-kubernetes\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.524729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.523004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-sys\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.522976    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-sysctl-d\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.523077    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-etc-kubernetes\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.523030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21ac6106-7a51-4276-8324-0645aa8a32f8-agent-certs\") pod \"konnectivity-agent-g5n9d\" (UID: \"21ac6106-7a51-4276-8324-0645aa8a32f8\") " pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:18.524729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.523113    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-var-lib-cni-bin\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.524729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.523119    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-sys\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.523026    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d05c63d-d588-46ea-8b94-a76583420760-host\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.524729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.523141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-run-ovn\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.524729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.523225    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-run-ovn\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.525986 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.525961    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d05c63d-d588-46ea-8b94-a76583420760-etc-tuned\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.526111 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.526023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d05c63d-d588-46ea-8b94-a76583420760-tmp\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.526111 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.526082    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-ovn-node-metrics-cert\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.530589 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.530568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9np2h\" (UniqueName: \"kubernetes.io/projected/06012240-3a1e-44ac-baf8-4648f6b640cf-kube-api-access-9np2h\") pod \"node-ca-bx5tq\" (UID: \"06012240-3a1e-44ac-baf8-4648f6b640cf\") " pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.530693 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.530643    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzdtx\" (UniqueName: \"kubernetes.io/projected/1d05c63d-d588-46ea-8b94-a76583420760-kube-api-access-dzdtx\") pod \"tuned-n7568\" (UID: \"1d05c63d-d588-46ea-8b94-a76583420760\") " pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.531280 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.531237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7b4f\" (UniqueName: \"kubernetes.io/projected/98985ec1-7b3c-4c2a-add7-be624aca2b36-kube-api-access-k7b4f\") pod \"multus-additional-cni-plugins-mjrhr\" (UID: \"98985ec1-7b3c-4c2a-add7-be624aca2b36\") " pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.537600 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.537577    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:18.537600 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.537602    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:18.538050 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.537618    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pwl9n for pod openshift-network-diagnostics/network-check-target-zvdsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:18.538050 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:18.537683    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n podName:691234af-48f7-41c2-abf9-27428e7250c4 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:19.037662791 +0000 UTC m=+3.048182787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pwl9n" (UniqueName: "kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n") pod "network-check-target-zvdsw" (UID: "691234af-48f7-41c2-abf9-27428e7250c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:18.539973 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.539930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6579\" (UniqueName: \"kubernetes.io/projected/f6e9a02e-c20b-4fc7-bdef-4d11df4eb280-kube-api-access-t6579\") pod \"ovnkube-node-nkmmk\" (UID: \"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280\") " pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.543934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.540468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtvwx\" (UniqueName: \"kubernetes.io/projected/fc907ff2-af58-4c71-9031-fddfbd162573-kube-api-access-xtvwx\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:18.543934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.540879    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pktv4\" (UniqueName: \"kubernetes.io/projected/63d7944c-15c0-4ff2-ac22-6cf9afdae1d2-kube-api-access-pktv4\") pod \"node-resolver-h672j\" (UID: \"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2\") " pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.624398 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-run-k8s-cni-cncf-io\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.624601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-conf-dir\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.624601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqqgn\" (UniqueName: \"kubernetes.io/projected/77f2080a-f31d-4b30-a798-33e9861d8a2e-kube-api-access-lqqgn\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.624601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-system-cni-dir\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.624601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-run-k8s-cni-cncf-io\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.624601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.624601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-run-netns\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.624601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-sys-fs\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.624601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-conf-dir\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.624601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-cni-dir\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.624601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624602    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-system-cni-dir\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624610    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624637    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-cni-dir\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624647    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-run-netns\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-socket-dir-parent\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-sys-fs\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21ac6106-7a51-4276-8324-0645aa8a32f8-konnectivity-ca\") pod \"konnectivity-agent-g5n9d\" (UID: \"21ac6106-7a51-4276-8324-0645aa8a32f8\") " pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl24g\" (UniqueName: \"kubernetes.io/projected/8968fb9e-3383-4d8a-b2b1-56d39e60b8f9-kube-api-access-fl24g\") pod \"iptables-alerter-6chfl\" (UID: \"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9\") " pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-registration-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624752    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-socket-dir-parent\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-registration-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgp7j\" (UniqueName: \"kubernetes.io/projected/a707b303-8154-47fb-aa33-fa01c7a7ffc5-kube-api-access-jgp7j\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8968fb9e-3383-4d8a-b2b1-56d39e60b8f9-iptables-alerter-script\") pod \"iptables-alerter-6chfl\" (UID: \"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9\") " pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-socket-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-var-lib-kubelet\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-device-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77f2080a-f31d-4b30-a798-33e9861d8a2e-cni-binary-copy\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625175 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-var-lib-cni-multus\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-etc-kubernetes\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21ac6106-7a51-4276-8324-0645aa8a32f8-agent-certs\") pod \"konnectivity-agent-g5n9d\" (UID: \"21ac6106-7a51-4276-8324-0645aa8a32f8\") " pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624950    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-var-lib-cni-bin\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-cnibin\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624984    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-daemon-config\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.624984    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-device-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8968fb9e-3383-4d8a-b2b1-56d39e60b8f9-host-slash\") pod \"iptables-alerter-6chfl\" (UID: \"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9\") " pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-hostroot\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-run-multus-certs\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-run-multus-certs\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625158    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-socket-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21ac6106-7a51-4276-8324-0645aa8a32f8-konnectivity-ca\") pod \"konnectivity-agent-g5n9d\" (UID: \"21ac6106-7a51-4276-8324-0645aa8a32f8\") " pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-var-lib-kubelet\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-etc-kubernetes\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625296    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-var-lib-cni-multus\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-cnibin\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.625869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625420    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8968fb9e-3383-4d8a-b2b1-56d39e60b8f9-host-slash\") pod \"iptables-alerter-6chfl\" (UID: \"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9\") " pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.626595 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-host-var-lib-cni-bin\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.626595 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a707b303-8154-47fb-aa33-fa01c7a7ffc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.626595 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625638    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8968fb9e-3383-4d8a-b2b1-56d39e60b8f9-iptables-alerter-script\") pod \"iptables-alerter-6chfl\" (UID: \"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9\") " pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.626595 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625663    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77f2080a-f31d-4b30-a798-33e9861d8a2e-hostroot\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.626595 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625677    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77f2080a-f31d-4b30-a798-33e9861d8a2e-cni-binary-copy\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.626595 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.625845    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77f2080a-f31d-4b30-a798-33e9861d8a2e-multus-daemon-config\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.628267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.628243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21ac6106-7a51-4276-8324-0645aa8a32f8-agent-certs\") pod \"konnectivity-agent-g5n9d\" (UID: \"21ac6106-7a51-4276-8324-0645aa8a32f8\") " pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:18.637351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.637290    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqqgn\" (UniqueName: \"kubernetes.io/projected/77f2080a-f31d-4b30-a798-33e9861d8a2e-kube-api-access-lqqgn\") pod \"multus-rsz42\" (UID: \"77f2080a-f31d-4b30-a798-33e9861d8a2e\") " pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.637465 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.637397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgp7j\" (UniqueName: \"kubernetes.io/projected/a707b303-8154-47fb-aa33-fa01c7a7ffc5-kube-api-access-jgp7j\") pod \"aws-ebs-csi-driver-node-87vfn\" (UID: \"a707b303-8154-47fb-aa33-fa01c7a7ffc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.637465 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.637399    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl24g\" (UniqueName: \"kubernetes.io/projected/8968fb9e-3383-4d8a-b2b1-56d39e60b8f9-kube-api-access-fl24g\") pod \"iptables-alerter-6chfl\" (UID: \"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9\") " pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.707571 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.707529    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h672j"
Sep 08 14:34:18.719894 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.719855    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bx5tq"
Sep 08 14:34:18.733282 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.733249    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mjrhr"
Sep 08 14:34:18.737754 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.737727    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n7568"
Sep 08 14:34:18.744708 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.744681    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:18.751770 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.751745    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn"
Sep 08 14:34:18.758682 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.758647    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rsz42"
Sep 08 14:34:18.764589 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.764567    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:18.770538 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.770518    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6chfl"
Sep 08 14:34:18.843922 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:18.843890    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:34:19.028744 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.028646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:19.028744 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.028701    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:19.028989 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:19.028819    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:19.028989 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:19.028831    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:19.028989 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:19.028904    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret podName:c3334c9c-8df4-4eef-a4e5-dfb55276c3f1 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:20.028883754 +0000 UTC m=+4.039403739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret") pod "global-pull-secret-syncer-shnpn" (UID: "c3334c9c-8df4-4eef-a4e5-dfb55276c3f1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:19.028989 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:19.028928    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs podName:fc907ff2-af58-4c71-9031-fddfbd162573 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:20.028919335 +0000 UTC m=+4.039439318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs") pod "network-metrics-daemon-qzw9s" (UID: "fc907ff2-af58-4c71-9031-fddfbd162573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:19.129108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.129066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwl9n\" (UniqueName: \"kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n\") pod \"network-check-target-zvdsw\" (UID: \"691234af-48f7-41c2-abf9-27428e7250c4\") " pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:19.129299 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:19.129269    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:19.129348 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:19.129300    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:19.129348 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:19.129314    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pwl9n for pod openshift-network-diagnostics/network-check-target-zvdsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:19.129415 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:19.129407    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n podName:691234af-48f7-41c2-abf9-27428e7250c4 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:20.129384464 +0000 UTC m=+4.139904445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwl9n" (UniqueName: "kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n") pod "network-check-target-zvdsw" (UID: "691234af-48f7-41c2-abf9-27428e7250c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:19.160874 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:19.160706    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d05c63d_d588_46ea_8b94_a76583420760.slice/crio-f94d8fb175ab1e4616deb96fb46f4c178eaaec0b38bc0ed34c30978724ea3cdd WatchSource:0}: Error finding container f94d8fb175ab1e4616deb96fb46f4c178eaaec0b38bc0ed34c30978724ea3cdd: Status 404 returned error can't find the container with id f94d8fb175ab1e4616deb96fb46f4c178eaaec0b38bc0ed34c30978724ea3cdd
Sep 08 14:34:19.164073 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:19.163925    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6e9a02e_c20b_4fc7_bdef_4d11df4eb280.slice/crio-2ddfb9fa6bd973e3a5c53a117c4753e0e4b4952b680328a2a25d8178df645f69 WatchSource:0}: Error finding container 2ddfb9fa6bd973e3a5c53a117c4753e0e4b4952b680328a2a25d8178df645f69: Status 404 returned error can't find the container with id 2ddfb9fa6bd973e3a5c53a117c4753e0e4b4952b680328a2a25d8178df645f69
Sep 08 14:34:19.167064 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:19.167026    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8968fb9e_3383_4d8a_b2b1_56d39e60b8f9.slice/crio-f775d4f605f8c8eb26ecb99a801227250b7b8e6c1aa2b948eac1c18d97556eb7 WatchSource:0}: Error finding container f775d4f605f8c8eb26ecb99a801227250b7b8e6c1aa2b948eac1c18d97556eb7: Status 404 returned error can't find the container with id f775d4f605f8c8eb26ecb99a801227250b7b8e6c1aa2b948eac1c18d97556eb7
Sep 08 14:34:19.167916 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:19.167893    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06012240_3a1e_44ac_baf8_4648f6b640cf.slice/crio-a03a1fe9f63fab59de47b546932a4278206bc1ac022fa28916ef568f2861c295 WatchSource:0}: Error finding container a03a1fe9f63fab59de47b546932a4278206bc1ac022fa28916ef568f2861c295: Status 404 returned error can't find the container with id a03a1fe9f63fab59de47b546932a4278206bc1ac022fa28916ef568f2861c295
Sep 08 14:34:19.168811 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:19.168748    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d7944c_15c0_4ff2_ac22_6cf9afdae1d2.slice/crio-4249dca35607e3ec7c02310fd769958f395e1560c0712e37afcd852eefb22cdc WatchSource:0}: Error finding container 4249dca35607e3ec7c02310fd769958f395e1560c0712e37afcd852eefb22cdc: Status 404 returned error can't find the container with id 4249dca35607e3ec7c02310fd769958f395e1560c0712e37afcd852eefb22cdc
Sep 08 14:34:19.171001 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:19.170871    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda707b303_8154_47fb_aa33_fa01c7a7ffc5.slice/crio-645317e64e2e6ec12e200317d422199b78a256cd84b5abf77959514b28dbecd6 WatchSource:0}: Error finding container 645317e64e2e6ec12e200317d422199b78a256cd84b5abf77959514b28dbecd6: Status 404 returned error can't find the container with id 645317e64e2e6ec12e200317d422199b78a256cd84b5abf77959514b28dbecd6
Sep 08 14:34:19.171555 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:19.171530    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98985ec1_7b3c_4c2a_add7_be624aca2b36.slice/crio-e8894ae3fc503e1157990bc6e7304250d03c545283f9488a58515466bc0fd0ff WatchSource:0}: Error finding container e8894ae3fc503e1157990bc6e7304250d03c545283f9488a58515466bc0fd0ff: Status 404 returned error can't find the container with id e8894ae3fc503e1157990bc6e7304250d03c545283f9488a58515466bc0fd0ff
Sep 08 14:34:19.196874 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:19.196838    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ac6106_7a51_4276_8324_0645aa8a32f8.slice/crio-d15fcd26b497ecee3296e644060f678b45ef934a95e51b7f7f0c5c240c08003e WatchSource:0}: Error finding container d15fcd26b497ecee3296e644060f678b45ef934a95e51b7f7f0c5c240c08003e: Status 404 returned error can't find the container with id d15fcd26b497ecee3296e644060f678b45ef934a95e51b7f7f0c5c240c08003e
Sep 08 14:34:19.197736 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:19.197705    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f2080a_f31d_4b30_a798_33e9861d8a2e.slice/crio-ac54e37a7ef9c68c049434147c543dd0e130f6dbf98bca67888bed735bdb790e WatchSource:0}: Error finding container ac54e37a7ef9c68c049434147c543dd0e130f6dbf98bca67888bed735bdb790e: Status 404 returned error can't find the container with id ac54e37a7ef9c68c049434147c543dd0e130f6dbf98bca67888bed735bdb790e
Sep 08 14:34:19.222058 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:19.222028    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795ff9d7ddaa3d074269b61192e23bdf.slice/crio-9ae75e77e9687e72b0b3319d182f7460f21788c1c2ac8a5871d94959b4667355 WatchSource:0}: Error finding container 9ae75e77e9687e72b0b3319d182f7460f21788c1c2ac8a5871d94959b4667355: Status 404 returned error can't find the container with id 9ae75e77e9687e72b0b3319d182f7460f21788c1c2ac8a5871d94959b4667355
Sep 08 14:34:19.463164 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.463110    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 14:29:19 +0000 UTC" deadline="2028-04-15 21:54:59.045135916 +0000 UTC"
Sep 08 14:34:19.463164 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.463170    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14047h20m39.581989255s"
Sep 08 14:34:19.514933 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.514893    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:19.515145 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:19.515049    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:19.515145 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.515109    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:19.515303 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:19.515242    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:19.525074 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.525030    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6chfl" event={"ID":"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9","Type":"ContainerStarted","Data":"f775d4f605f8c8eb26ecb99a801227250b7b8e6c1aa2b948eac1c18d97556eb7"}
Sep 08 14:34:19.526891 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.526852    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bx5tq" event={"ID":"06012240-3a1e-44ac-baf8-4648f6b640cf","Type":"ContainerStarted","Data":"a03a1fe9f63fab59de47b546932a4278206bc1ac022fa28916ef568f2861c295"}
Sep 08 14:34:19.528218 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.528189    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n7568" event={"ID":"1d05c63d-d588-46ea-8b94-a76583420760","Type":"ContainerStarted","Data":"f94d8fb175ab1e4616deb96fb46f4c178eaaec0b38bc0ed34c30978724ea3cdd"}
Sep 08 14:34:19.530205 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.530182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal" event={"ID":"aaee42d2e078b0aa5a0ca900ffc90198","Type":"ContainerStarted","Data":"eb13188fd6babf0c0938cf652d9f907eb9a282dd1e9efd2bc06336b7be470d91"}
Sep 08 14:34:19.531471 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.531443    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal" event={"ID":"795ff9d7ddaa3d074269b61192e23bdf","Type":"ContainerStarted","Data":"9ae75e77e9687e72b0b3319d182f7460f21788c1c2ac8a5871d94959b4667355"}
Sep 08 14:34:19.532667 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.532645    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjrhr" event={"ID":"98985ec1-7b3c-4c2a-add7-be624aca2b36","Type":"ContainerStarted","Data":"e8894ae3fc503e1157990bc6e7304250d03c545283f9488a58515466bc0fd0ff"}
Sep 08 14:34:19.533974 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.533955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk" event={"ID":"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280","Type":"ContainerStarted","Data":"2ddfb9fa6bd973e3a5c53a117c4753e0e4b4952b680328a2a25d8178df645f69"}
Sep 08 14:34:19.535242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.535209    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rsz42" event={"ID":"77f2080a-f31d-4b30-a798-33e9861d8a2e","Type":"ContainerStarted","Data":"ac54e37a7ef9c68c049434147c543dd0e130f6dbf98bca67888bed735bdb790e"}
Sep 08 14:34:19.536321 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.536290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g5n9d" event={"ID":"21ac6106-7a51-4276-8324-0645aa8a32f8","Type":"ContainerStarted","Data":"d15fcd26b497ecee3296e644060f678b45ef934a95e51b7f7f0c5c240c08003e"}
Sep 08 14:34:19.537550 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.537528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn" event={"ID":"a707b303-8154-47fb-aa33-fa01c7a7ffc5","Type":"ContainerStarted","Data":"645317e64e2e6ec12e200317d422199b78a256cd84b5abf77959514b28dbecd6"}
Sep 08 14:34:19.538667 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.538645    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h672j" event={"ID":"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2","Type":"ContainerStarted","Data":"4249dca35607e3ec7c02310fd769958f395e1560c0712e37afcd852eefb22cdc"}
Sep 08 14:34:19.546825 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:19.546707    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-248.ec2.internal" podStartSLOduration=1.546687269 podStartE2EDuration="1.546687269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:19.545790661 +0000 UTC m=+3.556310653" watchObservedRunningTime="2026-09-08 14:34:19.546687269 +0000 UTC m=+3.557207272"
Sep 08 14:34:20.035692 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:20.035644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:20.035912 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:20.035706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:20.035912 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:20.035846    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:20.036040 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:20.035914    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret podName:c3334c9c-8df4-4eef-a4e5-dfb55276c3f1 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:22.035894814 +0000 UTC m=+6.046414799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret") pod "global-pull-secret-syncer-shnpn" (UID: "c3334c9c-8df4-4eef-a4e5-dfb55276c3f1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:20.036440 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:20.036344    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:20.036440 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:20.036426    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs podName:fc907ff2-af58-4c71-9031-fddfbd162573 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:22.036406027 +0000 UTC m=+6.046926008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs") pod "network-metrics-daemon-qzw9s" (UID: "fc907ff2-af58-4c71-9031-fddfbd162573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:20.137551 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:20.136853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwl9n\" (UniqueName: \"kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n\") pod \"network-check-target-zvdsw\" (UID: \"691234af-48f7-41c2-abf9-27428e7250c4\") " pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:20.137551 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:20.137051    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:20.137551 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:20.137079    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:20.137551 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:20.137094    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pwl9n for pod openshift-network-diagnostics/network-check-target-zvdsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:20.137551 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:20.137159    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n podName:691234af-48f7-41c2-abf9-27428e7250c4 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:22.137139394 +0000 UTC m=+6.147659387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwl9n" (UniqueName: "kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n") pod "network-check-target-zvdsw" (UID: "691234af-48f7-41c2-abf9-27428e7250c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:20.464326 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:20.464248    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 14:29:19 +0000 UTC" deadline="2028-05-20 18:51:33.35926769 +0000 UTC"
Sep 08 14:34:20.464326 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:20.464322    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14884h17m12.894950319s"
Sep 08 14:34:20.519923 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:20.519375    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:20.519923 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:20.519526    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:21.515242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:21.515185    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:21.515749 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:21.515356    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:21.515749 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:21.515444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:21.515749 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:21.515539    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:22.052486 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:22.052442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:22.052711 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:22.052502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:22.052711 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:22.052683    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:22.052828 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:22.052750    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret podName:c3334c9c-8df4-4eef-a4e5-dfb55276c3f1 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:26.052731289 +0000 UTC m=+10.063251272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret") pod "global-pull-secret-syncer-shnpn" (UID: "c3334c9c-8df4-4eef-a4e5-dfb55276c3f1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:22.053214 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:22.053191    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:22.053341 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:22.053266    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs podName:fc907ff2-af58-4c71-9031-fddfbd162573 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:26.053249418 +0000 UTC m=+10.063769420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs") pod "network-metrics-daemon-qzw9s" (UID: "fc907ff2-af58-4c71-9031-fddfbd162573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:22.153533 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:22.153489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwl9n\" (UniqueName: \"kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n\") pod \"network-check-target-zvdsw\" (UID: \"691234af-48f7-41c2-abf9-27428e7250c4\") " pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:22.153759 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:22.153740    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:22.153823 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:22.153770    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:22.153823 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:22.153784    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pwl9n for pod openshift-network-diagnostics/network-check-target-zvdsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:22.153938 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:22.153849    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n podName:691234af-48f7-41c2-abf9-27428e7250c4 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:26.153830054 +0000 UTC m=+10.164350058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwl9n" (UniqueName: "kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n") pod "network-check-target-zvdsw" (UID: "691234af-48f7-41c2-abf9-27428e7250c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:22.515783 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:22.515689    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:22.516354 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:22.515950    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:23.515360 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:23.515320    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:23.515556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:23.515321    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:23.515556 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:23.515485    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:23.515556 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:23.515539    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:24.517712 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:24.517668    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:24.518241 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:24.517831    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:25.514992 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:25.514900    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:25.515192 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:25.515026    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:25.517785 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:25.515438    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:25.517785 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:25.515505    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:26.092211 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:26.092151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:26.092413 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:26.092234    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:26.092413 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:26.092298    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:26.092413 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:26.092366    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:26.092413 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:26.092378    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs podName:fc907ff2-af58-4c71-9031-fddfbd162573 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:34.092357813 +0000 UTC m=+18.102877792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs") pod "network-metrics-daemon-qzw9s" (UID: "fc907ff2-af58-4c71-9031-fddfbd162573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:26.092413 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:26.092407    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret podName:c3334c9c-8df4-4eef-a4e5-dfb55276c3f1 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:34.092396755 +0000 UTC m=+18.102916733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret") pod "global-pull-secret-syncer-shnpn" (UID: "c3334c9c-8df4-4eef-a4e5-dfb55276c3f1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:26.193704 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:26.193650    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwl9n\" (UniqueName: \"kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n\") pod \"network-check-target-zvdsw\" (UID: \"691234af-48f7-41c2-abf9-27428e7250c4\") " pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:26.193928 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:26.193869    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:26.193928 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:26.193905    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:26.193928 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:26.193921    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pwl9n for pod openshift-network-diagnostics/network-check-target-zvdsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:26.194087 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:26.193987    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n podName:691234af-48f7-41c2-abf9-27428e7250c4 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:34.193968101 +0000 UTC m=+18.204488105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwl9n" (UniqueName: "kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n") pod "network-check-target-zvdsw" (UID: "691234af-48f7-41c2-abf9-27428e7250c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:26.516221 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:26.516118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:26.516399 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:26.516251    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:27.514868 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:27.514833    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:27.515418 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:27.514967    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:27.515418 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:27.515356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:27.515501 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:27.515441    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:28.515220 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:28.514974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:28.515220 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:28.515122    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:29.515650 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:29.515561    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:29.516113 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:29.515687    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:29.516113 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:29.515728    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:29.516113 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:29.515793    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:30.514895 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:30.514859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:30.515116 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:30.515029    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:31.514938 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:31.514905    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:31.515418 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:31.514891    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:31.515418 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:31.515081    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:31.515418 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:31.515229    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:32.515743 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:32.515541    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:32.516174 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:32.515883    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:33.515355 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:33.515312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:33.515629 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:33.515312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:33.515629 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:33.515435    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:33.515629 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:33.515544    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:34.158339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:34.158298    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:34.158339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:34.158354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:34.158810 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:34.158472    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:34.158810 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:34.158483    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:34.158810 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:34.158549    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs podName:fc907ff2-af58-4c71-9031-fddfbd162573 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:50.158529129 +0000 UTC m=+34.169049106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs") pod "network-metrics-daemon-qzw9s" (UID: "fc907ff2-af58-4c71-9031-fddfbd162573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:34.158810 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:34.158570    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret podName:c3334c9c-8df4-4eef-a4e5-dfb55276c3f1 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:50.15856105 +0000 UTC m=+34.169081032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret") pod "global-pull-secret-syncer-shnpn" (UID: "c3334c9c-8df4-4eef-a4e5-dfb55276c3f1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:34.259097 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:34.259046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwl9n\" (UniqueName: \"kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n\") pod \"network-check-target-zvdsw\" (UID: \"691234af-48f7-41c2-abf9-27428e7250c4\") " pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:34.259304 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:34.259244    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:34.259304 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:34.259276    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:34.259304 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:34.259288    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pwl9n for pod openshift-network-diagnostics/network-check-target-zvdsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:34.259448 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:34.259356    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n podName:691234af-48f7-41c2-abf9-27428e7250c4 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:50.259340123 +0000 UTC m=+34.269860102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwl9n" (UniqueName: "kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n") pod "network-check-target-zvdsw" (UID: "691234af-48f7-41c2-abf9-27428e7250c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:34.515525 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:34.515438    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:34.515670 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:34.515561    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:35.515604 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:35.515566    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:35.516048 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:35.515614    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:35.516048 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:35.515701    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:35.516048 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:35.515864    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:36.515227 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:36.515201    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:36.515385 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:36.515294    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:37.515401 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:37.515355    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:37.515401 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:37.515399    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:37.515908 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:37.515503    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:37.515908 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:37.515620    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:38.516046 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:38.515542    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:38.516046 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:38.515684    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:39.515317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.515111    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:39.515482 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.515179    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:39.515482 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:39.515402    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:39.515482 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:39.515471    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:39.588829 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.588751    2561 generic.go:356] "Generic (PLEG): container finished" podID="795ff9d7ddaa3d074269b61192e23bdf" containerID="c15f3bd9e5cee156ff600963d0f16fbef2e3e46375231ab930bf8b95bf4b58a0" exitCode=0
Sep 08 14:34:39.589861 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.588852    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal" event={"ID":"795ff9d7ddaa3d074269b61192e23bdf","Type":"ContainerDied","Data":"c15f3bd9e5cee156ff600963d0f16fbef2e3e46375231ab930bf8b95bf4b58a0"}
Sep 08 14:34:39.590970 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.590866    2561 generic.go:356] "Generic (PLEG): container finished" podID="98985ec1-7b3c-4c2a-add7-be624aca2b36" containerID="b210b7fc46691f3169b4962454450da12a644a5e31645450b5b413e2f79213bc" exitCode=0
Sep 08 14:34:39.590970 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.590904    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjrhr" event={"ID":"98985ec1-7b3c-4c2a-add7-be624aca2b36","Type":"ContainerDied","Data":"b210b7fc46691f3169b4962454450da12a644a5e31645450b5b413e2f79213bc"}
Sep 08 14:34:39.596694 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.596672    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk" event={"ID":"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280","Type":"ContainerStarted","Data":"bd889dadbbf7ba47da4d818521fa5be418f9f4ddcafc49738631630b0275f47e"}
Sep 08 14:34:39.596815 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.596742    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk" event={"ID":"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280","Type":"ContainerStarted","Data":"ea3b083ce804c2b4566808e6ced729a5cf27abe1975b859688447e5245d1d3f3"}
Sep 08 14:34:39.596815 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.596772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk" event={"ID":"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280","Type":"ContainerStarted","Data":"2ab3c97b6b26ee39c9b1a3d9792f8c26d03423d11480876f217480b7e979cdaf"}
Sep 08 14:34:39.596815 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.596801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk" event={"ID":"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280","Type":"ContainerStarted","Data":"5e932debf0810937a926ca9b77187460e043a1ada27d4ca34702ed9a9acb9ff0"}
Sep 08 14:34:39.596965 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.596826    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk" event={"ID":"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280","Type":"ContainerStarted","Data":"b1ab51da5033c8ff0cc4c7727c7a09d616bb074abeda3a78c961a648f8c22805"}
Sep 08 14:34:39.596965 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.596853    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk" event={"ID":"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280","Type":"ContainerStarted","Data":"f7eff5179e0327b3a860008e8fab48a3e364d6bb4e04a2a772a516eea10673ed"}
Sep 08 14:34:39.599697 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.599654    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rsz42" event={"ID":"77f2080a-f31d-4b30-a798-33e9861d8a2e","Type":"ContainerStarted","Data":"a0a4654aeed8a72928241d544a3a329bfd993c6081efba9605eef6a2b96e9999"}
Sep 08 14:34:39.601252 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.601228    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g5n9d" event={"ID":"21ac6106-7a51-4276-8324-0645aa8a32f8","Type":"ContainerStarted","Data":"c48070106a9b2db4a04be939fa29fecd5368d1e523d22b80e290db9256718bdd"}
Sep 08 14:34:39.602853 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.602797    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn" event={"ID":"a707b303-8154-47fb-aa33-fa01c7a7ffc5","Type":"ContainerStarted","Data":"521c1ad58d6a7dee762636bb8a3fe3a328ff36a38f905dc2d6fe824b4f8bb587"}
Sep 08 14:34:39.604365 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.604345    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h672j" event={"ID":"63d7944c-15c0-4ff2-ac22-6cf9afdae1d2","Type":"ContainerStarted","Data":"4e891c0159862dafe1bcea707ded1ec153b060cd6fa77d4f7aad73d4641763f5"}
Sep 08 14:34:39.606888 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.606863    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bx5tq" event={"ID":"06012240-3a1e-44ac-baf8-4648f6b640cf","Type":"ContainerStarted","Data":"cb2f25c83aab3652140290e0c87215138f7c85b44e53ad42147706b696725f36"}
Sep 08 14:34:39.608363 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.608340    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n7568" event={"ID":"1d05c63d-d588-46ea-8b94-a76583420760","Type":"ContainerStarted","Data":"9642b7bc44c05bbeaa36cf52709300fbc7876a8c1a0d9fa2e1f35fff2bffca53"}
Sep 08 14:34:39.694014 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.693953    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n7568" podStartSLOduration=3.2202542100000002 podStartE2EDuration="22.69392918s" totalImagesPullingTime="19.47367497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:39.667500212 +0000 UTC m=+23.678020212" watchObservedRunningTime="2026-09-08 14:34:39.69392918 +0000 UTC m=+23.704449181"
Sep 08 14:34:39.720872 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.720673    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rsz42" podStartSLOduration=3.235323365 podStartE2EDuration="22.720656424s" totalImagesPullingTime="19.485333059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:39.694289059 +0000 UTC m=+23.704809058" watchObservedRunningTime="2026-09-08 14:34:39.720656424 +0000 UTC m=+23.731176423"
Sep 08 14:34:39.755940 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.755896    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g5n9d" podStartSLOduration=7.251917027 podStartE2EDuration="22.755882213s" totalImagesPullingTime="15.503965186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:39.755389239 +0000 UTC m=+23.765909262" watchObservedRunningTime="2026-09-08 14:34:39.755882213 +0000 UTC m=+23.766402211"
Sep 08 14:34:39.756051 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:39.756021    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h672j" podStartSLOduration=3.314155771 podStartE2EDuration="22.756015151s" totalImagesPullingTime="19.44185938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:39.720387173 +0000 UTC m=+23.730907173" watchObservedRunningTime="2026-09-08 14:34:39.756015151 +0000 UTC m=+23.766535147"
Sep 08 14:34:40.465823 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.465790    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 14:34:40.484744 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.484657    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T14:34:40.465815332Z","UUID":"a2e02b65-32bf-497e-af41-ea7715bda61c","Handler":null,"Name":"","Endpoint":""}
Sep 08 14:34:40.486229 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.486209    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 14:34:40.486346 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.486246    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 14:34:40.515523 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.515489    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:40.515701 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:40.515612    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:40.613455 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.613365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn" event={"ID":"a707b303-8154-47fb-aa33-fa01c7a7ffc5","Type":"ContainerStarted","Data":"25781ffa220d0a9a5caae3b3297dbc7938b9548c4d7d790d5d4143cdacb7551b"}
Sep 08 14:34:40.615250 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.615210    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6chfl" event={"ID":"8968fb9e-3383-4d8a-b2b1-56d39e60b8f9","Type":"ContainerStarted","Data":"bc0cbdf5ae3057b88770711ebecd056ef79c5857dd67eab5156d8f583c32a37a"}
Sep 08 14:34:40.617422 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.617395    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal" event={"ID":"795ff9d7ddaa3d074269b61192e23bdf","Type":"ContainerStarted","Data":"6afb040b72cc70b56ff98cf88fc5f5a454a167ec4710b9da960f0aa427883070"}
Sep 08 14:34:40.632372 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.632328    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6chfl" podStartSLOduration=4.168522869 podStartE2EDuration="23.632312268s" totalImagesPullingTime="19.463789399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:40.632308743 +0000 UTC m=+24.642828741" watchObservedRunningTime="2026-09-08 14:34:40.632312268 +0000 UTC m=+24.642832267"
Sep 08 14:34:40.632736 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.632710    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bx5tq" podStartSLOduration=4.175119877 podStartE2EDuration="23.632700448s" totalImagesPullingTime="19.457580571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:39.809053624 +0000 UTC m=+23.819573622" watchObservedRunningTime="2026-09-08 14:34:40.632700448 +0000 UTC m=+24.643220518"
Sep 08 14:34:40.653783 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.653738    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-248.ec2.internal" podStartSLOduration=22.653726224 podStartE2EDuration="22.653726224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:40.653158404 +0000 UTC m=+24.663678394" watchObservedRunningTime="2026-09-08 14:34:40.653726224 +0000 UTC m=+24.664246223"
Sep 08 14:34:40.850271 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.850229    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:40.850901 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:40.850879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:41.514922 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:41.514893    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:41.515075 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:41.514921    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:41.515075 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:41.515038    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:41.515215 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:41.515179    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:41.623973 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:41.623932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk" event={"ID":"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280","Type":"ContainerStarted","Data":"72b5d7ffac92b100e44f6bea2a367f0873cf3c97f806df6c8bf191aadc72c16c"}
Sep 08 14:34:42.515717 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:42.515678    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:42.515896 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:42.515830    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:42.628781 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:42.628732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn" event={"ID":"a707b303-8154-47fb-aa33-fa01c7a7ffc5","Type":"ContainerStarted","Data":"89a1f620b37387c98e015c18740f79a0ee4d25b8273ba6eb4fe835dcdc0aa39b"}
Sep 08 14:34:42.629266 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:42.628762    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 14:34:42.647943 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:42.647891    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87vfn" podStartSLOduration=3.604898455 podStartE2EDuration="25.64787572s" totalImagesPullingTime="22.042977265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:42.647364135 +0000 UTC m=+26.657884134" watchObservedRunningTime="2026-09-08 14:34:42.64787572 +0000 UTC m=+26.658395719"
Sep 08 14:34:43.514850 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:43.514811    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:43.514850 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:43.514838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:43.515097 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:43.514936    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:43.515097 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:43.515063    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:44.515813 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:44.515652    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:44.516212 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:44.515949    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:44.636774 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:44.636735    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjrhr" event={"ID":"98985ec1-7b3c-4c2a-add7-be624aca2b36","Type":"ContainerStarted","Data":"068525aa833dda4ac5f3fb3a642196da13f41b72cfcbb12023461e72a2bd7b1f"}
Sep 08 14:34:44.640663 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:44.640627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk" event={"ID":"f6e9a02e-c20b-4fc7-bdef-4d11df4eb280","Type":"ContainerStarted","Data":"6d0cbab4d81c7c0fa1b469b5abc6acfd74dd04074fd0c5a47933ab966c179cef"}
Sep 08 14:34:44.640910 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:44.640896    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:44.657078 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:44.657046    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:44.965464 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:44.965431    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:44.965633 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:44.965587    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 14:34:44.965980 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:44.965955    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g5n9d"
Sep 08 14:34:44.983061 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:44.983010    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk" podStartSLOduration=8.452892272 podStartE2EDuration="27.982994487s" totalImagesPullingTime="19.530102215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:44.69921154 +0000 UTC m=+28.709731539" watchObservedRunningTime="2026-09-08 14:34:44.982994487 +0000 UTC m=+28.993514494"
Sep 08 14:34:45.515051 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:45.515010    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:45.515051 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:45.515035    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:45.515280 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:45.515139    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:45.515280 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:45.515260    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:45.646859 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:45.646779    2561 generic.go:356] "Generic (PLEG): container finished" podID="98985ec1-7b3c-4c2a-add7-be624aca2b36" containerID="068525aa833dda4ac5f3fb3a642196da13f41b72cfcbb12023461e72a2bd7b1f" exitCode=0
Sep 08 14:34:45.648678 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:45.648074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjrhr" event={"ID":"98985ec1-7b3c-4c2a-add7-be624aca2b36","Type":"ContainerDied","Data":"068525aa833dda4ac5f3fb3a642196da13f41b72cfcbb12023461e72a2bd7b1f"}
Sep 08 14:34:45.649402 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:45.649264    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:45.649402 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:45.649341    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:45.673763 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:45.673723    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:34:46.374874 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:46.374117    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-shnpn"]
Sep 08 14:34:46.374874 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:46.374506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:46.374874 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:46.374620    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:46.376919 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:46.376884    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zvdsw"]
Sep 08 14:34:46.377040 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:46.376984    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:46.377140 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:46.377071    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:46.389129 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:46.389015    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qzw9s"]
Sep 08 14:34:46.389288 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:46.389137    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:46.389288 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:46.389264    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:46.651494 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:46.651412    2561 generic.go:356] "Generic (PLEG): container finished" podID="98985ec1-7b3c-4c2a-add7-be624aca2b36" containerID="7f5e8ff87f49a28174166427af727739bebb04791073fbfd7bc412180053a6a0" exitCode=0
Sep 08 14:34:46.651494 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:46.651475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjrhr" event={"ID":"98985ec1-7b3c-4c2a-add7-be624aca2b36","Type":"ContainerDied","Data":"7f5e8ff87f49a28174166427af727739bebb04791073fbfd7bc412180053a6a0"}
Sep 08 14:34:47.514655 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:47.514627    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:47.514818 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:47.514627    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:47.514818 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:47.514733    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:47.514885 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:47.514825    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:47.514885 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:47.514627    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:47.514939 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:47.514903    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:47.656666 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:47.656564    2561 generic.go:356] "Generic (PLEG): container finished" podID="98985ec1-7b3c-4c2a-add7-be624aca2b36" containerID="a6f2816bae86447db53cd3d1d232946914c2e97c1de5976e7bf50fa6857d8bc8" exitCode=0
Sep 08 14:34:47.656666 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:47.656599    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjrhr" event={"ID":"98985ec1-7b3c-4c2a-add7-be624aca2b36","Type":"ContainerDied","Data":"a6f2816bae86447db53cd3d1d232946914c2e97c1de5976e7bf50fa6857d8bc8"}
Sep 08 14:34:49.514858 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:49.514821    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:49.515391 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:49.514821    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:49.515391 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:49.514951    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-shnpn" podUID="c3334c9c-8df4-4eef-a4e5-dfb55276c3f1"
Sep 08 14:34:49.515391 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:49.515031    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzw9s" podUID="fc907ff2-af58-4c71-9031-fddfbd162573"
Sep 08 14:34:49.515391 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:49.514830    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:49.515391 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:49.515121    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvdsw" podUID="691234af-48f7-41c2-abf9-27428e7250c4"
Sep 08 14:34:50.172624 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:50.172588    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:50.172624 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:50.172629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:50.172852 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:50.172736    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:50.172852 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:50.172737    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:50.172852 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:50.172794    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret podName:c3334c9c-8df4-4eef-a4e5-dfb55276c3f1 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:22.172780346 +0000 UTC m=+66.183300322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret") pod "global-pull-secret-syncer-shnpn" (UID: "c3334c9c-8df4-4eef-a4e5-dfb55276c3f1") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:50.172852 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:50.172809    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs podName:fc907ff2-af58-4c71-9031-fddfbd162573 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:22.172803123 +0000 UTC m=+66.183323099 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs") pod "network-metrics-daemon-qzw9s" (UID: "fc907ff2-af58-4c71-9031-fddfbd162573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:50.273041 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:50.272991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwl9n\" (UniqueName: \"kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n\") pod \"network-check-target-zvdsw\" (UID: \"691234af-48f7-41c2-abf9-27428e7250c4\") " pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:50.273292 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:50.273186    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:50.273292 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:50.273210    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:50.273292 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:50.273225    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pwl9n for pod openshift-network-diagnostics/network-check-target-zvdsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:50.273451 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:50.273297    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n podName:691234af-48f7-41c2-abf9-27428e7250c4 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:22.273279049 +0000 UTC m=+66.283799050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwl9n" (UniqueName: "kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n") pod "network-check-target-zvdsw" (UID: "691234af-48f7-41c2-abf9-27428e7250c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:51.271853 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.271812    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-248.ec2.internal" event="NodeReady"
Sep 08 14:34:51.272337 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.271984    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 14:34:51.327583 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.327544    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-szrgb"]
Sep 08 14:34:51.333554 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.333530    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w6pcq"]
Sep 08 14:34:51.333720 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.333675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.337126 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.336976    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 14:34:51.337442 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.337417    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rsnws\""
Sep 08 14:34:51.337555 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.337462    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w6pcq"
Sep 08 14:34:51.337615 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.337560    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 14:34:51.340219 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.340198    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 14:34:51.340332 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.340304    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 14:34:51.341362 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.341347    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 14:34:51.341616 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.341579    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xpbhp\""
Sep 08 14:34:51.348441 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.348416    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-szrgb"]
Sep 08 14:34:51.348549 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.348509    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w6pcq"]
Sep 08 14:34:51.482284 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.482248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bg8h\" (UniqueName: \"kubernetes.io/projected/0ddd618f-e729-4985-b013-c6dbbb8931c2-kube-api-access-6bg8h\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.482477 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.482293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.482477 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.482316    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2546d478-fdbf-4358-bd11-a3b07cef8fb4-cert\") pod \"ingress-canary-w6pcq\" (UID: \"2546d478-fdbf-4358-bd11-a3b07cef8fb4\") " pod="openshift-ingress-canary/ingress-canary-w6pcq"
Sep 08 14:34:51.482477 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.482346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddd618f-e729-4985-b013-c6dbbb8931c2-tmp-dir\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.482477 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.482375    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ddd618f-e729-4985-b013-c6dbbb8931c2-config-volume\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.482477 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.482399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55ghz\" (UniqueName: \"kubernetes.io/projected/2546d478-fdbf-4358-bd11-a3b07cef8fb4-kube-api-access-55ghz\") pod \"ingress-canary-w6pcq\" (UID: \"2546d478-fdbf-4358-bd11-a3b07cef8fb4\") " pod="openshift-ingress-canary/ingress-canary-w6pcq"
Sep 08 14:34:51.515533 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.515496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:34:51.515533 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.515537    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:34:51.515789 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.515542    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:34:51.518425 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.518401    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nvk2x\""
Sep 08 14:34:51.518425 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.518410    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 14:34:51.518591 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.518409    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42kmv\""
Sep 08 14:34:51.518591 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.518490    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 14:34:51.519115 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.519095    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 14:34:51.519115 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.519111    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 14:34:51.583133 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.583093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ddd618f-e729-4985-b013-c6dbbb8931c2-config-volume\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.583330 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.583165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55ghz\" (UniqueName: \"kubernetes.io/projected/2546d478-fdbf-4358-bd11-a3b07cef8fb4-kube-api-access-55ghz\") pod \"ingress-canary-w6pcq\" (UID: \"2546d478-fdbf-4358-bd11-a3b07cef8fb4\") " pod="openshift-ingress-canary/ingress-canary-w6pcq"
Sep 08 14:34:51.583586 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.583556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bg8h\" (UniqueName: \"kubernetes.io/projected/0ddd618f-e729-4985-b013-c6dbbb8931c2-kube-api-access-6bg8h\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.583721 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.583606    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.583721 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.583631    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2546d478-fdbf-4358-bd11-a3b07cef8fb4-cert\") pod \"ingress-canary-w6pcq\" (UID: \"2546d478-fdbf-4358-bd11-a3b07cef8fb4\") " pod="openshift-ingress-canary/ingress-canary-w6pcq"
Sep 08 14:34:51.583721 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.583668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddd618f-e729-4985-b013-c6dbbb8931c2-tmp-dir\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.583882 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.583753    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ddd618f-e729-4985-b013-c6dbbb8931c2-config-volume\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.583882 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:51.583860    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:51.583986 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:51.583909    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls podName:0ddd618f-e729-4985-b013-c6dbbb8931c2 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:52.083891097 +0000 UTC m=+36.094411074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls") pod "dns-default-szrgb" (UID: "0ddd618f-e729-4985-b013-c6dbbb8931c2") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:51.583986 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.583967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddd618f-e729-4985-b013-c6dbbb8931c2-tmp-dir\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.589205 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.589178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2546d478-fdbf-4358-bd11-a3b07cef8fb4-cert\") pod \"ingress-canary-w6pcq\" (UID: \"2546d478-fdbf-4358-bd11-a3b07cef8fb4\") " pod="openshift-ingress-canary/ingress-canary-w6pcq"
Sep 08 14:34:51.595586 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.595538    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bg8h\" (UniqueName: \"kubernetes.io/projected/0ddd618f-e729-4985-b013-c6dbbb8931c2-kube-api-access-6bg8h\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:51.595864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.595846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55ghz\" (UniqueName: \"kubernetes.io/projected/2546d478-fdbf-4358-bd11-a3b07cef8fb4-kube-api-access-55ghz\") pod \"ingress-canary-w6pcq\" (UID: \"2546d478-fdbf-4358-bd11-a3b07cef8fb4\") " pod="openshift-ingress-canary/ingress-canary-w6pcq"
Sep 08 14:34:51.653857 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:51.653799    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w6pcq"
Sep 08 14:34:52.088515 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:52.088261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:52.088678 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:52.088400    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:52.088678 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:52.088646    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls podName:0ddd618f-e729-4985-b013-c6dbbb8931c2 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:53.088626137 +0000 UTC m=+37.099146116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls") pod "dns-default-szrgb" (UID: "0ddd618f-e729-4985-b013-c6dbbb8931c2") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:52.351593 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:52.351509    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w6pcq"]
Sep 08 14:34:52.355259 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:52.355230    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2546d478_fdbf_4358_bd11_a3b07cef8fb4.slice/crio-d5c9081b9a85a54dc458e386f59f9daefb87e2c3d26ea241ff69c7050f4b5524 WatchSource:0}: Error finding container d5c9081b9a85a54dc458e386f59f9daefb87e2c3d26ea241ff69c7050f4b5524: Status 404 returned error can't find the container with id d5c9081b9a85a54dc458e386f59f9daefb87e2c3d26ea241ff69c7050f4b5524
Sep 08 14:34:52.670185 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:52.670133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w6pcq" event={"ID":"2546d478-fdbf-4358-bd11-a3b07cef8fb4","Type":"ContainerStarted","Data":"d5c9081b9a85a54dc458e386f59f9daefb87e2c3d26ea241ff69c7050f4b5524"}
Sep 08 14:34:52.673004 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:52.672979    2561 generic.go:356] "Generic (PLEG): container finished" podID="98985ec1-7b3c-4c2a-add7-be624aca2b36" containerID="60cdd20b51dc574cf6ece3b8c39d71afe251f061548db8ca71a4a04de7286a45" exitCode=0
Sep 08 14:34:52.673124 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:52.673031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjrhr" event={"ID":"98985ec1-7b3c-4c2a-add7-be624aca2b36","Type":"ContainerDied","Data":"60cdd20b51dc574cf6ece3b8c39d71afe251f061548db8ca71a4a04de7286a45"}
Sep 08 14:34:53.095680 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:53.095644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:53.095855 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:53.095769    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:53.095855 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:53.095824    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls podName:0ddd618f-e729-4985-b013-c6dbbb8931c2 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:55.095811062 +0000 UTC m=+39.106331043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls") pod "dns-default-szrgb" (UID: "0ddd618f-e729-4985-b013-c6dbbb8931c2") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:53.679799 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:53.679764    2561 generic.go:356] "Generic (PLEG): container finished" podID="98985ec1-7b3c-4c2a-add7-be624aca2b36" containerID="52b514221791c6138a098ff45b4077f41f98d30c0f6927a12ca444dc5a7b1177" exitCode=0
Sep 08 14:34:53.680421 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:53.679809    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjrhr" event={"ID":"98985ec1-7b3c-4c2a-add7-be624aca2b36","Type":"ContainerDied","Data":"52b514221791c6138a098ff45b4077f41f98d30c0f6927a12ca444dc5a7b1177"}
Sep 08 14:34:54.686351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:54.686309    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjrhr" event={"ID":"98985ec1-7b3c-4c2a-add7-be624aca2b36","Type":"ContainerStarted","Data":"6b156c053adf20fce1729044a91f350445b1591538565f9fc377746e208d2179"}
Sep 08 14:34:54.708215 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:54.708125    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mjrhr" podStartSLOduration=7.13843572 podStartE2EDuration="37.708101704s" totalImagesPullingTime="30.569665984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:54.706507304 +0000 UTC m=+38.717027302" watchObservedRunningTime="2026-09-08 14:34:54.708101704 +0000 UTC m=+38.718621706"
Sep 08 14:34:55.112231 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.112187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:55.112405 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:55.112363    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:55.112453 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:55.112441    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls podName:0ddd618f-e729-4985-b013-c6dbbb8931c2 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:59.112421913 +0000 UTC m=+43.122941889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls") pod "dns-default-szrgb" (UID: "0ddd618f-e729-4985-b013-c6dbbb8931c2") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:55.690500 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.690253    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w6pcq" event={"ID":"2546d478-fdbf-4358-bd11-a3b07cef8fb4","Type":"ContainerStarted","Data":"3fa2cc44fd7267620b43f6a2565915a82a0a272633980ac53526e52f4889322b"}
Sep 08 14:34:55.705872 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.705824    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w6pcq" podStartSLOduration=1.750248541 podStartE2EDuration="4.705807233s" totalImagesPullingTime="2.955558692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:55.705676073 +0000 UTC m=+39.716196082" watchObservedRunningTime="2026-09-08 14:34:55.705807233 +0000 UTC m=+39.716327231"
Sep 08 14:34:55.924693 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.924662    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr"]
Sep 08 14:34:55.941829 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.941757    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr"]
Sep 08 14:34:55.941954 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.941857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr"
Sep 08 14:34:55.944272 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.944246    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fvnfp\""
Sep 08 14:34:55.944492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.944464    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 08 14:34:55.944620 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.944515    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:34:55.954958 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.954937    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8476856557-wr4vm"]
Sep 08 14:34:55.973628 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.973608    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8476856557-wr4vm"]
Sep 08 14:34:55.973750 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.973708    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:55.976013 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.975894    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7gv8x\""
Sep 08 14:34:55.976013 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.975983    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 14:34:55.976437 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.976417    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 14:34:55.976560 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.976484    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 14:34:55.984259 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:55.984238    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 14:34:56.018715 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.018694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm2gz\" (UniqueName: \"kubernetes.io/projected/74358fc4-0e9c-4f0f-b22d-c3552227e0c6-kube-api-access-fm2gz\") pod \"volume-data-source-validator-695c895bd6-mt2hr\" (UID: \"74358fc4-0e9c-4f0f-b22d-c3552227e0c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr"
Sep 08 14:34:56.023098 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.023071    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-4ccf5"]
Sep 08 14:34:56.045107 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.045086    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-4ccf5"]
Sep 08 14:34:56.045212 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.045196    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.047766 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.047738    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 08 14:34:56.048046 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.048034    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 08 14:34:56.048649 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.048632    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:34:56.049040 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.048999    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 08 14:34:56.049749 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.049734    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fkz9q\""
Sep 08 14:34:56.054796 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.054777    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 08 14:34:56.119880 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.119844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b2e05c9-ce24-4ebc-90dc-365bddac7688-config\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.120072 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.119927    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dpmt\" (UniqueName: \"kubernetes.io/projected/9b2e05c9-ce24-4ebc-90dc-365bddac7688-kube-api-access-6dpmt\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.120072 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.119996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-installation-pull-secrets\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.120205 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.120108    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-registry-certificates\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.120205 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.120135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-bound-sa-token\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.120205 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.120193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-trusted-ca\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.120311 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.120254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-image-registry-private-configuration\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.120311 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.120273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1686006-e577-4a36-8d03-de6de7f4c297-ca-trust-extracted\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.120311 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.120292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm2gz\" (UniqueName: \"kubernetes.io/projected/74358fc4-0e9c-4f0f-b22d-c3552227e0c6-kube-api-access-fm2gz\") pod \"volume-data-source-validator-695c895bd6-mt2hr\" (UID: \"74358fc4-0e9c-4f0f-b22d-c3552227e0c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr"
Sep 08 14:34:56.120311 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.120310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b2e05c9-ce24-4ebc-90dc-365bddac7688-trusted-ca\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.120446 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.120362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b2e05c9-ce24-4ebc-90dc-365bddac7688-serving-cert\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.120446 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.120384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjp6b\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-kube-api-access-vjp6b\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.120446 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.120408    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.132763 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.132738    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-h95lg"]
Sep 08 14:34:56.139743 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.139719    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm2gz\" (UniqueName: \"kubernetes.io/projected/74358fc4-0e9c-4f0f-b22d-c3552227e0c6-kube-api-access-fm2gz\") pod \"volume-data-source-validator-695c895bd6-mt2hr\" (UID: \"74358fc4-0e9c-4f0f-b22d-c3552227e0c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr"
Sep 08 14:34:56.151624 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.151594    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-h95lg"]
Sep 08 14:34:56.151796 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.151693    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.154499 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.154476    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 08 14:34:56.155085 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.155032    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 14:34:56.155219 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.155090    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 08 14:34:56.155350 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.155332    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 14:34:56.155417 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.155357    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kgh2z\""
Sep 08 14:34:56.160515 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.160494    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 08 14:34:56.221583 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.221554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-registry-certificates\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.221750 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.221589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-bound-sa-token\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.221750 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.221608    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-trusted-ca\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.221878 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.221857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-image-registry-private-configuration\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.221938 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.221885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1686006-e577-4a36-8d03-de6de7f4c297-ca-trust-extracted\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.221938 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.221915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b2e05c9-ce24-4ebc-90dc-365bddac7688-trusted-ca\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.222035 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.221951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b2e05c9-ce24-4ebc-90dc-365bddac7688-serving-cert\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.222035 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.221967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjp6b\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-kube-api-access-vjp6b\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.222035 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.222002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.222353 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.222049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b2e05c9-ce24-4ebc-90dc-365bddac7688-config\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.222353 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.222074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dpmt\" (UniqueName: \"kubernetes.io/projected/9b2e05c9-ce24-4ebc-90dc-365bddac7688-kube-api-access-6dpmt\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.222353 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.222099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-installation-pull-secrets\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.222353 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:56.222338    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:34:56.222521 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:56.222357    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8476856557-wr4vm: secret "image-registry-tls" not found
Sep 08 14:34:56.222521 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:56.222429    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls podName:f1686006-e577-4a36-8d03-de6de7f4c297 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:56.72240874 +0000 UTC m=+40.732928731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls") pod "image-registry-8476856557-wr4vm" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297") : secret "image-registry-tls" not found
Sep 08 14:34:56.222521 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.222500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-registry-certificates\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.222678 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.222352    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1686006-e577-4a36-8d03-de6de7f4c297-ca-trust-extracted\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.223070 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.223034    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b2e05c9-ce24-4ebc-90dc-365bddac7688-config\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.223070 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.223054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b2e05c9-ce24-4ebc-90dc-365bddac7688-trusted-ca\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.223225 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.223097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-trusted-ca\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.224713 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.224685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b2e05c9-ce24-4ebc-90dc-365bddac7688-serving-cert\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.224825 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.224764    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-image-registry-private-configuration\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.225086 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.225066    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-installation-pull-secrets\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.229489 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.229442    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-bound-sa-token\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.230739 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.230712    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjp6b\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-kube-api-access-vjp6b\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.230850 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.230833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dpmt\" (UniqueName: \"kubernetes.io/projected/9b2e05c9-ce24-4ebc-90dc-365bddac7688-kube-api-access-6dpmt\") pod \"console-operator-85b454874b-4ccf5\" (UID: \"9b2e05c9-ce24-4ebc-90dc-365bddac7688\") " pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.251806 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.251777    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr"
Sep 08 14:34:56.322788 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.322750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mngm\" (UniqueName: \"kubernetes.io/projected/29018d4b-c9e9-403b-97d3-94b36bd94401-kube-api-access-6mngm\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.322788 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.322788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/29018d4b-c9e9-403b-97d3-94b36bd94401-snapshots\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.322998 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.322868    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29018d4b-c9e9-403b-97d3-94b36bd94401-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.322998 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.322934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29018d4b-c9e9-403b-97d3-94b36bd94401-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.322998 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.322985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29018d4b-c9e9-403b-97d3-94b36bd94401-serving-cert\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.323119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.323023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29018d4b-c9e9-403b-97d3-94b36bd94401-tmp\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.353583 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.353551    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:34:56.423418 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.423381    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29018d4b-c9e9-403b-97d3-94b36bd94401-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.423580 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.423428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29018d4b-c9e9-403b-97d3-94b36bd94401-serving-cert\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.423580 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.423460    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29018d4b-c9e9-403b-97d3-94b36bd94401-tmp\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.423580 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.423544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mngm\" (UniqueName: \"kubernetes.io/projected/29018d4b-c9e9-403b-97d3-94b36bd94401-kube-api-access-6mngm\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.423580 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.423575    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/29018d4b-c9e9-403b-97d3-94b36bd94401-snapshots\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.423721 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.423631    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29018d4b-c9e9-403b-97d3-94b36bd94401-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.424244 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.424190    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29018d4b-c9e9-403b-97d3-94b36bd94401-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.424244 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.424226    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29018d4b-c9e9-403b-97d3-94b36bd94401-tmp\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.424450 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.424249    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/29018d4b-c9e9-403b-97d3-94b36bd94401-snapshots\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.424514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.424496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29018d4b-c9e9-403b-97d3-94b36bd94401-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.427497 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.427476    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29018d4b-c9e9-403b-97d3-94b36bd94401-serving-cert\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.431716 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.431693    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mngm\" (UniqueName: \"kubernetes.io/projected/29018d4b-c9e9-403b-97d3-94b36bd94401-kube-api-access-6mngm\") pod \"insights-operator-76bcd6ccf5-h95lg\" (UID: \"29018d4b-c9e9-403b-97d3-94b36bd94401\") " pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.461724 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.461691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg"
Sep 08 14:34:56.549267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.549070    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr"]
Sep 08 14:34:56.554367 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:56.554329    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74358fc4_0e9c_4f0f_b22d_c3552227e0c6.slice/crio-bf2c6e5cbcde63caf07ba55caa236612d6a4d3287c6576b59f3f91ca4e67587e WatchSource:0}: Error finding container bf2c6e5cbcde63caf07ba55caa236612d6a4d3287c6576b59f3f91ca4e67587e: Status 404 returned error can't find the container with id bf2c6e5cbcde63caf07ba55caa236612d6a4d3287c6576b59f3f91ca4e67587e
Sep 08 14:34:56.669277 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.669216    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-4ccf5"]
Sep 08 14:34:56.672508 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:56.672479    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2e05c9_ce24_4ebc_90dc_365bddac7688.slice/crio-f97d69d0aa02c88b3250338e5e15e9e2bdefdf7ddb54d143a53a2c9564e159f2 WatchSource:0}: Error finding container f97d69d0aa02c88b3250338e5e15e9e2bdefdf7ddb54d143a53a2c9564e159f2: Status 404 returned error can't find the container with id f97d69d0aa02c88b3250338e5e15e9e2bdefdf7ddb54d143a53a2c9564e159f2
Sep 08 14:34:56.694338 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.694299    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" event={"ID":"9b2e05c9-ce24-4ebc-90dc-365bddac7688","Type":"ContainerStarted","Data":"f97d69d0aa02c88b3250338e5e15e9e2bdefdf7ddb54d143a53a2c9564e159f2"}
Sep 08 14:34:56.695431 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.695408    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr" event={"ID":"74358fc4-0e9c-4f0f-b22d-c3552227e0c6","Type":"ContainerStarted","Data":"bf2c6e5cbcde63caf07ba55caa236612d6a4d3287c6576b59f3f91ca4e67587e"}
Sep 08 14:34:56.726072 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.726040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:56.726242 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:56.726224    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:34:56.726285 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:56.726244    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8476856557-wr4vm: secret "image-registry-tls" not found
Sep 08 14:34:56.726322 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:56.726309    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls podName:f1686006-e577-4a36-8d03-de6de7f4c297 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:57.726284336 +0000 UTC m=+41.736804313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls") pod "image-registry-8476856557-wr4vm" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297") : secret "image-registry-tls" not found
Sep 08 14:34:56.763719 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:56.763640    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-h95lg"]
Sep 08 14:34:56.766764 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:34:56.766737    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29018d4b_c9e9_403b_97d3_94b36bd94401.slice/crio-e22d5fe058f8b6b745cd87b38402ddfb53dcf2b83fc6c1dff74b6740e9f03690 WatchSource:0}: Error finding container e22d5fe058f8b6b745cd87b38402ddfb53dcf2b83fc6c1dff74b6740e9f03690: Status 404 returned error can't find the container with id e22d5fe058f8b6b745cd87b38402ddfb53dcf2b83fc6c1dff74b6740e9f03690
Sep 08 14:34:57.700191 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:57.700138    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg" event={"ID":"29018d4b-c9e9-403b-97d3-94b36bd94401","Type":"ContainerStarted","Data":"e22d5fe058f8b6b745cd87b38402ddfb53dcf2b83fc6c1dff74b6740e9f03690"}
Sep 08 14:34:57.734750 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:57.734711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:57.734938 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:57.734891    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:34:57.734938 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:57.734907    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8476856557-wr4vm: secret "image-registry-tls" not found
Sep 08 14:34:57.735063 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:57.734961    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls podName:f1686006-e577-4a36-8d03-de6de7f4c297 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:59.734947413 +0000 UTC m=+43.745467408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls") pod "image-registry-8476856557-wr4vm" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297") : secret "image-registry-tls" not found
Sep 08 14:34:59.150832 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:59.150794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:34:59.151327 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:59.150911    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:59.151327 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:59.150965    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls podName:0ddd618f-e729-4985-b013-c6dbbb8931c2 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:07.150951628 +0000 UTC m=+51.161471605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls") pod "dns-default-szrgb" (UID: "0ddd618f-e729-4985-b013-c6dbbb8931c2") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:59.755604 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:34:59.755542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:34:59.755816 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:59.755712    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:34:59.755816 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:59.755732    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8476856557-wr4vm: secret "image-registry-tls" not found
Sep 08 14:34:59.755816 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:34:59.755816    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls podName:f1686006-e577-4a36-8d03-de6de7f4c297 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:03.755795664 +0000 UTC m=+47.766315664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls") pod "image-registry-8476856557-wr4vm" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297") : secret "image-registry-tls" not found
Sep 08 14:35:01.513340 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.513303    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kc8lh"]
Sep 08 14:35:01.535256 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.535213    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kc8lh"]
Sep 08 14:35:01.535416 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.535334    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.538307 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.538016    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 14:35:01.538307 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.538024    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 14:35:01.538307 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.538024    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7h2nw\""
Sep 08 14:35:01.673788 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.673750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/554fe1a1-4bed-43fc-839e-c60a6a0ef795-data-volume\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.673975 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.673804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.673975 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.673887    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/554fe1a1-4bed-43fc-839e-c60a6a0ef795-crio-socket\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.673975 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.673916    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.673975 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.673942    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rt79\" (UniqueName: \"kubernetes.io/projected/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-api-access-5rt79\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.712551 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.712522    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/0.log"
Sep 08 14:35:01.712681 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.712561    2561 generic.go:356] "Generic (PLEG): container finished" podID="9b2e05c9-ce24-4ebc-90dc-365bddac7688" containerID="a13d976ebcea79c8eaed0a0745a2bcc38c98782574f82fa6d2643acdefe35821" exitCode=255
Sep 08 14:35:01.712681 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.712635    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" event={"ID":"9b2e05c9-ce24-4ebc-90dc-365bddac7688","Type":"ContainerDied","Data":"a13d976ebcea79c8eaed0a0745a2bcc38c98782574f82fa6d2643acdefe35821"}
Sep 08 14:35:01.712847 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.712830    2561 scope.go:117] "RemoveContainer" containerID="a13d976ebcea79c8eaed0a0745a2bcc38c98782574f82fa6d2643acdefe35821"
Sep 08 14:35:01.714424 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.714394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr" event={"ID":"74358fc4-0e9c-4f0f-b22d-c3552227e0c6","Type":"ContainerStarted","Data":"e0cdc7c85bfccd53ece4630c15dec5035aa206c4673d7037ee529c839073aed5"}
Sep 08 14:35:01.716014 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.715990    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg" event={"ID":"29018d4b-c9e9-403b-97d3-94b36bd94401","Type":"ContainerStarted","Data":"ddbc07a2c19d4da7aded7054f197ef240cd180bd81b79ca25aa73ebaeafff61e"}
Sep 08 14:35:01.753805 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.753752    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg" podStartSLOduration=1.875305124 podStartE2EDuration="5.753734236s" totalImagesPullingTime="3.878429112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:01.752914675 +0000 UTC m=+45.763434673" watchObservedRunningTime="2026-09-08 14:35:01.753734236 +0000 UTC m=+45.764254234"
Sep 08 14:35:01.769320 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.769226    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-mt2hr" podStartSLOduration=2.680426645 podStartE2EDuration="6.769209567s" totalImagesPullingTime="4.088782922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:01.768606789 +0000 UTC m=+45.779126788" watchObservedRunningTime="2026-09-08 14:35:01.769209567 +0000 UTC m=+45.779729566"
Sep 08 14:35:01.774884 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.774857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/554fe1a1-4bed-43fc-839e-c60a6a0ef795-crio-socket\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.775042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.774889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.775042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.774906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rt79\" (UniqueName: \"kubernetes.io/projected/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-api-access-5rt79\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.775042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.774980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/554fe1a1-4bed-43fc-839e-c60a6a0ef795-data-volume\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.775042 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:01.774999    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:35:01.775042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.775011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.775314 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:01.775073    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:02.275052173 +0000 UTC m=+46.285572164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : configmap "kube-rbac-proxy" not found
Sep 08 14:35:01.775314 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:01.775106    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:01.775314 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.775113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/554fe1a1-4bed-43fc-839e-c60a6a0ef795-crio-socket\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.775314 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:01.775193    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:02.275177324 +0000 UTC m=+46.285697302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:01.775541 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.775387    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/554fe1a1-4bed-43fc-839e-c60a6a0ef795-data-volume\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:01.784622 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:01.784592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rt79\" (UniqueName: \"kubernetes.io/projected/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-api-access-5rt79\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:02.280042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:02.280002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:02.280275 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:02.280060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:02.280275 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:02.280134    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:35:02.280275 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:02.280185    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:02.280275 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:02.280206    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:03.2801919 +0000 UTC m=+47.290711877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : configmap "kube-rbac-proxy" not found
Sep 08 14:35:02.280275 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:02.280247    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:03.280234003 +0000 UTC m=+47.290753979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:02.719811 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:02.719784    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/1.log"
Sep 08 14:35:02.720271 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:02.720249    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/0.log"
Sep 08 14:35:02.720339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:02.720279    2561 generic.go:356] "Generic (PLEG): container finished" podID="9b2e05c9-ce24-4ebc-90dc-365bddac7688" containerID="fb3c269db862ab3c1930608909d759ae1085289cf238791cd149dbfe54d605e0" exitCode=255
Sep 08 14:35:02.720339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:02.720311    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" event={"ID":"9b2e05c9-ce24-4ebc-90dc-365bddac7688","Type":"ContainerDied","Data":"fb3c269db862ab3c1930608909d759ae1085289cf238791cd149dbfe54d605e0"}
Sep 08 14:35:02.720420 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:02.720375    2561 scope.go:117] "RemoveContainer" containerID="a13d976ebcea79c8eaed0a0745a2bcc38c98782574f82fa6d2643acdefe35821"
Sep 08 14:35:02.720581 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:02.720556    2561 scope.go:117] "RemoveContainer" containerID="fb3c269db862ab3c1930608909d759ae1085289cf238791cd149dbfe54d605e0"
Sep 08 14:35:02.720818 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:02.720753    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-4ccf5_openshift-console-operator(9b2e05c9-ce24-4ebc-90dc-365bddac7688)\"" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" podUID="9b2e05c9-ce24-4ebc-90dc-365bddac7688"
Sep 08 14:35:03.245034 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:03.245005    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h672j_63d7944c-15c0-4ff2-ac22-6cf9afdae1d2/dns-node-resolver/0.log"
Sep 08 14:35:03.288420 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:03.288378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:03.288586 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:03.288433    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:03.288586 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:03.288514    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:35:03.288586 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:03.288534    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:03.288586 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:03.288577    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:05.28856218 +0000 UTC m=+49.299082160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : configmap "kube-rbac-proxy" not found
Sep 08 14:35:03.288713 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:03.288591    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:05.288585571 +0000 UTC m=+49.299105548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:03.724812 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:03.724783    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/1.log"
Sep 08 14:35:03.725195 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:03.725107    2561 scope.go:117] "RemoveContainer" containerID="fb3c269db862ab3c1930608909d759ae1085289cf238791cd149dbfe54d605e0"
Sep 08 14:35:03.725327 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:03.725306    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-4ccf5_openshift-console-operator(9b2e05c9-ce24-4ebc-90dc-365bddac7688)\"" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" podUID="9b2e05c9-ce24-4ebc-90dc-365bddac7688"
Sep 08 14:35:03.791491 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:03.791445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:35:03.791669 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:03.791599    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:35:03.791669 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:03.791616    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8476856557-wr4vm: secret "image-registry-tls" not found
Sep 08 14:35:03.791762 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:03.791673    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls podName:f1686006-e577-4a36-8d03-de6de7f4c297 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:11.791656454 +0000 UTC m=+55.802176434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls") pod "image-registry-8476856557-wr4vm" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297") : secret "image-registry-tls" not found
Sep 08 14:35:04.001699 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.001605    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-57sx9"]
Sep 08 14:35:04.034584 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.034550    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-57sx9"]
Sep 08 14:35:04.034752 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.034671    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.043351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.043320    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 08 14:35:04.043467 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.043370    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 08 14:35:04.043467 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.043450    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rbxw5\""
Sep 08 14:35:04.043853 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.043835    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 08 14:35:04.044667 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.044646    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 08 14:35:04.194033 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.193985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d5dbc02d-61c5-46ab-be05-53701091a7bb-signing-key\") pod \"service-ca-75d99c484-57sx9\" (UID: \"d5dbc02d-61c5-46ab-be05-53701091a7bb\") " pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.194207 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.194058    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngps5\" (UniqueName: \"kubernetes.io/projected/d5dbc02d-61c5-46ab-be05-53701091a7bb-kube-api-access-ngps5\") pod \"service-ca-75d99c484-57sx9\" (UID: \"d5dbc02d-61c5-46ab-be05-53701091a7bb\") " pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.194266 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.194222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d5dbc02d-61c5-46ab-be05-53701091a7bb-signing-cabundle\") pod \"service-ca-75d99c484-57sx9\" (UID: \"d5dbc02d-61c5-46ab-be05-53701091a7bb\") " pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.246026 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.245999    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bx5tq_06012240-3a1e-44ac-baf8-4648f6b640cf/node-ca/0.log"
Sep 08 14:35:04.295561 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.295474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d5dbc02d-61c5-46ab-be05-53701091a7bb-signing-cabundle\") pod \"service-ca-75d99c484-57sx9\" (UID: \"d5dbc02d-61c5-46ab-be05-53701091a7bb\") " pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.295561 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.295544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d5dbc02d-61c5-46ab-be05-53701091a7bb-signing-key\") pod \"service-ca-75d99c484-57sx9\" (UID: \"d5dbc02d-61c5-46ab-be05-53701091a7bb\") " pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.295734 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.295600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngps5\" (UniqueName: \"kubernetes.io/projected/d5dbc02d-61c5-46ab-be05-53701091a7bb-kube-api-access-ngps5\") pod \"service-ca-75d99c484-57sx9\" (UID: \"d5dbc02d-61c5-46ab-be05-53701091a7bb\") " pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.296271 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.296239    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d5dbc02d-61c5-46ab-be05-53701091a7bb-signing-cabundle\") pod \"service-ca-75d99c484-57sx9\" (UID: \"d5dbc02d-61c5-46ab-be05-53701091a7bb\") " pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.298128 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.298099    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d5dbc02d-61c5-46ab-be05-53701091a7bb-signing-key\") pod \"service-ca-75d99c484-57sx9\" (UID: \"d5dbc02d-61c5-46ab-be05-53701091a7bb\") " pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.307038 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.307010    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngps5\" (UniqueName: \"kubernetes.io/projected/d5dbc02d-61c5-46ab-be05-53701091a7bb-kube-api-access-ngps5\") pod \"service-ca-75d99c484-57sx9\" (UID: \"d5dbc02d-61c5-46ab-be05-53701091a7bb\") " pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.343079 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.343028    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-57sx9"
Sep 08 14:35:04.637527 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.637438    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-57sx9"]
Sep 08 14:35:04.640642 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:04.640615    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5dbc02d_61c5_46ab_be05_53701091a7bb.slice/crio-e88a68b1f525e8d5d0711e6d8486f4f4515691868da532118ccbf7634e49b2e0 WatchSource:0}: Error finding container e88a68b1f525e8d5d0711e6d8486f4f4515691868da532118ccbf7634e49b2e0: Status 404 returned error can't find the container with id e88a68b1f525e8d5d0711e6d8486f4f4515691868da532118ccbf7634e49b2e0
Sep 08 14:35:04.728578 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:04.728546    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-57sx9" event={"ID":"d5dbc02d-61c5-46ab-be05-53701091a7bb","Type":"ContainerStarted","Data":"e88a68b1f525e8d5d0711e6d8486f4f4515691868da532118ccbf7634e49b2e0"}
Sep 08 14:35:05.305599 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:05.305558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:05.305790 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:05.305621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:05.305790 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:05.305740    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:35:05.305790 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:05.305740    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:05.305965 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:05.305816    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:09.305796212 +0000 UTC m=+53.316316206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : configmap "kube-rbac-proxy" not found
Sep 08 14:35:05.305965 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:05.305836    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:09.305826286 +0000 UTC m=+53.316346263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:05.448486 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:05.448446    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w6pcq_2546d478-fdbf-4358-bd11-a3b07cef8fb4/serve-healthcheck-canary/0.log"
Sep 08 14:35:06.354264 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:06.354225    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:35:06.354743 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:06.354298    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:35:06.354814 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:06.354748    2561 scope.go:117] "RemoveContainer" containerID="fb3c269db862ab3c1930608909d759ae1085289cf238791cd149dbfe54d605e0"
Sep 08 14:35:06.354972 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:06.354948    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-4ccf5_openshift-console-operator(9b2e05c9-ce24-4ebc-90dc-365bddac7688)\"" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" podUID="9b2e05c9-ce24-4ebc-90dc-365bddac7688"
Sep 08 14:35:07.221246 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:07.221205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:35:07.221440 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:07.221344    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:35:07.221440 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:07.221409    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls podName:0ddd618f-e729-4985-b013-c6dbbb8931c2 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:23.221391561 +0000 UTC m=+67.231911544 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls") pod "dns-default-szrgb" (UID: "0ddd618f-e729-4985-b013-c6dbbb8931c2") : secret "dns-default-metrics-tls" not found
Sep 08 14:35:07.739557 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:07.739513    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-57sx9" event={"ID":"d5dbc02d-61c5-46ab-be05-53701091a7bb","Type":"ContainerStarted","Data":"2b596812c2520321ac96d193d0047ae45c05182043c1731625fc584dd1fdcb0f"}
Sep 08 14:35:09.336461 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:09.336416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:09.336921 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:09.336477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:09.336921 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:09.336572    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:35:09.336921 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:09.336571    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:09.336921 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:09.336642    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:17.336625819 +0000 UTC m=+61.347145795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : configmap "kube-rbac-proxy" not found
Sep 08 14:35:09.336921 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:09.336662    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:17.336652092 +0000 UTC m=+61.347172069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:11.860539 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:11.860502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:35:11.863119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:11.863083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls\") pod \"image-registry-8476856557-wr4vm\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") " pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:35:11.886251 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:11.886209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:35:12.162941 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:12.162835    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-57sx9" podStartSLOduration=6.993465419 podStartE2EDuration="9.162810005s" totalImagesPullingTime="2.169344586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:07.766448814 +0000 UTC m=+51.776968813" watchObservedRunningTime="2026-09-08 14:35:12.162810005 +0000 UTC m=+56.173330007"
Sep 08 14:35:12.163610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:12.163590    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8476856557-wr4vm"]
Sep 08 14:35:12.166885 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:12.166858    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1686006_e577_4a36_8d03_de6de7f4c297.slice/crio-16e6d53de5c77625deba5f213052dd58dc643d1b7fb5619b97ea7f79b5ec89c7 WatchSource:0}: Error finding container 16e6d53de5c77625deba5f213052dd58dc643d1b7fb5619b97ea7f79b5ec89c7: Status 404 returned error can't find the container with id 16e6d53de5c77625deba5f213052dd58dc643d1b7fb5619b97ea7f79b5ec89c7
Sep 08 14:35:12.755650 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:12.755612    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8476856557-wr4vm" event={"ID":"f1686006-e577-4a36-8d03-de6de7f4c297","Type":"ContainerStarted","Data":"5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32"}
Sep 08 14:35:12.755870 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:12.755674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8476856557-wr4vm" event={"ID":"f1686006-e577-4a36-8d03-de6de7f4c297","Type":"ContainerStarted","Data":"16e6d53de5c77625deba5f213052dd58dc643d1b7fb5619b97ea7f79b5ec89c7"}
Sep 08 14:35:12.755870 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:12.755712    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:35:17.408054 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.408005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:17.408054 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.408068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:17.408504 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:17.408184    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:17.408504 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:17.408254    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls podName:554fe1a1-4bed-43fc-839e-c60a6a0ef795 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:33.408237851 +0000 UTC m=+77.418757827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kc8lh" (UID: "554fe1a1-4bed-43fc-839e-c60a6a0ef795") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:17.408638 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.408621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/554fe1a1-4bed-43fc-839e-c60a6a0ef795-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:17.514955 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.514921    2561 scope.go:117] "RemoveContainer" containerID="fb3c269db862ab3c1930608909d759ae1085289cf238791cd149dbfe54d605e0"
Sep 08 14:35:17.668619 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.668544    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nkmmk"
Sep 08 14:35:17.704118 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.704052    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8476856557-wr4vm" podStartSLOduration=22.704036407 podStartE2EDuration="22.704036407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:12.78018676 +0000 UTC m=+56.790706762" watchObservedRunningTime="2026-09-08 14:35:17.704036407 +0000 UTC m=+61.714556403"
Sep 08 14:35:17.773368 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.773339    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:35:17.773780 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.773761    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/1.log"
Sep 08 14:35:17.773890 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.773800    2561 generic.go:356] "Generic (PLEG): container finished" podID="9b2e05c9-ce24-4ebc-90dc-365bddac7688" containerID="8088e9a78eb9f50e519251c2a42058a7243c960aee8083d0feb650772794fa08" exitCode=255
Sep 08 14:35:17.773890 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.773839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" event={"ID":"9b2e05c9-ce24-4ebc-90dc-365bddac7688","Type":"ContainerDied","Data":"8088e9a78eb9f50e519251c2a42058a7243c960aee8083d0feb650772794fa08"}
Sep 08 14:35:17.773990 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.773898    2561 scope.go:117] "RemoveContainer" containerID="fb3c269db862ab3c1930608909d759ae1085289cf238791cd149dbfe54d605e0"
Sep 08 14:35:17.774216 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:17.774198    2561 scope.go:117] "RemoveContainer" containerID="8088e9a78eb9f50e519251c2a42058a7243c960aee8083d0feb650772794fa08"
Sep 08 14:35:17.774393 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:17.774374    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-4ccf5_openshift-console-operator(9b2e05c9-ce24-4ebc-90dc-365bddac7688)\"" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" podUID="9b2e05c9-ce24-4ebc-90dc-365bddac7688"
Sep 08 14:35:18.778211 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:18.778184    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:35:22.245019 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.244980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:35:22.245019 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.245016    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:35:22.247697 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.247678    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 14:35:22.247784 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.247678    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 14:35:22.258058 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.258028    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3334c9c-8df4-4eef-a4e5-dfb55276c3f1-original-pull-secret\") pod \"global-pull-secret-syncer-shnpn\" (UID: \"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1\") " pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:35:22.258188 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.258062    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc907ff2-af58-4c71-9031-fddfbd162573-metrics-certs\") pod \"network-metrics-daemon-qzw9s\" (UID: \"fc907ff2-af58-4c71-9031-fddfbd162573\") " pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:35:22.346272 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.346234    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwl9n\" (UniqueName: \"kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n\") pod \"network-check-target-zvdsw\" (UID: \"691234af-48f7-41c2-abf9-27428e7250c4\") " pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:35:22.348398 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.348377    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 14:35:22.359271 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.359250    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 14:35:22.370442 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.370411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwl9n\" (UniqueName: \"kubernetes.io/projected/691234af-48f7-41c2-abf9-27428e7250c4-kube-api-access-pwl9n\") pod \"network-check-target-zvdsw\" (UID: \"691234af-48f7-41c2-abf9-27428e7250c4\") " pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:35:22.429793 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.429764    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nvk2x\""
Sep 08 14:35:22.435664 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.435639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-shnpn"
Sep 08 14:35:22.437777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.437758    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:35:22.442199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.442179    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42kmv\""
Sep 08 14:35:22.450267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.450250    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzw9s"
Sep 08 14:35:22.729061 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.728941    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-shnpn"]
Sep 08 14:35:22.731459 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:22.731428    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3334c9c_8df4_4eef_a4e5_dfb55276c3f1.slice/crio-f7ea1af99af268cdabaf49b7217d5d09082f49288dfc44b3e1e0fb122cee2e2b WatchSource:0}: Error finding container f7ea1af99af268cdabaf49b7217d5d09082f49288dfc44b3e1e0fb122cee2e2b: Status 404 returned error can't find the container with id f7ea1af99af268cdabaf49b7217d5d09082f49288dfc44b3e1e0fb122cee2e2b
Sep 08 14:35:22.774609 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.774504    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zvdsw"]
Sep 08 14:35:22.778779 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:22.778744    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691234af_48f7_41c2_abf9_27428e7250c4.slice/crio-0f3e69526e37d49be89e107e81bcbfe5dce506be686cc76a4d5985cb77066870 WatchSource:0}: Error finding container 0f3e69526e37d49be89e107e81bcbfe5dce506be686cc76a4d5985cb77066870: Status 404 returned error can't find the container with id 0f3e69526e37d49be89e107e81bcbfe5dce506be686cc76a4d5985cb77066870
Sep 08 14:35:22.792013 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.791979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-shnpn" event={"ID":"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1","Type":"ContainerStarted","Data":"f7ea1af99af268cdabaf49b7217d5d09082f49288dfc44b3e1e0fb122cee2e2b"}
Sep 08 14:35:22.793082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.793061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zvdsw" event={"ID":"691234af-48f7-41c2-abf9-27428e7250c4","Type":"ContainerStarted","Data":"0f3e69526e37d49be89e107e81bcbfe5dce506be686cc76a4d5985cb77066870"}
Sep 08 14:35:22.797893 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:22.797873    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qzw9s"]
Sep 08 14:35:22.800616 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:22.800595    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc907ff2_af58_4c71_9031_fddfbd162573.slice/crio-e9cfe08586f179746a7264e17538f029a7cf698a82196e5a71d94eef3ec38da7 WatchSource:0}: Error finding container e9cfe08586f179746a7264e17538f029a7cf698a82196e5a71d94eef3ec38da7: Status 404 returned error can't find the container with id e9cfe08586f179746a7264e17538f029a7cf698a82196e5a71d94eef3ec38da7
Sep 08 14:35:23.254106 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:23.254068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:35:23.256832 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:23.256802    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd618f-e729-4985-b013-c6dbbb8931c2-metrics-tls\") pod \"dns-default-szrgb\" (UID: \"0ddd618f-e729-4985-b013-c6dbbb8931c2\") " pod="openshift-dns/dns-default-szrgb"
Sep 08 14:35:23.449252 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:23.449220    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rsnws\""
Sep 08 14:35:23.456991 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:23.456935    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-szrgb"
Sep 08 14:35:23.755450 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:23.755368    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-szrgb"]
Sep 08 14:35:23.799241 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:23.799139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qzw9s" event={"ID":"fc907ff2-af58-4c71-9031-fddfbd162573","Type":"ContainerStarted","Data":"e9cfe08586f179746a7264e17538f029a7cf698a82196e5a71d94eef3ec38da7"}
Sep 08 14:35:23.802110 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:23.802039    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-szrgb" event={"ID":"0ddd618f-e729-4985-b013-c6dbbb8931c2","Type":"ContainerStarted","Data":"35cf3cced32cecce86bd5c490743229db488329a3c834c7df50c7afd4a1113d0"}
Sep 08 14:35:24.809080 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:24.809029    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qzw9s" event={"ID":"fc907ff2-af58-4c71-9031-fddfbd162573","Type":"ContainerStarted","Data":"782d992b03471c8c9872122239c0624991931f8057fba97ca9a5c6c706e7f852"}
Sep 08 14:35:24.809604 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:24.809111    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qzw9s" event={"ID":"fc907ff2-af58-4c71-9031-fddfbd162573","Type":"ContainerStarted","Data":"a3a3864e28e6045263f6c6e924ba52b7813af52ea19963a44a32212489932ed9"}
Sep 08 14:35:24.827188 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:24.826930    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qzw9s" podStartSLOduration=66.203882531 podStartE2EDuration="1m7.826910667s" totalImagesPullingTime="1.623028136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:24.825656206 +0000 UTC m=+68.836176205" watchObservedRunningTime="2026-09-08 14:35:24.826910667 +0000 UTC m=+68.837430670"
Sep 08 14:35:25.310403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.310366    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"]
Sep 08 14:35:25.314669 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.314312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.314669 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.314655    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8476856557-wr4vm"]
Sep 08 14:35:25.321514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.321132    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 14:35:25.321514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.321284    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 08 14:35:25.321514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.321376    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 14:35:25.326991 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.324946    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 14:35:25.353020 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.352985    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"]
Sep 08 14:35:25.372306 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.372269    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f5f49de3-b719-4c0f-9e99-dc2189d69b8f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c7d78d6cc-gfkhb\" (UID: \"f5f49de3-b719-4c0f-9e99-dc2189d69b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.372481 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.372328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5f49de3-b719-4c0f-9e99-dc2189d69b8f-tmp\") pod \"klusterlet-addon-workmgr-6c7d78d6cc-gfkhb\" (UID: \"f5f49de3-b719-4c0f-9e99-dc2189d69b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.372481 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.372444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjqzg\" (UniqueName: \"kubernetes.io/projected/f5f49de3-b719-4c0f-9e99-dc2189d69b8f-kube-api-access-cjqzg\") pod \"klusterlet-addon-workmgr-6c7d78d6cc-gfkhb\" (UID: \"f5f49de3-b719-4c0f-9e99-dc2189d69b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.428733 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.428695    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-856cfd6cc-tvg9t"]
Sep 08 14:35:25.432002 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.431975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.458919 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.458888    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-856cfd6cc-tvg9t"]
Sep 08 14:35:25.473908 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.473874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqzg\" (UniqueName: \"kubernetes.io/projected/f5f49de3-b719-4c0f-9e99-dc2189d69b8f-kube-api-access-cjqzg\") pod \"klusterlet-addon-workmgr-6c7d78d6cc-gfkhb\" (UID: \"f5f49de3-b719-4c0f-9e99-dc2189d69b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.474119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.473924    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e313ff21-c430-4647-9bfd-221ece98c548-image-registry-private-configuration\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.474119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.473979    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e313ff21-c430-4647-9bfd-221ece98c548-ca-trust-extracted\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.474119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.473999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e313ff21-c430-4647-9bfd-221ece98c548-trusted-ca\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.474119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.474049    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e313ff21-c430-4647-9bfd-221ece98c548-registry-certificates\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.474119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.474085    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e313ff21-c430-4647-9bfd-221ece98c548-bound-sa-token\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.474119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.474119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f5f49de3-b719-4c0f-9e99-dc2189d69b8f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c7d78d6cc-gfkhb\" (UID: \"f5f49de3-b719-4c0f-9e99-dc2189d69b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.474453 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.474140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgnj9\" (UniqueName: \"kubernetes.io/projected/e313ff21-c430-4647-9bfd-221ece98c548-kube-api-access-cgnj9\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.474453 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.474205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5f49de3-b719-4c0f-9e99-dc2189d69b8f-tmp\") pod \"klusterlet-addon-workmgr-6c7d78d6cc-gfkhb\" (UID: \"f5f49de3-b719-4c0f-9e99-dc2189d69b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.474453 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.474222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e313ff21-c430-4647-9bfd-221ece98c548-installation-pull-secrets\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.474453 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.474268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e313ff21-c430-4647-9bfd-221ece98c548-registry-tls\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.474692 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.474674    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5f49de3-b719-4c0f-9e99-dc2189d69b8f-tmp\") pod \"klusterlet-addon-workmgr-6c7d78d6cc-gfkhb\" (UID: \"f5f49de3-b719-4c0f-9e99-dc2189d69b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.477652 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.477626    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f5f49de3-b719-4c0f-9e99-dc2189d69b8f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c7d78d6cc-gfkhb\" (UID: \"f5f49de3-b719-4c0f-9e99-dc2189d69b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.483466 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.483433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjqzg\" (UniqueName: \"kubernetes.io/projected/f5f49de3-b719-4c0f-9e99-dc2189d69b8f-kube-api-access-cjqzg\") pod \"klusterlet-addon-workmgr-6c7d78d6cc-gfkhb\" (UID: \"f5f49de3-b719-4c0f-9e99-dc2189d69b8f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.575405 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.575327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e313ff21-c430-4647-9bfd-221ece98c548-bound-sa-token\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.575405 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.575375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgnj9\" (UniqueName: \"kubernetes.io/projected/e313ff21-c430-4647-9bfd-221ece98c548-kube-api-access-cgnj9\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.575405 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.575395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e313ff21-c430-4647-9bfd-221ece98c548-installation-pull-secrets\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.575651 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.575427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e313ff21-c430-4647-9bfd-221ece98c548-registry-tls\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.575651 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.575457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e313ff21-c430-4647-9bfd-221ece98c548-image-registry-private-configuration\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.575651 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.575475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e313ff21-c430-4647-9bfd-221ece98c548-ca-trust-extracted\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.575651 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.575490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e313ff21-c430-4647-9bfd-221ece98c548-trusted-ca\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.575651 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.575514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e313ff21-c430-4647-9bfd-221ece98c548-registry-certificates\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.576556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.576526    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e313ff21-c430-4647-9bfd-221ece98c548-registry-certificates\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.577053 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.577014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e313ff21-c430-4647-9bfd-221ece98c548-ca-trust-extracted\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.577650 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.577623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e313ff21-c430-4647-9bfd-221ece98c548-trusted-ca\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.579257 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.579235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e313ff21-c430-4647-9bfd-221ece98c548-registry-tls\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.579383 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.579348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e313ff21-c430-4647-9bfd-221ece98c548-image-registry-private-configuration\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.579954 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.579932    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e313ff21-c430-4647-9bfd-221ece98c548-installation-pull-secrets\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.587541 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.587246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgnj9\" (UniqueName: \"kubernetes.io/projected/e313ff21-c430-4647-9bfd-221ece98c548-kube-api-access-cgnj9\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.587541 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.587534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e313ff21-c430-4647-9bfd-221ece98c548-bound-sa-token\") pod \"image-registry-856cfd6cc-tvg9t\" (UID: \"e313ff21-c430-4647-9bfd-221ece98c548\") " pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:25.628577 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.628540    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:25.743988 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:25.743950    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:26.354648 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:26.354611    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:35:26.355044 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:26.354678    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:35:26.355085 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:26.355068    2561 scope.go:117] "RemoveContainer" containerID="8088e9a78eb9f50e519251c2a42058a7243c960aee8083d0feb650772794fa08"
Sep 08 14:35:26.355291 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:26.355269    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-4ccf5_openshift-console-operator(9b2e05c9-ce24-4ebc-90dc-365bddac7688)\"" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" podUID="9b2e05c9-ce24-4ebc-90dc-365bddac7688"
Sep 08 14:35:28.696940 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.696914    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"]
Sep 08 14:35:28.699620 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:28.699584    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f49de3_b719_4c0f_9e99_dc2189d69b8f.slice/crio-8dbbc65ec13dcede0144cf6362af0bfb61dd4ce4820eff77984806187b934bae WatchSource:0}: Error finding container 8dbbc65ec13dcede0144cf6362af0bfb61dd4ce4820eff77984806187b934bae: Status 404 returned error can't find the container with id 8dbbc65ec13dcede0144cf6362af0bfb61dd4ce4820eff77984806187b934bae
Sep 08 14:35:28.700530 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.700476    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-856cfd6cc-tvg9t"]
Sep 08 14:35:28.704756 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:28.704726    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode313ff21_c430_4647_9bfd_221ece98c548.slice/crio-32cb50bc2eeb13cf7b9733ff7328618a65bbbee7a0e8ffaaf9f06a8289257962 WatchSource:0}: Error finding container 32cb50bc2eeb13cf7b9733ff7328618a65bbbee7a0e8ffaaf9f06a8289257962: Status 404 returned error can't find the container with id 32cb50bc2eeb13cf7b9733ff7328618a65bbbee7a0e8ffaaf9f06a8289257962
Sep 08 14:35:28.825709 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.825664    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zvdsw" event={"ID":"691234af-48f7-41c2-abf9-27428e7250c4","Type":"ContainerStarted","Data":"f7371485abf482df570cf9a6a7a1db14249e563bb0fe63d43d305db0712c82d9"}
Sep 08 14:35:28.825882 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.825777    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:35:28.827459 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.827427    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t" event={"ID":"e313ff21-c430-4647-9bfd-221ece98c548","Type":"ContainerStarted","Data":"1b13ed5f592bc7b3434239b8fb33e76b1c9e70d9b3ab40ee438e7565652f7c0e"}
Sep 08 14:35:28.827579 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.827474    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t" event={"ID":"e313ff21-c430-4647-9bfd-221ece98c548","Type":"ContainerStarted","Data":"32cb50bc2eeb13cf7b9733ff7328618a65bbbee7a0e8ffaaf9f06a8289257962"}
Sep 08 14:35:28.827579 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.827568    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:28.829111 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.829089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-shnpn" event={"ID":"c3334c9c-8df4-4eef-a4e5-dfb55276c3f1","Type":"ContainerStarted","Data":"24bf3fe8ccaf2be80178916814d89fabea16852947cf86f5ebd507f3ae0c3021"}
Sep 08 14:35:28.830371 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.830348    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb" event={"ID":"f5f49de3-b719-4c0f-9e99-dc2189d69b8f","Type":"ContainerStarted","Data":"8dbbc65ec13dcede0144cf6362af0bfb61dd4ce4820eff77984806187b934bae"}
Sep 08 14:35:28.835161 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.835130    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-szrgb" event={"ID":"0ddd618f-e729-4985-b013-c6dbbb8931c2","Type":"ContainerStarted","Data":"9bbd3b0c5d5353ae81b3358dd841e36ab06418ba920e556822cab0f1dc6e6c5e"}
Sep 08 14:35:28.835248 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.835186    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-szrgb" event={"ID":"0ddd618f-e729-4985-b013-c6dbbb8931c2","Type":"ContainerStarted","Data":"ac787bc78580c9af0c8740e4a795d76eb7439dce4c6627acaf0c45e90873ff12"}
Sep 08 14:35:28.835312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.835300    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-szrgb"
Sep 08 14:35:28.845449 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.845401    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zvdsw" podStartSLOduration=66.219986078 podStartE2EDuration="1m11.845389969s" totalImagesPullingTime="5.625403891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:28.844305124 +0000 UTC m=+72.854825123" watchObservedRunningTime="2026-09-08 14:35:28.845389969 +0000 UTC m=+72.855909969"
Sep 08 14:35:28.866658 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.866616    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-shnpn" podStartSLOduration=66.193223828 podStartE2EDuration="1m11.86660356s" totalImagesPullingTime="5.673379732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:28.864866155 +0000 UTC m=+72.875386146" watchObservedRunningTime="2026-09-08 14:35:28.86660356 +0000 UTC m=+72.877123558"
Sep 08 14:35:28.887773 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.887681    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-szrgb" podStartSLOduration=33.237714749 podStartE2EDuration="37.88766469s" totalImagesPullingTime="4.649949941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:28.887440199 +0000 UTC m=+72.897960201" watchObservedRunningTime="2026-09-08 14:35:28.88766469 +0000 UTC m=+72.898184708"
Sep 08 14:35:28.908849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:28.908792    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t" podStartSLOduration=3.908770708 podStartE2EDuration="3.908770708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:28.908723375 +0000 UTC m=+72.919243387" watchObservedRunningTime="2026-09-08 14:35:28.908770708 +0000 UTC m=+72.919290708"
Sep 08 14:35:33.324734 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.324699    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-b75h5"]
Sep 08 14:35:33.328390 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.328373    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.330814 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.330783    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 14:35:33.330814 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.330785    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 14:35:33.331089 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.331069    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 14:35:33.331236 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.331222    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 14:35:33.331337 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.331313    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lkf57\""
Sep 08 14:35:33.331545 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.331533    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 14:35:33.343038 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.343011    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-b75h5"]
Sep 08 14:35:33.441816 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.441782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:33.441816 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.441832    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.442088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.441851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.442088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.441887    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgm2\" (UniqueName: \"kubernetes.io/projected/bb48f451-4152-4b4b-adac-535b9f3db19f-kube-api-access-zrgm2\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.442088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.441973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb48f451-4152-4b4b-adac-535b9f3db19f-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.444289 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.444260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/554fe1a1-4bed-43fc-839e-c60a6a0ef795-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kc8lh\" (UID: \"554fe1a1-4bed-43fc-839e-c60a6a0ef795\") " pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:33.543211 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.543175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.543211 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.543210    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.543472 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.543245    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgm2\" (UniqueName: \"kubernetes.io/projected/bb48f451-4152-4b4b-adac-535b9f3db19f-kube-api-access-zrgm2\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.543472 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.543276    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb48f451-4152-4b4b-adac-535b9f3db19f-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.543472 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:33.543352    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 08 14:35:33.543472 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:33.543433    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-tls podName:bb48f451-4152-4b4b-adac-535b9f3db19f nodeName:}" failed. No retries permitted until 2026-09-08 14:35:34.04341224 +0000 UTC m=+78.053932242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-b75h5" (UID: "bb48f451-4152-4b4b-adac-535b9f3db19f") : secret "prometheus-operator-tls" not found
Sep 08 14:35:33.543883 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.543859    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb48f451-4152-4b4b-adac-535b9f3db19f-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.545959 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.545934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.554301 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.554277    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgm2\" (UniqueName: \"kubernetes.io/projected/bb48f451-4152-4b4b-adac-535b9f3db19f-kube-api-access-zrgm2\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:33.647669 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.647586    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7h2nw\""
Sep 08 14:35:33.655585 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.655564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kc8lh"
Sep 08 14:35:33.929078 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:33.928924    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kc8lh"]
Sep 08 14:35:33.931662 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:33.931633    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554fe1a1_4bed_43fc_839e_c60a6a0ef795.slice/crio-d9c38063a8c0d75cb102b0c93baad8276ede282f0254d410aa6012e16821080c WatchSource:0}: Error finding container d9c38063a8c0d75cb102b0c93baad8276ede282f0254d410aa6012e16821080c: Status 404 returned error can't find the container with id d9c38063a8c0d75cb102b0c93baad8276ede282f0254d410aa6012e16821080c
Sep 08 14:35:34.048139 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:34.048086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:34.048331 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:34.048249    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 08 14:35:34.048384 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:34.048329    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-tls podName:bb48f451-4152-4b4b-adac-535b9f3db19f nodeName:}" failed. No retries permitted until 2026-09-08 14:35:35.048314578 +0000 UTC m=+79.058834560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-b75h5" (UID: "bb48f451-4152-4b4b-adac-535b9f3db19f") : secret "prometheus-operator-tls" not found
Sep 08 14:35:34.858219 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:34.858175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kc8lh" event={"ID":"554fe1a1-4bed-43fc-839e-c60a6a0ef795","Type":"ContainerStarted","Data":"583bc9dba901bde75a4da31185090a40cf4c9ac834fdb51b772198fc1db18caa"}
Sep 08 14:35:34.858564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:34.858242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kc8lh" event={"ID":"554fe1a1-4bed-43fc-839e-c60a6a0ef795","Type":"ContainerStarted","Data":"244ea370bb04a39df082cf4a6562dda5f61c0608eeef82cf3ebc3a520b10ea97"}
Sep 08 14:35:34.858564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:34.858261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kc8lh" event={"ID":"554fe1a1-4bed-43fc-839e-c60a6a0ef795","Type":"ContainerStarted","Data":"d9c38063a8c0d75cb102b0c93baad8276ede282f0254d410aa6012e16821080c"}
Sep 08 14:35:35.054721 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:35.054542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:35.057794 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:35.057737    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb48f451-4152-4b4b-adac-535b9f3db19f-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-b75h5\" (UID: \"bb48f451-4152-4b4b-adac-535b9f3db19f\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:35.139976 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:35.139877    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5"
Sep 08 14:35:35.324457 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:35.324371    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:35:35.436649 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:35.436581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-b75h5"]
Sep 08 14:35:35.864944 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:35.864898    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5" event={"ID":"bb48f451-4152-4b4b-adac-535b9f3db19f","Type":"ContainerStarted","Data":"23a3fb87a5f5374c36972d7d4469fe1385d5016b0fba8e437af7b606015d991a"}
Sep 08 14:35:38.840565 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:38.840478    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-szrgb"
Sep 08 14:35:38.880050 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:38.878851    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb" event={"ID":"f5f49de3-b719-4c0f-9e99-dc2189d69b8f","Type":"ContainerStarted","Data":"f9b7ab682a8c5952a0b60e33f69bfe11f03b1a2bfb31c40f4ad448bd91f84e14"}
Sep 08 14:35:38.880050 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:38.879977    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:38.883458 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:38.883430    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb"
Sep 08 14:35:38.884940 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:38.884871    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kc8lh" event={"ID":"554fe1a1-4bed-43fc-839e-c60a6a0ef795","Type":"ContainerStarted","Data":"a215a1bb753b21c325d77e5b328bfcc4e983d5577ec88ed7080accb64732ea12"}
Sep 08 14:35:38.887760 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:38.887693    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5" event={"ID":"bb48f451-4152-4b4b-adac-535b9f3db19f","Type":"ContainerStarted","Data":"d345a579887aef35f9d60597a08c37e625876680e22c671e6f90b17f963ed216"}
Sep 08 14:35:38.888014 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:38.887954    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5" event={"ID":"bb48f451-4152-4b4b-adac-535b9f3db19f","Type":"ContainerStarted","Data":"b210239ad4c7895a64de850f0f0852896f7f81faba0bd57611a87b46c7a1d8a5"}
Sep 08 14:35:38.906367 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:38.906308    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c7d78d6cc-gfkhb" podStartSLOduration=3.986709941 podStartE2EDuration="13.906291555s" totalImagesPullingTime="9.919581614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:38.905285412 +0000 UTC m=+82.915805413" watchObservedRunningTime="2026-09-08 14:35:38.906291555 +0000 UTC m=+82.916811554"
Sep 08 14:35:38.951559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:38.951502    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-b75h5" podStartSLOduration=2.796246695 podStartE2EDuration="5.951482273s" totalImagesPullingTime="3.155235578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:38.950938183 +0000 UTC m=+82.961458181" watchObservedRunningTime="2026-09-08 14:35:38.951482273 +0000 UTC m=+82.962002274"
Sep 08 14:35:38.972870 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:38.972809    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kc8lh" podStartSLOduration=33.436596829 podStartE2EDuration="37.972790469s" totalImagesPullingTime="4.53619364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:35:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:38.97153029 +0000 UTC m=+82.982050291" watchObservedRunningTime="2026-09-08 14:35:38.972790469 +0000 UTC m=+82.983310468"
Sep 08 14:35:40.515948 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.515910    2561 scope.go:117] "RemoveContainer" containerID="8088e9a78eb9f50e519251c2a42058a7243c960aee8083d0feb650772794fa08"
Sep 08 14:35:40.810933 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.810828    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cb4jl"]
Sep 08 14:35:40.814540 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.814513    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:40.817031 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.817001    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 14:35:40.817433 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.817415    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v7mcr\""
Sep 08 14:35:40.817673 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.817658    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 14:35:40.817889 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.817875    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 14:35:40.896916 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.896883    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:35:40.897080 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.897012    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" event={"ID":"9b2e05c9-ce24-4ebc-90dc-365bddac7688","Type":"ContainerStarted","Data":"bd04ecc591378b5ee58122ac2de77fb757c8a81de2464f7a4232e5e545b892b1"}
Sep 08 14:35:40.897414 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.897393    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:35:40.904032 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.904002    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81289f78-5e33-428f-b578-76e96a12f126-root\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:40.904190 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.904054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbdx\" (UniqueName: \"kubernetes.io/projected/81289f78-5e33-428f-b578-76e96a12f126-kube-api-access-wtbdx\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:40.904190 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.904080    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81289f78-5e33-428f-b578-76e96a12f126-sys\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:40.904190 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.904122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81289f78-5e33-428f-b578-76e96a12f126-metrics-client-ca\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:40.904339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.904207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-accelerators-collector-config\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:40.904339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.904244    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-wtmp\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:40.904339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.904267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-textfile\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:40.904339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.904284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:40.904339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.904318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-tls\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:40.919067 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:40.919016    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-4ccf5" podStartSLOduration=40.951082544 podStartE2EDuration="44.918998593s" totalImagesPullingTime="3.967916049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:40.917581054 +0000 UTC m=+84.928101056" watchObservedRunningTime="2026-09-08 14:35:40.918998593 +0000 UTC m=+84.929518592"
Sep 08 14:35:41.005554 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.005502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-accelerators-collector-config\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.005757 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.005579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-wtmp\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.005757 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.005629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-textfile\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.005757 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.005656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.005757 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.005705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-tls\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.005757 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.005749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81289f78-5e33-428f-b578-76e96a12f126-root\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.006006 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.005780    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-wtmp\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.006006 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.005804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbdx\" (UniqueName: \"kubernetes.io/projected/81289f78-5e33-428f-b578-76e96a12f126-kube-api-access-wtbdx\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.006006 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.005850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81289f78-5e33-428f-b578-76e96a12f126-sys\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.006006 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.005898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81289f78-5e33-428f-b578-76e96a12f126-metrics-client-ca\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.006230 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.006196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-accelerators-collector-config\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.006279 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.006261    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81289f78-5e33-428f-b578-76e96a12f126-sys\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.006906 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.006503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81289f78-5e33-428f-b578-76e96a12f126-root\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.006906 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.006831    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81289f78-5e33-428f-b578-76e96a12f126-metrics-client-ca\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.007232 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.007209    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-textfile\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.008708 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.008678    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.008992 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.008971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81289f78-5e33-428f-b578-76e96a12f126-node-exporter-tls\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.016924 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.016891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbdx\" (UniqueName: \"kubernetes.io/projected/81289f78-5e33-428f-b578-76e96a12f126-kube-api-access-wtbdx\") pod \"node-exporter-cb4jl\" (UID: \"81289f78-5e33-428f-b578-76e96a12f126\") " pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.127872 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.127766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cb4jl"
Sep 08 14:35:41.143045 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:41.143002    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81289f78_5e33_428f_b578_76e96a12f126.slice/crio-10ceb384b6af666a445dede75725897fd2b6cc10f86fe8a9137c88158cb1e738 WatchSource:0}: Error finding container 10ceb384b6af666a445dede75725897fd2b6cc10f86fe8a9137c88158cb1e738: Status 404 returned error can't find the container with id 10ceb384b6af666a445dede75725897fd2b6cc10f86fe8a9137c88158cb1e738
Sep 08 14:35:41.197261 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.197228    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-4ccf5"
Sep 08 14:35:41.902893 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:41.902858    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cb4jl" event={"ID":"81289f78-5e33-428f-b578-76e96a12f126","Type":"ContainerStarted","Data":"10ceb384b6af666a445dede75725897fd2b6cc10f86fe8a9137c88158cb1e738"}
Sep 08 14:35:42.908544 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:42.908502    2561 generic.go:356] "Generic (PLEG): container finished" podID="81289f78-5e33-428f-b578-76e96a12f126" containerID="525bb2c0ed290e8d93324c34233b48506f7f3d3039c1b6dcf7175381b996a9d8" exitCode=0
Sep 08 14:35:42.909067 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:42.908594    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cb4jl" event={"ID":"81289f78-5e33-428f-b578-76e96a12f126","Type":"ContainerDied","Data":"525bb2c0ed290e8d93324c34233b48506f7f3d3039c1b6dcf7175381b996a9d8"}
Sep 08 14:35:43.915219 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:43.915183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cb4jl" event={"ID":"81289f78-5e33-428f-b578-76e96a12f126","Type":"ContainerStarted","Data":"aea85738a5c11b25ee1279243d40b6e116d8b189c2cd44a72020f23d9ce88f00"}
Sep 08 14:35:43.915703 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:43.915232    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cb4jl" event={"ID":"81289f78-5e33-428f-b578-76e96a12f126","Type":"ContainerStarted","Data":"885148ccf58d59abddc8147a7e4771eece10a339b1fda932ebc8bc0849f9c59a"}
Sep 08 14:35:44.009929 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:44.009870    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cb4jl" podStartSLOduration=2.828947713 podStartE2EDuration="4.009848924s" totalImagesPullingTime="1.105874253s" totalInitContainerRuntime="75.026958ms" isStatefulPod=true podCreationTimestamp="2026-09-08 14:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:44.008262913 +0000 UTC m=+88.018782911" watchObservedRunningTime="2026-09-08 14:35:44.009848924 +0000 UTC m=+88.020368925"
Sep 08 14:35:45.249254 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.249213    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-bc599d54b-z97mq"]
Sep 08 14:35:45.252448 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.252427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.255995 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.255968    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 14:35:45.256860 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.256839    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lfwgl\""
Sep 08 14:35:45.256860 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.256853    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 14:35:45.257035 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.256864    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-raennrptg47n\""
Sep 08 14:35:45.257035 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.256903    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 14:35:45.257134 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.257103    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 14:35:45.267397 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.267372    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bc599d54b-z97mq"]
Sep 08 14:35:45.345350 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.345309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/86217df2-2491-42fb-a428-7ea8119feda3-metrics-server-audit-profiles\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.345350 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.345357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/86217df2-2491-42fb-a428-7ea8119feda3-audit-log\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.345564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.345432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/86217df2-2491-42fb-a428-7ea8119feda3-secret-metrics-server-tls\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.345564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.345451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/86217df2-2491-42fb-a428-7ea8119feda3-secret-metrics-server-client-certs\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.345564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.345478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86217df2-2491-42fb-a428-7ea8119feda3-client-ca-bundle\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.345564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.345497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86217df2-2491-42fb-a428-7ea8119feda3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.345564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.345512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2hzg\" (UniqueName: \"kubernetes.io/projected/86217df2-2491-42fb-a428-7ea8119feda3-kube-api-access-q2hzg\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.443043 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.443000    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"]
Sep 08 14:35:45.446117 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.446098    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:45.446329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.446305    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/86217df2-2491-42fb-a428-7ea8119feda3-audit-log\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.446401 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.446375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/86217df2-2491-42fb-a428-7ea8119feda3-secret-metrics-server-tls\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.446463 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.446417    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/86217df2-2491-42fb-a428-7ea8119feda3-secret-metrics-server-client-certs\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.446463 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.446444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86217df2-2491-42fb-a428-7ea8119feda3-client-ca-bundle\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.446555 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.446473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86217df2-2491-42fb-a428-7ea8119feda3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.446555 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.446494    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2hzg\" (UniqueName: \"kubernetes.io/projected/86217df2-2491-42fb-a428-7ea8119feda3-kube-api-access-q2hzg\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.446555 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.446529    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/86217df2-2491-42fb-a428-7ea8119feda3-metrics-server-audit-profiles\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.446858 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.446832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/86217df2-2491-42fb-a428-7ea8119feda3-audit-log\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.447568 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.447543    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86217df2-2491-42fb-a428-7ea8119feda3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.448087 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.448034    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/86217df2-2491-42fb-a428-7ea8119feda3-metrics-server-audit-profiles\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.449234 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.449116    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 14:35:45.449311 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.449234    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rfh9q\""
Sep 08 14:35:45.449432 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.449412    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86217df2-2491-42fb-a428-7ea8119feda3-client-ca-bundle\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.449541 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.449521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/86217df2-2491-42fb-a428-7ea8119feda3-secret-metrics-server-client-certs\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.449714 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.449697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/86217df2-2491-42fb-a428-7ea8119feda3-secret-metrics-server-tls\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.458005 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.457977    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"]
Sep 08 14:35:45.459965 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.459940    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2hzg\" (UniqueName: \"kubernetes.io/projected/86217df2-2491-42fb-a428-7ea8119feda3-kube-api-access-q2hzg\") pod \"metrics-server-bc599d54b-z97mq\" (UID: \"86217df2-2491-42fb-a428-7ea8119feda3\") " pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.547457 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.547373    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtth9\" (UniqueName: \"kubernetes.io/projected/d90be506-b58c-4239-bfe6-44cd5aecec11-kube-api-access-vtth9\") pod \"monitoring-plugin-85bbbbbf4-8wmpb\" (UID: \"d90be506-b58c-4239-bfe6-44cd5aecec11\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:45.547457 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.547424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d90be506-b58c-4239-bfe6-44cd5aecec11-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8wmpb\" (UID: \"d90be506-b58c-4239-bfe6-44cd5aecec11\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:45.561972 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.561930    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:35:45.648322 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.648288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d90be506-b58c-4239-bfe6-44cd5aecec11-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8wmpb\" (UID: \"d90be506-b58c-4239-bfe6-44cd5aecec11\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:45.648507 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.648388    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtth9\" (UniqueName: \"kubernetes.io/projected/d90be506-b58c-4239-bfe6-44cd5aecec11-kube-api-access-vtth9\") pod \"monitoring-plugin-85bbbbbf4-8wmpb\" (UID: \"d90be506-b58c-4239-bfe6-44cd5aecec11\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:45.648507 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:45.648460    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 08 14:35:45.648708 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:45.648678    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d90be506-b58c-4239-bfe6-44cd5aecec11-monitoring-plugin-cert podName:d90be506-b58c-4239-bfe6-44cd5aecec11 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:46.148648213 +0000 UTC m=+90.159168210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d90be506-b58c-4239-bfe6-44cd5aecec11-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-8wmpb" (UID: "d90be506-b58c-4239-bfe6-44cd5aecec11") : secret "monitoring-plugin-cert" not found
Sep 08 14:35:45.663675 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.663642    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtth9\" (UniqueName: \"kubernetes.io/projected/d90be506-b58c-4239-bfe6-44cd5aecec11-kube-api-access-vtth9\") pod \"monitoring-plugin-85bbbbbf4-8wmpb\" (UID: \"d90be506-b58c-4239-bfe6-44cd5aecec11\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:45.851080 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.851047    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bc599d54b-z97mq"]
Sep 08 14:35:45.852019 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:45.851993    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86217df2_2491_42fb_a428_7ea8119feda3.slice/crio-8143a8c27f162f499e566a7cc3afb919cebaab2f3438165f072dec20c218b05b WatchSource:0}: Error finding container 8143a8c27f162f499e566a7cc3afb919cebaab2f3438165f072dec20c218b05b: Status 404 returned error can't find the container with id 8143a8c27f162f499e566a7cc3afb919cebaab2f3438165f072dec20c218b05b
Sep 08 14:35:45.924090 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:45.924057    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bc599d54b-z97mq" event={"ID":"86217df2-2491-42fb-a428-7ea8119feda3","Type":"ContainerStarted","Data":"8143a8c27f162f499e566a7cc3afb919cebaab2f3438165f072dec20c218b05b"}
Sep 08 14:35:46.153227 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:46.153111    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d90be506-b58c-4239-bfe6-44cd5aecec11-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8wmpb\" (UID: \"d90be506-b58c-4239-bfe6-44cd5aecec11\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:46.155736 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:46.155706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d90be506-b58c-4239-bfe6-44cd5aecec11-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8wmpb\" (UID: \"d90be506-b58c-4239-bfe6-44cd5aecec11\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:46.373444 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:46.373401    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:46.661091 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:46.660998    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"]
Sep 08 14:35:46.665226 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:46.665194    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90be506_b58c_4239_bfe6_44cd5aecec11.slice/crio-77046b96e6f6e6ffaf69ff11e93b5e80bb0543cc0c412b1e33f8d1dfc0fd1db9 WatchSource:0}: Error finding container 77046b96e6f6e6ffaf69ff11e93b5e80bb0543cc0c412b1e33f8d1dfc0fd1db9: Status 404 returned error can't find the container with id 77046b96e6f6e6ffaf69ff11e93b5e80bb0543cc0c412b1e33f8d1dfc0fd1db9
Sep 08 14:35:46.930197 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:46.930140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb" event={"ID":"d90be506-b58c-4239-bfe6-44cd5aecec11","Type":"ContainerStarted","Data":"77046b96e6f6e6ffaf69ff11e93b5e80bb0543cc0c412b1e33f8d1dfc0fd1db9"}
Sep 08 14:35:47.285098 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.283278    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:35:47.289273 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.289248    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.292500 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.292468    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 14:35:47.300015 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.299986    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 14:35:47.300222 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.299987    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 14:35:47.300222 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.299988    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 14:35:47.300222 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.300107    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 14:35:47.300409 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.300396    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 14:35:47.300560 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.300547    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 14:35:47.300600 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.300592    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 14:35:47.301772 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.301754    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 14:35:47.301877 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.301831    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 14:35:47.301877 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.301831    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ass2h0jf596h\""
Sep 08 14:35:47.302428 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.302410    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 14:35:47.302428 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.302424    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pl76k\""
Sep 08 14:35:47.304406 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.304386    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 14:35:47.309014 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.308992    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 14:35:47.311381 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.311361    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 14:35:47.340849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.340815    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:35:47.464339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464410    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm4hh\" (UniqueName: \"kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-kube-api-access-lm4hh\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464624    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464739    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.464817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464815    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.465610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.465610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464883    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.465610 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.464907    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567010 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.566921    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567010 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.566957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567010 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.566981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm4hh\" (UniqueName: \"kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-kube-api-access-lm4hh\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567704 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567704 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567704 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567704 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567704 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567704 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.567704 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.567516    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.568352 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.568312    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.569125 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.568977    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.571889 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.571856    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.573314 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.572962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.575180 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.574801    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.575180 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.575051    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.577326 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.575482    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.577326 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.576016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.577326 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.576509    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.577326 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.576930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.577580 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.577340    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.578449 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.578423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.578866 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.578813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.579469 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.579435    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.579578 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.579492    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.580492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.579998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.580492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.580441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.581953 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.581930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.589409 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.589349    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm4hh\" (UniqueName: \"kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-kube-api-access-lm4hh\") pod \"prometheus-k8s-0\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.617310 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.617266    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:47.937598 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.937375    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bc599d54b-z97mq" event={"ID":"86217df2-2491-42fb-a428-7ea8119feda3","Type":"ContainerStarted","Data":"b7ae8b67271f3dc7f72e55f36b6562a9e628be28738972682bf709b28fa42cbf"}
Sep 08 14:35:47.941194 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.941159    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:35:47.962018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:47.961961    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-bc599d54b-z97mq" podStartSLOduration=1.5481303560000002 podStartE2EDuration="2.961941599s" totalImagesPullingTime="1.413811243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:47.960661772 +0000 UTC m=+91.971181771" watchObservedRunningTime="2026-09-08 14:35:47.961941599 +0000 UTC m=+91.972461598"
Sep 08 14:35:48.191886 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:35:48.191811    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ab10a3_06c6_425e_8aed_9705bbb1f2f1.slice/crio-c357daa4eb4a0758db37eb0c5da2a3a08c49106a2334b0a3a657ef6f99d3f884 WatchSource:0}: Error finding container c357daa4eb4a0758db37eb0c5da2a3a08c49106a2334b0a3a657ef6f99d3f884: Status 404 returned error can't find the container with id c357daa4eb4a0758db37eb0c5da2a3a08c49106a2334b0a3a657ef6f99d3f884
Sep 08 14:35:48.943221 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:48.943176    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerStarted","Data":"c357daa4eb4a0758db37eb0c5da2a3a08c49106a2334b0a3a657ef6f99d3f884"}
Sep 08 14:35:48.944988 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:48.944951    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb" event={"ID":"d90be506-b58c-4239-bfe6-44cd5aecec11","Type":"ContainerStarted","Data":"c30890935fcd08d21d3660005770d0aeff5c16e3cb05d1b42c72b26e9711563d"}
Sep 08 14:35:48.945246 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:48.945222    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:48.951049 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:48.951015    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb"
Sep 08 14:35:48.964163 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:48.964089    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8wmpb" podStartSLOduration=2.393932573 podStartE2EDuration="3.964071498s" totalImagesPullingTime="1.570138925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:48.963573381 +0000 UTC m=+92.974093381" watchObservedRunningTime="2026-09-08 14:35:48.964071498 +0000 UTC m=+92.974591622"
Sep 08 14:35:49.842626 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:49.842599    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-856cfd6cc-tvg9t"
Sep 08 14:35:49.950136 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:49.950100    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerID="0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7" exitCode=0
Sep 08 14:35:49.950516 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:49.950183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerDied","Data":"0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7"}
Sep 08 14:35:50.340562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.340519    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8476856557-wr4vm" podUID="f1686006-e577-4a36-8d03-de6de7f4c297" containerName="registry" containerID="cri-o://5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32" gracePeriod=30
Sep 08 14:35:50.574441 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.574417    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:35:50.699996 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.699892    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-installation-pull-secrets\") pod \"f1686006-e577-4a36-8d03-de6de7f4c297\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") "
Sep 08 14:35:50.699996 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.699957    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjp6b\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-kube-api-access-vjp6b\") pod \"f1686006-e577-4a36-8d03-de6de7f4c297\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") "
Sep 08 14:35:50.699996 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.699988    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1686006-e577-4a36-8d03-de6de7f4c297-ca-trust-extracted\") pod \"f1686006-e577-4a36-8d03-de6de7f4c297\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") "
Sep 08 14:35:50.700298 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.700009    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-bound-sa-token\") pod \"f1686006-e577-4a36-8d03-de6de7f4c297\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") "
Sep 08 14:35:50.700298 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.700058    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls\") pod \"f1686006-e577-4a36-8d03-de6de7f4c297\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") "
Sep 08 14:35:50.700298 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.700077    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-registry-certificates\") pod \"f1686006-e577-4a36-8d03-de6de7f4c297\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") "
Sep 08 14:35:50.700298 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.700100    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-trusted-ca\") pod \"f1686006-e577-4a36-8d03-de6de7f4c297\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") "
Sep 08 14:35:50.700298 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.700131    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-image-registry-private-configuration\") pod \"f1686006-e577-4a36-8d03-de6de7f4c297\" (UID: \"f1686006-e577-4a36-8d03-de6de7f4c297\") "
Sep 08 14:35:50.701073 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.700732    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f1686006-e577-4a36-8d03-de6de7f4c297" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:35:50.701214 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.701173    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f1686006-e577-4a36-8d03-de6de7f4c297" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:35:50.703101 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.703070    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f1686006-e577-4a36-8d03-de6de7f4c297" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:35:50.703101 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.703073    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f1686006-e577-4a36-8d03-de6de7f4c297" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:35:50.703257 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.703167    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f1686006-e577-4a36-8d03-de6de7f4c297" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:35:50.703257 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.703253    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-kube-api-access-vjp6b" (OuterVolumeSpecName: "kube-api-access-vjp6b") pod "f1686006-e577-4a36-8d03-de6de7f4c297" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297"). InnerVolumeSpecName "kube-api-access-vjp6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:35:50.703322 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.703305    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f1686006-e577-4a36-8d03-de6de7f4c297" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:35:50.712042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.712009    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1686006-e577-4a36-8d03-de6de7f4c297-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f1686006-e577-4a36-8d03-de6de7f4c297" (UID: "f1686006-e577-4a36-8d03-de6de7f4c297"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:50.801049 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.801010    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-image-registry-private-configuration\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:35:50.801049 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.801040    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1686006-e577-4a36-8d03-de6de7f4c297-installation-pull-secrets\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:35:50.801049 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.801050    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjp6b\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-kube-api-access-vjp6b\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:35:50.801049 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.801060    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1686006-e577-4a36-8d03-de6de7f4c297-ca-trust-extracted\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:35:50.801339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.801068    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-bound-sa-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:35:50.801339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.801077    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1686006-e577-4a36-8d03-de6de7f4c297-registry-tls\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:35:50.801339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.801084    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-registry-certificates\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:35:50.801339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.801092    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1686006-e577-4a36-8d03-de6de7f4c297-trusted-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:35:50.955113 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.955030    2561 generic.go:356] "Generic (PLEG): container finished" podID="f1686006-e577-4a36-8d03-de6de7f4c297" containerID="5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32" exitCode=0
Sep 08 14:35:50.955113 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.955089    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8476856557-wr4vm"
Sep 08 14:35:50.955559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.955105    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8476856557-wr4vm" event={"ID":"f1686006-e577-4a36-8d03-de6de7f4c297","Type":"ContainerDied","Data":"5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32"}
Sep 08 14:35:50.955559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.955182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8476856557-wr4vm" event={"ID":"f1686006-e577-4a36-8d03-de6de7f4c297","Type":"ContainerDied","Data":"16e6d53de5c77625deba5f213052dd58dc643d1b7fb5619b97ea7f79b5ec89c7"}
Sep 08 14:35:50.955559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.955207    2561 scope.go:117] "RemoveContainer" containerID="5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32"
Sep 08 14:35:50.964729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.964707    2561 scope.go:117] "RemoveContainer" containerID="5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32"
Sep 08 14:35:50.965119 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:35:50.965089    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32\": container with ID starting with 5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32 not found: ID does not exist" containerID="5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32"
Sep 08 14:35:50.965239 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.965132    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32"} err="failed to get container status \"5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32\": rpc error: code = NotFound desc = could not find container \"5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32\": container with ID starting with 5f565ec734509dc51bc55be2ef5e9754886146293d90eb00207bae94184f7e32 not found: ID does not exist"
Sep 08 14:35:50.977542 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.977504    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8476856557-wr4vm"]
Sep 08 14:35:50.991730 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:50.991700    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8476856557-wr4vm"]
Sep 08 14:35:52.520958 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:52.520914    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1686006-e577-4a36-8d03-de6de7f4c297" path="/var/lib/kubelet/pods/f1686006-e577-4a36-8d03-de6de7f4c297/volumes"
Sep 08 14:35:53.979823 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:53.979730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerStarted","Data":"6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418"}
Sep 08 14:35:53.979823 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:53.979796    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerStarted","Data":"c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c"}
Sep 08 14:35:55.991436 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:55.991403    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerStarted","Data":"6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011"}
Sep 08 14:35:55.991784 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:55.991465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerStarted","Data":"4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07"}
Sep 08 14:35:55.991784 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:55.991492    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerStarted","Data":"edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee"}
Sep 08 14:35:55.991784 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:55.991520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerStarted","Data":"3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2"}
Sep 08 14:35:56.024083 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:56.024013    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.23283511 podStartE2EDuration="9.023992276s" totalImagesPullingTime="6.7719927s" totalInitContainerRuntime="19.164466ms" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:56.022645337 +0000 UTC m=+100.033165336" watchObservedRunningTime="2026-09-08 14:35:56.023992276 +0000 UTC m=+100.034512275"
Sep 08 14:35:57.618113 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:57.618076    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:35:59.841314 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:35:59.841281    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zvdsw"
Sep 08 14:36:05.562697 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:05.562650    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:36:05.563207 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:05.562729    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:36:25.568030 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:25.568000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:36:25.572164 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:25.572121    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-bc599d54b-z97mq"
Sep 08 14:36:31.122078 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:31.122040    2561 generic.go:356] "Generic (PLEG): container finished" podID="29018d4b-c9e9-403b-97d3-94b36bd94401" containerID="ddbc07a2c19d4da7aded7054f197ef240cd180bd81b79ca25aa73ebaeafff61e" exitCode=0
Sep 08 14:36:31.122486 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:31.122112    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg" event={"ID":"29018d4b-c9e9-403b-97d3-94b36bd94401","Type":"ContainerDied","Data":"ddbc07a2c19d4da7aded7054f197ef240cd180bd81b79ca25aa73ebaeafff61e"}
Sep 08 14:36:31.122486 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:31.122482    2561 scope.go:117] "RemoveContainer" containerID="ddbc07a2c19d4da7aded7054f197ef240cd180bd81b79ca25aa73ebaeafff61e"
Sep 08 14:36:32.128205 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:32.128172    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-h95lg" event={"ID":"29018d4b-c9e9-403b-97d3-94b36bd94401","Type":"ContainerStarted","Data":"b9a4ba63ee5ca9c63fc98617d6499496a4562335a61d57cf2cef2e5235c6c379"}
Sep 08 14:36:47.618010 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:47.617970    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:36:47.637026 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:47.636994    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:36:48.206315 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:36:48.206288    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:05.491497 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:05.491454    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:37:05.492683 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:05.492542    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011" gracePeriod=600
Sep 08 14:37:05.493018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:05.492995    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="config-reloader" containerID="cri-o://6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418" gracePeriod=600
Sep 08 14:37:05.493271 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:05.493111    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy-web" containerID="cri-o://edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee" gracePeriod=600
Sep 08 14:37:05.493271 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:05.493162    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="thanos-sidecar" containerID="cri-o://3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2" gracePeriod=600
Sep 08 14:37:05.493271 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:05.493072    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="prometheus" containerID="cri-o://c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c" gracePeriod=600
Sep 08 14:37:05.493271 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:05.493179    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy" containerID="cri-o://4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07" gracePeriod=600
Sep 08 14:37:06.258900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.258868    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerID="6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011" exitCode=0
Sep 08 14:37:06.258900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.258895    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerID="4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07" exitCode=0
Sep 08 14:37:06.258900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.258901    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerID="3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2" exitCode=0
Sep 08 14:37:06.258900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.258907    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerID="6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418" exitCode=0
Sep 08 14:37:06.258900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.258912    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerID="c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c" exitCode=0
Sep 08 14:37:06.259220 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.258944    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerDied","Data":"6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011"}
Sep 08 14:37:06.259220 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.259040    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerDied","Data":"4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07"}
Sep 08 14:37:06.259220 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.259069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerDied","Data":"3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2"}
Sep 08 14:37:06.259220 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.259093    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerDied","Data":"6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418"}
Sep 08 14:37:06.259220 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.259117    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerDied","Data":"c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c"}
Sep 08 14:37:06.749214 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.749184    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:06.856689 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856616    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-metrics-client-certs\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856689 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856670    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-trusted-ca-bundle\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856689 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856688    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-serving-certs-ca-bundle\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856708    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-thanos-prometheus-http-client-file\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856741    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-metrics-client-ca\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856758    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-2\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856788    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-0\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856813    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-tls\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856841    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm4hh\" (UniqueName: \"kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-kube-api-access-lm4hh\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856878    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-db\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856905    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-kube-rbac-proxy\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.856932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856923    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-kubelet-serving-ca-bundle\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856950    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config-out\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.856981    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-1\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857021    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857074    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-grpc-tls\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857100    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-tls-assets\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857127    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-web-config\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857170    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857192    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\" (UID: \"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1\") "
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857073    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857249    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:37:06.857403 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857269    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:37:06.858091 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857452    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.858091 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857469    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.858091 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857483    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-metrics-client-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.858091 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.857580    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:37:06.858091 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.858048    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:37:06.858919 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.858628    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:37:06.859247 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.859219    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:37:06.859843 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.859813    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:37:06.859944 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.859900    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:37:06.860009 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.859934    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:37:06.860696 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.860669    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:37:06.861588 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.861560    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:37:06.862079 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.862055    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:37:06.862214 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.862075    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-kube-api-access-lm4hh" (OuterVolumeSpecName: "kube-api-access-lm4hh") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "kube-api-access-lm4hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:37:06.862321 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.862294    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:37:06.862924 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.862894    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config-out" (OuterVolumeSpecName: "config-out") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:37:06.863020 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.862975    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:37:06.863219 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.863199    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:37:06.863655 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.863639    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config" (OuterVolumeSpecName: "config") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:37:06.872698 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.872674    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-web-config" (OuterVolumeSpecName: "web-config") pod "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" (UID: "e6ab10a3-06c6-425e-8aed-9705bbb1f2f1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:37:06.957987 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.957950    2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.957987 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.957980    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.957987 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.957991    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958001    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958010    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm4hh\" (UniqueName: \"kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-kube-api-access-lm4hh\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958021    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-db\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958030    2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-kube-rbac-proxy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958038    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958046    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config-out\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958055    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958063    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958071    2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-grpc-tls\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958079    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-tls-assets\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958086    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-web-config\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958094    2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-config\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958101    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:06.958242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:06.958109    2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1-secret-metrics-client-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:37:07.266381 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.266344    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerID="edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee" exitCode=0
Sep 08 14:37:07.266546 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.266388    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerDied","Data":"edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee"}
Sep 08 14:37:07.266546 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.266424    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.266546 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.266449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ab10a3-06c6-425e-8aed-9705bbb1f2f1","Type":"ContainerDied","Data":"c357daa4eb4a0758db37eb0c5da2a3a08c49106a2334b0a3a657ef6f99d3f884"}
Sep 08 14:37:07.266546 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.266480    2561 scope.go:117] "RemoveContainer" containerID="6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011"
Sep 08 14:37:07.274695 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.274666    2561 scope.go:117] "RemoveContainer" containerID="4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07"
Sep 08 14:37:07.281794 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.281777    2561 scope.go:117] "RemoveContainer" containerID="edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee"
Sep 08 14:37:07.288495 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.288479    2561 scope.go:117] "RemoveContainer" containerID="3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2"
Sep 08 14:37:07.291951 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.291927    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:37:07.295650 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.295629    2561 scope.go:117] "RemoveContainer" containerID="6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418"
Sep 08 14:37:07.300111 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.300088    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:37:07.303083 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.303061    2561 scope.go:117] "RemoveContainer" containerID="c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c"
Sep 08 14:37:07.310287 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.310253    2561 scope.go:117] "RemoveContainer" containerID="0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7"
Sep 08 14:37:07.316914 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.316889    2561 scope.go:117] "RemoveContainer" containerID="6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011"
Sep 08 14:37:07.317214 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:37:07.317194    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011\": container with ID starting with 6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011 not found: ID does not exist" containerID="6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011"
Sep 08 14:37:07.317291 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.317228    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011"} err="failed to get container status \"6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011\": rpc error: code = NotFound desc = could not find container \"6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011\": container with ID starting with 6e8f59e6420cc07bcaf09fc2b087f575f38cae2e6fe90c9763e8a08f7ad9c011 not found: ID does not exist"
Sep 08 14:37:07.317291 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.317253    2561 scope.go:117] "RemoveContainer" containerID="4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07"
Sep 08 14:37:07.317510 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:37:07.317494    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07\": container with ID starting with 4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07 not found: ID does not exist" containerID="4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07"
Sep 08 14:37:07.317545 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.317519    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07"} err="failed to get container status \"4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07\": rpc error: code = NotFound desc = could not find container \"4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07\": container with ID starting with 4781786ab6c5d762c917f1b00a172aff70c4e44b4cb7064ae58d7c22805ecd07 not found: ID does not exist"
Sep 08 14:37:07.317545 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.317534    2561 scope.go:117] "RemoveContainer" containerID="edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee"
Sep 08 14:37:07.317742 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:37:07.317726    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee\": container with ID starting with edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee not found: ID does not exist" containerID="edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee"
Sep 08 14:37:07.317784 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.317747    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee"} err="failed to get container status \"edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee\": rpc error: code = NotFound desc = could not find container \"edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee\": container with ID starting with edd81dffb795a5f573f3b16eed1b71ba0bdceeb5e6b5e7f631b0e930451892ee not found: ID does not exist"
Sep 08 14:37:07.317784 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.317761    2561 scope.go:117] "RemoveContainer" containerID="3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2"
Sep 08 14:37:07.317979 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:37:07.317963    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2\": container with ID starting with 3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2 not found: ID does not exist" containerID="3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2"
Sep 08 14:37:07.318042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.317986    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2"} err="failed to get container status \"3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2\": rpc error: code = NotFound desc = could not find container \"3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2\": container with ID starting with 3ab1dd9bde82dda17adca3d9790bdeaadf835e49e16b8e4f0b3714b7ec2d23b2 not found: ID does not exist"
Sep 08 14:37:07.318042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.318005    2561 scope.go:117] "RemoveContainer" containerID="6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418"
Sep 08 14:37:07.318384 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:37:07.318348    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418\": container with ID starting with 6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418 not found: ID does not exist" containerID="6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418"
Sep 08 14:37:07.318470 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.318384    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418"} err="failed to get container status \"6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418\": rpc error: code = NotFound desc = could not find container \"6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418\": container with ID starting with 6c8e89416ac6ca63cf100ee0a87848b8817a36beb3f78b5343b8c19c3934a418 not found: ID does not exist"
Sep 08 14:37:07.318470 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.318397    2561 scope.go:117] "RemoveContainer" containerID="c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c"
Sep 08 14:37:07.318689 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:37:07.318663    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c\": container with ID starting with c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c not found: ID does not exist" containerID="c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c"
Sep 08 14:37:07.318785 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.318693    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c"} err="failed to get container status \"c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c\": rpc error: code = NotFound desc = could not find container \"c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c\": container with ID starting with c30d974003ba0e338b84ddd71ccb685b136c15161c0f156dfbf98e336bf5f06c not found: ID does not exist"
Sep 08 14:37:07.318785 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.318709    2561 scope.go:117] "RemoveContainer" containerID="0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7"
Sep 08 14:37:07.318977 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:37:07.318963    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7\": container with ID starting with 0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7 not found: ID does not exist" containerID="0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7"
Sep 08 14:37:07.319012 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.318980    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7"} err="failed to get container status \"0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7\": rpc error: code = NotFound desc = could not find container \"0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7\": container with ID starting with 0f02035e4731e4a70534fceab2038b0de007baeaa1cae93dd937b246445737f7 not found: ID does not exist"
Sep 08 14:37:07.329568 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329533    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:37:07.329797 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329785    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="prometheus"
Sep 08 14:37:07.329845 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329825    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="prometheus"
Sep 08 14:37:07.329845 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329836    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy-web"
Sep 08 14:37:07.329845 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329842    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy-web"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329853    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy-thanos"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329859    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy-thanos"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329868    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329874    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329881    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="thanos-sidecar"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329886    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="thanos-sidecar"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329899    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="config-reloader"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329904    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="config-reloader"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329911    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1686006-e577-4a36-8d03-de6de7f4c297" containerName="registry"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329916    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1686006-e577-4a36-8d03-de6de7f4c297" containerName="registry"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329922    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="init-config-reloader"
Sep 08 14:37:07.329934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329926    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="init-config-reloader"
Sep 08 14:37:07.330293 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329965    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="config-reloader"
Sep 08 14:37:07.330293 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329973    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1686006-e577-4a36-8d03-de6de7f4c297" containerName="registry"
Sep 08 14:37:07.330293 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329979    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy-thanos"
Sep 08 14:37:07.330293 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329984    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="prometheus"
Sep 08 14:37:07.330293 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329989    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="thanos-sidecar"
Sep 08 14:37:07.330293 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.329994    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy"
Sep 08 14:37:07.330293 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.330000    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" containerName="kube-rbac-proxy-web"
Sep 08 14:37:07.336021 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.335996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.338076 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338053    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ass2h0jf596h\""
Sep 08 14:37:07.338194 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338080    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 14:37:07.338366 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338336    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 14:37:07.338366 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338357    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pl76k\""
Sep 08 14:37:07.338506 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338363    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 14:37:07.338506 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338420    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 14:37:07.338506 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338457    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 14:37:07.338706 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338689    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 14:37:07.338778 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338759    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 14:37:07.338830 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338781    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 14:37:07.338926 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.338781    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 14:37:07.339028 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.339012    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 14:37:07.339489 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.339447    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 14:37:07.339489 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.339469    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 14:37:07.341514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.341492    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 14:37:07.344367 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.344349    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 14:37:07.352982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.352961    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:37:07.461768 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.461729    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8nd\" (UniqueName: \"kubernetes.io/projected/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-kube-api-access-ng8nd\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.461768 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.461772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.461973 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.461790    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.461973 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.461838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.461973 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.461911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.461973 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.461956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462104 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.461977    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-config\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462104 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.461996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462104 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-config-out\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462104 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462063    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462104 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462082    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462318 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462318 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462136    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-web-config\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462318 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462185    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462318 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462318 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462318 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462318 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462518 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462332    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.462518 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.462368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.562975 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.562882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.562975 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.562917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.562975 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.562934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.562975 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.562973    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563223 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563223 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563223 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8nd\" (UniqueName: \"kubernetes.io/projected/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-kube-api-access-ng8nd\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563223 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563223 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563390 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563707 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563809 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563809 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-config\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563909 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563909 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563862    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-config-out\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.563909 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.564061 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.564061 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.563957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.564178 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.564061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.564178 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.564088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-web-config\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.564368 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.564290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.567206 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.566683    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.567206 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.567115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.567565 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.567541    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.567786 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.567759    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.567943 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.567901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.567943 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.567910    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.568804 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.568739    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.568804 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.568743    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.569395 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.569373    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.569492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.569373    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.570431 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.570403    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-config-out\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.570521 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.570453    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.573052 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.572224    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.573052 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.572224    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.573052 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.572589    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-config\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.573052 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.573024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8nd\" (UniqueName: \"kubernetes.io/projected/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-kube-api-access-ng8nd\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.573671 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.573469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-web-config\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.573671 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.573493    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.574245 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.574227    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.646410 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.646357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:37:07.928056 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:07.927975    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 14:37:07.931919 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:37:07.931893    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01655af4_16c8_4ebe_9e1a_65dbd2d9e0e8.slice/crio-870e4e844ca0a04aa9493aeb7c14d1170d6ba58b3eb513ae50daa2b002b06a60 WatchSource:0}: Error finding container 870e4e844ca0a04aa9493aeb7c14d1170d6ba58b3eb513ae50daa2b002b06a60: Status 404 returned error can't find the container with id 870e4e844ca0a04aa9493aeb7c14d1170d6ba58b3eb513ae50daa2b002b06a60
Sep 08 14:37:08.273155 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:08.273114    2561 generic.go:356] "Generic (PLEG): container finished" podID="01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8" containerID="7f651a37990ef45665869b88f13cd1c6fda7798a78a58d996a8c7c031a9a031c" exitCode=0
Sep 08 14:37:08.273329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:08.273204    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8","Type":"ContainerDied","Data":"7f651a37990ef45665869b88f13cd1c6fda7798a78a58d996a8c7c031a9a031c"}
Sep 08 14:37:08.273329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:08.273286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8","Type":"ContainerStarted","Data":"870e4e844ca0a04aa9493aeb7c14d1170d6ba58b3eb513ae50daa2b002b06a60"}
Sep 08 14:37:08.522436 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:08.522401    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6ab10a3-06c6-425e-8aed-9705bbb1f2f1" path="/var/lib/kubelet/pods/e6ab10a3-06c6-425e-8aed-9705bbb1f2f1/volumes"
Sep 08 14:37:09.281314 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:09.281276    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8","Type":"ContainerStarted","Data":"074fe41a7a9845461306c22602514b426c44f8b71cb626527af254f36290ecc7"}
Sep 08 14:37:09.281749 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:09.281343    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8","Type":"ContainerStarted","Data":"2934017f9d646d9551dc2a33a2d241c03df41075184301db1d4d56779e91cc59"}
Sep 08 14:37:09.281749 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:09.281380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8","Type":"ContainerStarted","Data":"3ac747bde1baee716d1fc4ef43916db72da872011984972affce64c87e365581"}
Sep 08 14:37:09.281749 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:09.281418    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8","Type":"ContainerStarted","Data":"c62ee872dd27abac0bd69da608148020a901ca8f91592446062b6fc51044a950"}
Sep 08 14:37:09.281749 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:09.281442    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8","Type":"ContainerStarted","Data":"6fb18911bba90b9d247f3994fbde3478279cff0e64182b37aaf17c80845f7e45"}
Sep 08 14:37:09.281749 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:09.281465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8","Type":"ContainerStarted","Data":"4ec6583dc87f48948da374289262d9d9605d781ad59fdf5db19bce1663914adc"}
Sep 08 14:37:09.310399 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:09.310339    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.290909377 podStartE2EDuration="2.310317587s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.40821ms" isStatefulPod=false podCreationTimestamp="2026-09-08 14:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:37:09.309489328 +0000 UTC m=+173.320009327" watchObservedRunningTime="2026-09-08 14:37:09.310317587 +0000 UTC m=+173.320837586"
Sep 08 14:37:12.647289 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:37:12.647232    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:38:07.647094 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:38:07.647054    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:38:07.663701 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:38:07.663674    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:38:08.527207 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:38:08.527179    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 14:39:09.367760 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.367724    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"]
Sep 08 14:39:09.370958 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.370934    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.374451 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.374425    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 14:39:09.374664 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.374651    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 14:39:09.375011 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.374983    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 14:39:09.375456 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.375438    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 14:39:09.377482 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.377461    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q8mbk\""
Sep 08 14:39:09.399970 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.399927    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"]
Sep 08 14:39:09.506540 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.506504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc991882-2984-40f2-953b-c8a2858714d2-manifests\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.506540 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.506545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc991882-2984-40f2-953b-c8a2858714d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.506760 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.506584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc991882-2984-40f2-953b-c8a2858714d2-tmp\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.506760 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.506653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2nhp\" (UniqueName: \"kubernetes.io/projected/cc991882-2984-40f2-953b-c8a2858714d2-kube-api-access-j2nhp\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.506760 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.506700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc991882-2984-40f2-953b-c8a2858714d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.607532 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.607492    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc991882-2984-40f2-953b-c8a2858714d2-manifests\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.607532 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.607532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc991882-2984-40f2-953b-c8a2858714d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.607814 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.607551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc991882-2984-40f2-953b-c8a2858714d2-tmp\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.607814 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.607600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2nhp\" (UniqueName: \"kubernetes.io/projected/cc991882-2984-40f2-953b-c8a2858714d2-kube-api-access-j2nhp\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.607814 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.607654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc991882-2984-40f2-953b-c8a2858714d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.608022 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.608002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc991882-2984-40f2-953b-c8a2858714d2-manifests\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.610039 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.610012    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc991882-2984-40f2-953b-c8a2858714d2-tmp\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.610270 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.610253    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc991882-2984-40f2-953b-c8a2858714d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.610329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.610311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc991882-2984-40f2-953b-c8a2858714d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.615731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.615696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2nhp\" (UniqueName: \"kubernetes.io/projected/cc991882-2984-40f2-953b-c8a2858714d2-kube-api-access-j2nhp\") pod \"opendatahub-operator-controller-manager-766f77f8db-5tvhp\" (UID: \"cc991882-2984-40f2-953b-c8a2858714d2\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.681083 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.680995    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:09.962347 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:09.962097    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"]
Sep 08 14:39:10.747340 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:10.747300    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp" event={"ID":"cc991882-2984-40f2-953b-c8a2858714d2","Type":"ContainerStarted","Data":"c4ac0c9966b6e35088fb2c8830220a6294fa91f126a78515b45d9f5bc9a09f55"}
Sep 08 14:39:13.763623 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:13.763589    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp" event={"ID":"cc991882-2984-40f2-953b-c8a2858714d2","Type":"ContainerStarted","Data":"f1dc636e0e1df160db3a6332786381173ae551eb947a56e6837a6de56863dde8"}
Sep 08 14:39:14.769572 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:14.769531    2561 generic.go:356] "Generic (PLEG): container finished" podID="cc991882-2984-40f2-953b-c8a2858714d2" containerID="f1dc636e0e1df160db3a6332786381173ae551eb947a56e6837a6de56863dde8" exitCode=0
Sep 08 14:39:14.769968 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:14.769615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp" event={"ID":"cc991882-2984-40f2-953b-c8a2858714d2","Type":"ContainerDied","Data":"f1dc636e0e1df160db3a6332786381173ae551eb947a56e6837a6de56863dde8"}
Sep 08 14:39:15.775690 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:15.775650    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp" event={"ID":"cc991882-2984-40f2-953b-c8a2858714d2","Type":"ContainerStarted","Data":"e41495a7d508591b305ca20adb3006fc31c0c8881c410ee79b4d1fd44d63c212"}
Sep 08 14:39:15.776135 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:15.775780    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:15.798490 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:15.798428    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp" podStartSLOduration=2.3297159069999998 podStartE2EDuration="6.798409341s" totalImagesPullingTime="3.398684664s" totalInitContainerRuntime="1.07000877s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:15.796745126 +0000 UTC m=+299.807265166" watchObservedRunningTime="2026-09-08 14:39:15.798409341 +0000 UTC m=+299.808929332"
Sep 08 14:39:16.423526 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:16.423492    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:39:16.426699 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:16.426677    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:39:16.434524 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:16.434503    2561 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 14:39:26.782039 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:26.782008    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-5tvhp"
Sep 08 14:39:37.585701 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.585660    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"]
Sep 08 14:39:37.589432 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.589406    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.591571 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.591545    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 14:39:37.591847 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.591826    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 14:39:37.591992 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.591967    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bvcvl\""
Sep 08 14:39:37.592116 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.591865    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 14:39:37.601498 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.601464    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"]
Sep 08 14:39:37.647374 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.647336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.647553 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.647437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.647607 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.647580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.647655 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.647617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72dc156a-871f-465d-ad38-977c8725857e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.647804 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.647767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7m44\" (UniqueName: \"kubernetes.io/projected/72dc156a-871f-465d-ad38-977c8725857e-kube-api-access-x7m44\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.648047 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.648014    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72dc156a-871f-465d-ad38-977c8725857e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.648216 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.648080    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.648216 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.648105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72dc156a-871f-465d-ad38-977c8725857e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.648377 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.648360    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.749709 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.749667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72dc156a-871f-465d-ad38-977c8725857e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.749709 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.749716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.749969 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.749732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72dc156a-871f-465d-ad38-977c8725857e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.749969 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.749751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.749969 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.749780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.749969 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.749815    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.749969 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.749872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.749969 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.749901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72dc156a-871f-465d-ad38-977c8725857e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.749969 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.749927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7m44\" (UniqueName: \"kubernetes.io/projected/72dc156a-871f-465d-ad38-977c8725857e-kube-api-access-x7m44\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.750348 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.750131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.750348 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.750225    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.750448 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.750432    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.750543 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.750521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.750683 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.750661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72dc156a-871f-465d-ad38-977c8725857e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.752797 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.752769    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72dc156a-871f-465d-ad38-977c8725857e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.752906 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.752868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72dc156a-871f-465d-ad38-977c8725857e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.760555 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.760528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7m44\" (UniqueName: \"kubernetes.io/projected/72dc156a-871f-465d-ad38-977c8725857e-kube-api-access-x7m44\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.761739 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.761716    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72dc156a-871f-465d-ad38-977c8725857e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8\" (UID: \"72dc156a-871f-465d-ad38-977c8725857e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:37.903644 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:37.903543    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:38.180609 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:38.180580    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"]
Sep 08 14:39:38.182762 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:39:38.182734    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72dc156a_871f_465d_ad38_977c8725857e.slice/crio-7ece7bda509e215a9b86fe8a773644195376279b626d7eeb6da99ef0294a85f6 WatchSource:0}: Error finding container 7ece7bda509e215a9b86fe8a773644195376279b626d7eeb6da99ef0294a85f6: Status 404 returned error can't find the container with id 7ece7bda509e215a9b86fe8a773644195376279b626d7eeb6da99ef0294a85f6
Sep 08 14:39:38.184727 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:38.184711    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:39:38.871961 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:38.871922    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8" event={"ID":"72dc156a-871f-465d-ad38-977c8725857e","Type":"ContainerStarted","Data":"7ece7bda509e215a9b86fe8a773644195376279b626d7eeb6da99ef0294a85f6"}
Sep 08 14:39:39.770982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.770944    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8hj74"]
Sep 08 14:39:39.774338 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.774321    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8hj74"
Sep 08 14:39:39.776424 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.776401    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 08 14:39:39.776663 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.776643    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-c27mc\""
Sep 08 14:39:39.784315 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.784282    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8hj74"]
Sep 08 14:39:39.869471 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.869435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7t8g\" (UniqueName: \"kubernetes.io/projected/f32d411f-ac32-4372-9bd6-8fd8393fcf5a-kube-api-access-w7t8g\") pod \"odh-model-controller-7998c67dc4-8hj74\" (UID: \"f32d411f-ac32-4372-9bd6-8fd8393fcf5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-8hj74"
Sep 08 14:39:39.869471 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.869471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f32d411f-ac32-4372-9bd6-8fd8393fcf5a-cert\") pod \"odh-model-controller-7998c67dc4-8hj74\" (UID: \"f32d411f-ac32-4372-9bd6-8fd8393fcf5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-8hj74"
Sep 08 14:39:39.970636 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.970602    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7t8g\" (UniqueName: \"kubernetes.io/projected/f32d411f-ac32-4372-9bd6-8fd8393fcf5a-kube-api-access-w7t8g\") pod \"odh-model-controller-7998c67dc4-8hj74\" (UID: \"f32d411f-ac32-4372-9bd6-8fd8393fcf5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-8hj74"
Sep 08 14:39:39.971019 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.970642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f32d411f-ac32-4372-9bd6-8fd8393fcf5a-cert\") pod \"odh-model-controller-7998c67dc4-8hj74\" (UID: \"f32d411f-ac32-4372-9bd6-8fd8393fcf5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-8hj74"
Sep 08 14:39:39.973386 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.973361    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f32d411f-ac32-4372-9bd6-8fd8393fcf5a-cert\") pod \"odh-model-controller-7998c67dc4-8hj74\" (UID: \"f32d411f-ac32-4372-9bd6-8fd8393fcf5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-8hj74"
Sep 08 14:39:39.984042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:39.984015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7t8g\" (UniqueName: \"kubernetes.io/projected/f32d411f-ac32-4372-9bd6-8fd8393fcf5a-kube-api-access-w7t8g\") pod \"odh-model-controller-7998c67dc4-8hj74\" (UID: \"f32d411f-ac32-4372-9bd6-8fd8393fcf5a\") " pod="opendatahub/odh-model-controller-7998c67dc4-8hj74"
Sep 08 14:39:40.086677 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:40.086570    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8hj74"
Sep 08 14:39:40.372063 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:40.371969    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8hj74"]
Sep 08 14:39:40.377387 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:39:40.377357    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32d411f_ac32_4372_9bd6_8fd8393fcf5a.slice/crio-22caf5b6ac7c730249d375aa557eb6b0d3f9f313079f749565c997048a5b5946 WatchSource:0}: Error finding container 22caf5b6ac7c730249d375aa557eb6b0d3f9f313079f749565c997048a5b5946: Status 404 returned error can't find the container with id 22caf5b6ac7c730249d375aa557eb6b0d3f9f313079f749565c997048a5b5946
Sep 08 14:39:40.881731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:40.881684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8hj74" event={"ID":"f32d411f-ac32-4372-9bd6-8fd8393fcf5a","Type":"ContainerStarted","Data":"22caf5b6ac7c730249d375aa557eb6b0d3f9f313079f749565c997048a5b5946"}
Sep 08 14:39:41.908219 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:41.908178    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:39:41.908590 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:41.908273    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:39:41.908590 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:41.908321    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:39:42.891807 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:42.891765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8" event={"ID":"72dc156a-871f-465d-ad38-977c8725857e","Type":"ContainerStarted","Data":"070ca1837a7e408f95f759eff2e89263a580c326e4e1b593f56699e026c41ead"}
Sep 08 14:39:42.904270 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:42.904227    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:42.910208 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:42.910117    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:42.911814 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:42.911765    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8" podStartSLOduration=2.1886884110000002 podStartE2EDuration="5.911748881s" totalImagesPullingTime="3.72306047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:42.909672047 +0000 UTC m=+326.920192046" watchObservedRunningTime="2026-09-08 14:39:42.911748881 +0000 UTC m=+326.922268879"
Sep 08 14:39:43.897351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:43.897317    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:43.898701 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:43.898674    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8"
Sep 08 14:39:44.902910 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:44.902868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8hj74" event={"ID":"f32d411f-ac32-4372-9bd6-8fd8393fcf5a","Type":"ContainerStarted","Data":"9dadab17f59e25a4556d4f43bb01a73ad21c07d222740f7ee1b35fa4daeed108"}
Sep 08 14:39:44.918674 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:44.918622    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-8hj74" podStartSLOduration=2.05806004 podStartE2EDuration="5.918604195s" totalImagesPullingTime="3.860544155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:44.917872851 +0000 UTC m=+328.928392849" watchObservedRunningTime="2026-09-08 14:39:44.918604195 +0000 UTC m=+328.929124195"
Sep 08 14:39:45.908019 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:45.907989    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-8hj74"
Sep 08 14:39:46.788081 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.788015    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"]
Sep 08 14:39:46.791573 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.791542    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:46.794273 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.794245    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 14:39:46.794273 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.794245    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:39:46.794484 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.794246    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 08 14:39:46.794580 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.794559    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 08 14:39:46.794652 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.794582    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 08 14:39:46.794652 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.794559    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lq5wr\""
Sep 08 14:39:46.800380 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.800355    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"]
Sep 08 14:39:46.941242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.941204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-cert\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:46.941242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.941244    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxp2b\" (UniqueName: \"kubernetes.io/projected/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-kube-api-access-fxp2b\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:46.941655 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.941280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-metrics-cert\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:46.941655 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:46.941303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-manager-config\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:47.042584 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.042499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-cert\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:47.042584 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.042538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxp2b\" (UniqueName: \"kubernetes.io/projected/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-kube-api-access-fxp2b\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:47.042786 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.042677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-metrics-cert\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:47.042786 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.042728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-manager-config\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:47.043378 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.043352    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-manager-config\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:47.045240 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.045222    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-cert\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:47.045396 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.045374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-metrics-cert\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:47.055405 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.055372    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxp2b\" (UniqueName: \"kubernetes.io/projected/a2f849d2-b865-439b-8e7a-75bdb15d4fcb-kube-api-access-fxp2b\") pod \"lws-controller-manager-84fb6884f5-zk28g\" (UID: \"a2f849d2-b865-439b-8e7a-75bdb15d4fcb\") " pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:47.103417 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.103375    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:47.384606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.384579    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"]
Sep 08 14:39:47.387381 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:39:47.387351    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f849d2_b865_439b_8e7a_75bdb15d4fcb.slice/crio-37be4e3a89ddb252d54fe199f7712fbdcbfb7ecde8a029fdb8394679ce1020ba WatchSource:0}: Error finding container 37be4e3a89ddb252d54fe199f7712fbdcbfb7ecde8a029fdb8394679ce1020ba: Status 404 returned error can't find the container with id 37be4e3a89ddb252d54fe199f7712fbdcbfb7ecde8a029fdb8394679ce1020ba
Sep 08 14:39:47.753378 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.753347    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"]
Sep 08 14:39:47.757846 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.757827    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.762321 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.762299    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 14:39:47.762597 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.762581    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9dqd8\""
Sep 08 14:39:47.762974 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.762956    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 14:39:47.764158 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.764127    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 14:39:47.850162 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.850116    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"]
Sep 08 14:39:47.850490 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.850465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.850596 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.850504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.850596 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.850543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91cafd67-b259-49c4-bae3-45b0986fbc03-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.850596 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.850564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.850596 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.850589    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91cafd67-b259-49c4-bae3-45b0986fbc03-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.850804 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.850619    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.850804 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.850638    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl4ss\" (UniqueName: \"kubernetes.io/projected/91cafd67-b259-49c4-bae3-45b0986fbc03-kube-api-access-bl4ss\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.917794 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.917756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g" event={"ID":"a2f849d2-b865-439b-8e7a-75bdb15d4fcb","Type":"ContainerStarted","Data":"37be4e3a89ddb252d54fe199f7712fbdcbfb7ecde8a029fdb8394679ce1020ba"}
Sep 08 14:39:47.951202 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.951126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.951654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.951217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91cafd67-b259-49c4-bae3-45b0986fbc03-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.951654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.951237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.951654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.951258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91cafd67-b259-49c4-bae3-45b0986fbc03-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.951654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.951277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.951654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.951302    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl4ss\" (UniqueName: \"kubernetes.io/projected/91cafd67-b259-49c4-bae3-45b0986fbc03-kube-api-access-bl4ss\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.951654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.951416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.952432 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.952403    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.953934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.953902    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91cafd67-b259-49c4-bae3-45b0986fbc03-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.953934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.953914    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.954061 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.953957    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.954061 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.954025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91cafd67-b259-49c4-bae3-45b0986fbc03-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.959697 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.959672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91cafd67-b259-49c4-bae3-45b0986fbc03-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:47.959800 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:47.959774    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl4ss\" (UniqueName: \"kubernetes.io/projected/91cafd67-b259-49c4-bae3-45b0986fbc03-kube-api-access-bl4ss\") pod \"istiod-openshift-gateway-5677ccb49b-r7pgn\" (UID: \"91cafd67-b259-49c4-bae3-45b0986fbc03\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:48.067915 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:48.067826    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:48.360449 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:48.358974    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"]
Sep 08 14:39:48.924435 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:48.924395    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn" event={"ID":"91cafd67-b259-49c4-bae3-45b0986fbc03","Type":"ContainerStarted","Data":"6bbfa7780de27911252d5d9c4c01eded49f21e8dc1d98686bb0dd33aa6f88a76"}
Sep 08 14:39:50.944382 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:50.944340    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g" event={"ID":"a2f849d2-b865-439b-8e7a-75bdb15d4fcb","Type":"ContainerStarted","Data":"3688fb350a87fc1126d49ae44e1e131c5092f3c16ea5911ff0a8a63f7b358980"}
Sep 08 14:39:50.944826 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:50.944450    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:39:50.979157 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:50.979073    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g" podStartSLOduration=2.466650631 podStartE2EDuration="4.979054466s" totalImagesPullingTime="2.512403835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:50.977876667 +0000 UTC m=+334.988396663" watchObservedRunningTime="2026-09-08 14:39:50.979054466 +0000 UTC m=+334.989574464"
Sep 08 14:39:51.724854 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:51.724818    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:39:51.724935 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:51.724884    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:39:51.950832 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:51.950793    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn" event={"ID":"91cafd67-b259-49c4-bae3-45b0986fbc03","Type":"ContainerStarted","Data":"6ae5a9e2a653b60a238283e2918fafd7aee7468aebde76fa26f5cc24daac7953"}
Sep 08 14:39:51.951243 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:51.951026    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:51.977843 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:51.977747    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn" podStartSLOduration=1.619505797 podStartE2EDuration="4.977724855s" totalImagesPullingTime="3.358219058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:51.974919524 +0000 UTC m=+335.985439524" watchObservedRunningTime="2026-09-08 14:39:51.977724855 +0000 UTC m=+335.988244855"
Sep 08 14:39:52.957415 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:52.957384    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7pgn"
Sep 08 14:39:56.914454 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:39:56.914417    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-8hj74"
Sep 08 14:40:01.953402 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:40:01.953370    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84fb6884f5-zk28g"
Sep 08 14:41:25.584718 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.584687    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"]
Sep 08 14:41:25.588252 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.588224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:25.590501 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.590466    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 14:41:25.590501 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.590481    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qzljs\""
Sep 08 14:41:25.590732 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.590466    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 14:41:25.605254 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.605216    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"]
Sep 08 14:41:25.652789 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.652750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhghw\" (UniqueName: \"kubernetes.io/projected/a271a217-9b00-40c7-b003-7fd3b03e7e63-kube-api-access-dhghw\") pod \"kuadrant-operator-controller-manager-58fc56757c-t2rr8\" (UID: \"a271a217-9b00-40c7-b003-7fd3b03e7e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:25.652980 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.652867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a271a217-9b00-40c7-b003-7fd3b03e7e63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t2rr8\" (UID: \"a271a217-9b00-40c7-b003-7fd3b03e7e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:25.753963 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.753927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a271a217-9b00-40c7-b003-7fd3b03e7e63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t2rr8\" (UID: \"a271a217-9b00-40c7-b003-7fd3b03e7e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:25.754169 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.754014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhghw\" (UniqueName: \"kubernetes.io/projected/a271a217-9b00-40c7-b003-7fd3b03e7e63-kube-api-access-dhghw\") pod \"kuadrant-operator-controller-manager-58fc56757c-t2rr8\" (UID: \"a271a217-9b00-40c7-b003-7fd3b03e7e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:25.754316 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.754285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a271a217-9b00-40c7-b003-7fd3b03e7e63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t2rr8\" (UID: \"a271a217-9b00-40c7-b003-7fd3b03e7e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:25.762991 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.762955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhghw\" (UniqueName: \"kubernetes.io/projected/a271a217-9b00-40c7-b003-7fd3b03e7e63-kube-api-access-dhghw\") pod \"kuadrant-operator-controller-manager-58fc56757c-t2rr8\" (UID: \"a271a217-9b00-40c7-b003-7fd3b03e7e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:25.901222 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:25.901100    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:26.185246 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:26.185218    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"]
Sep 08 14:41:26.187301 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:41:26.187274    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda271a217_9b00_40c7_b003_7fd3b03e7e63.slice/crio-867ab27033c3608b26f9c684db48602e03d1b3a0c8b75e955251b3701116e2b1 WatchSource:0}: Error finding container 867ab27033c3608b26f9c684db48602e03d1b3a0c8b75e955251b3701116e2b1: Status 404 returned error can't find the container with id 867ab27033c3608b26f9c684db48602e03d1b3a0c8b75e955251b3701116e2b1
Sep 08 14:41:26.367519 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:26.367480    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8" event={"ID":"a271a217-9b00-40c7-b003-7fd3b03e7e63","Type":"ContainerStarted","Data":"867ab27033c3608b26f9c684db48602e03d1b3a0c8b75e955251b3701116e2b1"}
Sep 08 14:41:31.395230 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:31.395193    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8" event={"ID":"a271a217-9b00-40c7-b003-7fd3b03e7e63","Type":"ContainerStarted","Data":"c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db"}
Sep 08 14:41:31.395628 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:31.395332    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:31.448389 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:31.448326    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8" podStartSLOduration=2.310058862 podStartE2EDuration="6.448306427s" totalImagesPullingTime="4.138247565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:41:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:31.446554296 +0000 UTC m=+435.457074311" watchObservedRunningTime="2026-09-08 14:41:31.448306427 +0000 UTC m=+435.458826427"
Sep 08 14:41:37.578343 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:37.578258    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"]
Sep 08 14:41:37.578784 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:37.578460    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8" podUID="a271a217-9b00-40c7-b003-7fd3b03e7e63" containerName="manager" containerID="cri-o://c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db" gracePeriod=10
Sep 08 14:41:37.580504 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:37.580481    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:37.824398 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:37.824372    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:37.865532 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:37.865445    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhghw\" (UniqueName: \"kubernetes.io/projected/a271a217-9b00-40c7-b003-7fd3b03e7e63-kube-api-access-dhghw\") pod \"a271a217-9b00-40c7-b003-7fd3b03e7e63\" (UID: \"a271a217-9b00-40c7-b003-7fd3b03e7e63\") "
Sep 08 14:41:37.865681 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:37.865566    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a271a217-9b00-40c7-b003-7fd3b03e7e63-extensions-socket-volume\") pod \"a271a217-9b00-40c7-b003-7fd3b03e7e63\" (UID: \"a271a217-9b00-40c7-b003-7fd3b03e7e63\") "
Sep 08 14:41:37.866035 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:37.866009    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a271a217-9b00-40c7-b003-7fd3b03e7e63-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a271a217-9b00-40c7-b003-7fd3b03e7e63" (UID: "a271a217-9b00-40c7-b003-7fd3b03e7e63"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:41:37.867937 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:37.867905    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a271a217-9b00-40c7-b003-7fd3b03e7e63-kube-api-access-dhghw" (OuterVolumeSpecName: "kube-api-access-dhghw") pod "a271a217-9b00-40c7-b003-7fd3b03e7e63" (UID: "a271a217-9b00-40c7-b003-7fd3b03e7e63"). InnerVolumeSpecName "kube-api-access-dhghw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:41:37.966635 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:37.966599    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhghw\" (UniqueName: \"kubernetes.io/projected/a271a217-9b00-40c7-b003-7fd3b03e7e63-kube-api-access-dhghw\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:41:37.966635 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:37.966630    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a271a217-9b00-40c7-b003-7fd3b03e7e63-extensions-socket-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:41:38.430119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:38.427915    2561 generic.go:356] "Generic (PLEG): container finished" podID="a271a217-9b00-40c7-b003-7fd3b03e7e63" containerID="c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db" exitCode=0
Sep 08 14:41:38.430119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:38.428017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8" event={"ID":"a271a217-9b00-40c7-b003-7fd3b03e7e63","Type":"ContainerDied","Data":"c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db"}
Sep 08 14:41:38.430119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:38.428069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8" event={"ID":"a271a217-9b00-40c7-b003-7fd3b03e7e63","Type":"ContainerDied","Data":"867ab27033c3608b26f9c684db48602e03d1b3a0c8b75e955251b3701116e2b1"}
Sep 08 14:41:38.430119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:38.428101    2561 scope.go:117] "RemoveContainer" containerID="c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db"
Sep 08 14:41:38.430119 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:38.428303    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"
Sep 08 14:41:38.439093 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:38.439076    2561 scope.go:117] "RemoveContainer" containerID="c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db"
Sep 08 14:41:38.439440 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:41:38.439417    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db\": container with ID starting with c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db not found: ID does not exist" containerID="c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db"
Sep 08 14:41:38.439494 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:38.439450    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db"} err="failed to get container status \"c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db\": rpc error: code = NotFound desc = could not find container \"c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db\": container with ID starting with c50d7cd942dc9cfb51304a1ee66270907fe03f1d0f6812322e05ad80f830f2db not found: ID does not exist"
Sep 08 14:41:38.454927 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:38.454893    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"]
Sep 08 14:41:38.459468 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:38.459444    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t2rr8"]
Sep 08 14:41:38.520188 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:38.520124    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a271a217-9b00-40c7-b003-7fd3b03e7e63" path="/var/lib/kubelet/pods/a271a217-9b00-40c7-b003-7fd3b03e7e63/volumes"
Sep 08 14:41:53.887907 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:53.887874    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"]
Sep 08 14:41:53.888329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:53.888246    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a271a217-9b00-40c7-b003-7fd3b03e7e63" containerName="manager"
Sep 08 14:41:53.888329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:53.888259    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a271a217-9b00-40c7-b003-7fd3b03e7e63" containerName="manager"
Sep 08 14:41:53.888329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:53.888313    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a271a217-9b00-40c7-b003-7fd3b03e7e63" containerName="manager"
Sep 08 14:41:53.892496 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:53.892476    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:53.894876 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:53.894856    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-r9p8x\""
Sep 08 14:41:53.904014 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:53.903987    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"]
Sep 08 14:41:54.011578 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.011541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.011774 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.011591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.011774 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.011648    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.011774 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.011693    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.011774 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.011724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.011774 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.011743    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5b7992a-ef04-4088-b506-255d966c7dfa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.012034 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.011851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.012034 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.011867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.012034 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.011936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzpnw\" (UniqueName: \"kubernetes.io/projected/d5b7992a-ef04-4088-b506-255d966c7dfa-kube-api-access-dzpnw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.112741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.112703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.112741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.112739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113020 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.112770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzpnw\" (UniqueName: \"kubernetes.io/projected/d5b7992a-ef04-4088-b506-255d966c7dfa-kube-api-access-dzpnw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113020 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.112799    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113020 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.112823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113020 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.112845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113020 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.112873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113020 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.112902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113020 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.112938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5b7992a-ef04-4088-b506-255d966c7dfa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113369 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.113242    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113427 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.113363    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113427 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.113383    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113500 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.113419    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.113990 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.113970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5b7992a-ef04-4088-b506-255d966c7dfa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.115355 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.115329    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.115574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.115555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.121042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.121018    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5b7992a-ef04-4088-b506-255d966c7dfa-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.121581 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.121563    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzpnw\" (UniqueName: \"kubernetes.io/projected/d5b7992a-ef04-4088-b506-255d966c7dfa-kube-api-access-dzpnw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-mm2f9\" (UID: \"d5b7992a-ef04-4088-b506-255d966c7dfa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.203791 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.203693    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:54.481157 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.481101    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"]
Sep 08 14:41:54.487752 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:41:54.487723    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b7992a_ef04_4088_b506_255d966c7dfa.slice/crio-25b97618fccc90fc00df042b67da3609265bb52c8eaed59e5c5f6b9d4c8aa7cc WatchSource:0}: Error finding container 25b97618fccc90fc00df042b67da3609265bb52c8eaed59e5c5f6b9d4c8aa7cc: Status 404 returned error can't find the container with id 25b97618fccc90fc00df042b67da3609265bb52c8eaed59e5c5f6b9d4c8aa7cc
Sep 08 14:41:54.490358 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.490319    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:41:54.490468 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.490387    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:41:54.490468 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.490416    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:41:54.500601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:54.500573    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9" event={"ID":"d5b7992a-ef04-4088-b506-255d966c7dfa","Type":"ContainerStarted","Data":"25b97618fccc90fc00df042b67da3609265bb52c8eaed59e5c5f6b9d4c8aa7cc"}
Sep 08 14:41:55.506689 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:55.506655    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9" event={"ID":"d5b7992a-ef04-4088-b506-255d966c7dfa","Type":"ContainerStarted","Data":"3cd6a76b4e104f36d8dfb7c8474b0193a0170979d598b223e1293b8c29ea4cdd"}
Sep 08 14:41:55.526562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:55.526507    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9" podStartSLOduration=2.526492835 podStartE2EDuration="2.526492835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:41:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:55.52477666 +0000 UTC m=+459.535296659" watchObservedRunningTime="2026-09-08 14:41:55.526492835 +0000 UTC m=+459.537012832"
Sep 08 14:41:56.204188 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:56.204086    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:56.209039 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:56.209012    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:56.511562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:56.511527    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:41:56.512685 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:41:56.512665    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:42:28.466607 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.466575    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"]
Sep 08 14:42:28.471489 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.471461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"
Sep 08 14:42:28.473808 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.473780    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:42:28.473808 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.473780    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 14:42:28.474014 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.473827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-cpxk5\""
Sep 08 14:42:28.474014 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.473822    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 14:42:28.479947 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.479924    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"]
Sep 08 14:42:28.530519 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.530490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c36b18cb-5643-4666-86b0-a2ff407c1aed-data\") pod \"postgres-69fb4594cf-ngndh\" (UID: \"c36b18cb-5643-4666-86b0-a2ff407c1aed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"
Sep 08 14:42:28.530696 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.530537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9wf9\" (UniqueName: \"kubernetes.io/projected/c36b18cb-5643-4666-86b0-a2ff407c1aed-kube-api-access-q9wf9\") pod \"postgres-69fb4594cf-ngndh\" (UID: \"c36b18cb-5643-4666-86b0-a2ff407c1aed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"
Sep 08 14:42:28.631436 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.631397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c36b18cb-5643-4666-86b0-a2ff407c1aed-data\") pod \"postgres-69fb4594cf-ngndh\" (UID: \"c36b18cb-5643-4666-86b0-a2ff407c1aed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"
Sep 08 14:42:28.631639 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.631456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9wf9\" (UniqueName: \"kubernetes.io/projected/c36b18cb-5643-4666-86b0-a2ff407c1aed-kube-api-access-q9wf9\") pod \"postgres-69fb4594cf-ngndh\" (UID: \"c36b18cb-5643-4666-86b0-a2ff407c1aed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"
Sep 08 14:42:28.631834 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.631812    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c36b18cb-5643-4666-86b0-a2ff407c1aed-data\") pod \"postgres-69fb4594cf-ngndh\" (UID: \"c36b18cb-5643-4666-86b0-a2ff407c1aed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"
Sep 08 14:42:28.643066 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.643033    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9wf9\" (UniqueName: \"kubernetes.io/projected/c36b18cb-5643-4666-86b0-a2ff407c1aed-kube-api-access-q9wf9\") pod \"postgres-69fb4594cf-ngndh\" (UID: \"c36b18cb-5643-4666-86b0-a2ff407c1aed\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"
Sep 08 14:42:28.783474 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:28.783438    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"
Sep 08 14:42:29.055866 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:29.055782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"]
Sep 08 14:42:29.059417 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:42:29.059392    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36b18cb_5643_4666_86b0_a2ff407c1aed.slice/crio-49902cb95bce560e20129713c0fd4045cb84f2be7dfd8212966e0eda6dd6e2ae WatchSource:0}: Error finding container 49902cb95bce560e20129713c0fd4045cb84f2be7dfd8212966e0eda6dd6e2ae: Status 404 returned error can't find the container with id 49902cb95bce560e20129713c0fd4045cb84f2be7dfd8212966e0eda6dd6e2ae
Sep 08 14:42:29.648426 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:29.648377    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh" event={"ID":"c36b18cb-5643-4666-86b0-a2ff407c1aed","Type":"ContainerStarted","Data":"49902cb95bce560e20129713c0fd4045cb84f2be7dfd8212966e0eda6dd6e2ae"}
Sep 08 14:42:34.677139 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:34.677109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh" event={"ID":"c36b18cb-5643-4666-86b0-a2ff407c1aed","Type":"ContainerStarted","Data":"8c023961a3f3d2757685dfaab7a14394b2472e9ebe97f542098dcf8dcaf77de5"}
Sep 08 14:42:34.677529 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:34.677254    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"
Sep 08 14:42:34.694214 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:34.694159    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh" podStartSLOduration=1.254168683 podStartE2EDuration="6.694124373s" totalImagesPullingTime="5.43995569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:42:34.692457554 +0000 UTC m=+498.702977553" watchObservedRunningTime="2026-09-08 14:42:34.694124373 +0000 UTC m=+498.704644370"
Sep 08 14:42:40.711947 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:40.711916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngndh"
Sep 08 14:42:47.940830 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:47.940791    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dd98f69d7-d6kwc"]
Sep 08 14:42:47.966559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:47.966518    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dd98f69d7-d6kwc"]
Sep 08 14:42:47.966741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:47.966650    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:47.969432 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:47.969404    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 14:42:47.969676 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:47.969439    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 14:42:47.969895 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:47.969441    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 14:42:47.969981 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:47.969454    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xvj5m\""
Sep 08 14:42:48.113539 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.113500    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgfwm\" (UniqueName: \"kubernetes.io/projected/438aee58-6ca7-4d0c-adcb-9621d6d798bd-kube-api-access-fgfwm\") pod \"maas-controller-7dd98f69d7-d6kwc\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") " pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:48.113760 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.113584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-webhook-cert\") pod \"maas-controller-7dd98f69d7-d6kwc\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") " pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:48.113760 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.113665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-metrics-certs\") pod \"maas-controller-7dd98f69d7-d6kwc\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") " pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:48.215045 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.214940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgfwm\" (UniqueName: \"kubernetes.io/projected/438aee58-6ca7-4d0c-adcb-9621d6d798bd-kube-api-access-fgfwm\") pod \"maas-controller-7dd98f69d7-d6kwc\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") " pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:48.215045 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.215020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-webhook-cert\") pod \"maas-controller-7dd98f69d7-d6kwc\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") " pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:48.215310 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.215107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-metrics-certs\") pod \"maas-controller-7dd98f69d7-d6kwc\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") " pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:48.215310 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:42:48.215283    2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 08 14:42:48.215473 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:42:48.215352    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-metrics-certs podName:438aee58-6ca7-4d0c-adcb-9621d6d798bd nodeName:}" failed. No retries permitted until 2026-09-08 14:42:48.715331221 +0000 UTC m=+512.725851220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-metrics-certs") pod "maas-controller-7dd98f69d7-d6kwc" (UID: "438aee58-6ca7-4d0c-adcb-9621d6d798bd") : secret "maas-controller-metrics-tls" not found
Sep 08 14:42:48.218159 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.218117    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-webhook-cert\") pod \"maas-controller-7dd98f69d7-d6kwc\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") " pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:48.227159 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.227123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgfwm\" (UniqueName: \"kubernetes.io/projected/438aee58-6ca7-4d0c-adcb-9621d6d798bd-kube-api-access-fgfwm\") pod \"maas-controller-7dd98f69d7-d6kwc\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") " pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:48.720722 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.720677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-metrics-certs\") pod \"maas-controller-7dd98f69d7-d6kwc\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") " pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:48.723342 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.723311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-metrics-certs\") pod \"maas-controller-7dd98f69d7-d6kwc\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") " pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:48.879886 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:48.879823    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:49.159242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:49.159217    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dd98f69d7-d6kwc"]
Sep 08 14:42:49.161586 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:42:49.161556    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438aee58_6ca7_4d0c_adcb_9621d6d798bd.slice/crio-e3879301f129647a028ff900a6ad7506368c1a7ee9a85a06486dc865653f2181 WatchSource:0}: Error finding container e3879301f129647a028ff900a6ad7506368c1a7ee9a85a06486dc865653f2181: Status 404 returned error can't find the container with id e3879301f129647a028ff900a6ad7506368c1a7ee9a85a06486dc865653f2181
Sep 08 14:42:49.745795 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:49.745756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc" event={"ID":"438aee58-6ca7-4d0c-adcb-9621d6d798bd","Type":"ContainerStarted","Data":"e3879301f129647a028ff900a6ad7506368c1a7ee9a85a06486dc865653f2181"}
Sep 08 14:42:52.761685 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:52.761587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc" event={"ID":"438aee58-6ca7-4d0c-adcb-9621d6d798bd","Type":"ContainerStarted","Data":"8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c"}
Sep 08 14:42:52.761685 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:52.761674    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:42:52.784408 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:42:52.784350    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc" podStartSLOduration=2.452925043 podStartE2EDuration="5.784326521s" totalImagesPullingTime="3.331401478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:42:52.783717427 +0000 UTC m=+516.794237423" watchObservedRunningTime="2026-09-08 14:42:52.784326521 +0000 UTC m=+516.794846520"
Sep 08 14:43:03.028461 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.028425    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dd98f69d7-d6kwc"]
Sep 08 14:43:03.029018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.028633    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc" podUID="438aee58-6ca7-4d0c-adcb-9621d6d798bd" containerName="manager" containerID="cri-o://8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c" gracePeriod=30
Sep 08 14:43:03.030338 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.030315    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:43:03.272402 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.272378    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:43:03.346417 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.346331    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgfwm\" (UniqueName: \"kubernetes.io/projected/438aee58-6ca7-4d0c-adcb-9621d6d798bd-kube-api-access-fgfwm\") pod \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") "
Sep 08 14:43:03.346560 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.346426    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-webhook-cert\") pod \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") "
Sep 08 14:43:03.346560 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.346473    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-metrics-certs\") pod \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\" (UID: \"438aee58-6ca7-4d0c-adcb-9621d6d798bd\") "
Sep 08 14:43:03.348940 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.348905    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "438aee58-6ca7-4d0c-adcb-9621d6d798bd" (UID: "438aee58-6ca7-4d0c-adcb-9621d6d798bd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:43:03.348940 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.348900    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "438aee58-6ca7-4d0c-adcb-9621d6d798bd" (UID: "438aee58-6ca7-4d0c-adcb-9621d6d798bd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:43:03.349130 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.348987    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/438aee58-6ca7-4d0c-adcb-9621d6d798bd-kube-api-access-fgfwm" (OuterVolumeSpecName: "kube-api-access-fgfwm") pod "438aee58-6ca7-4d0c-adcb-9621d6d798bd" (UID: "438aee58-6ca7-4d0c-adcb-9621d6d798bd"). InnerVolumeSpecName "kube-api-access-fgfwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:43:03.447632 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.447588    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-webhook-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:43:03.447632 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.447625    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/438aee58-6ca7-4d0c-adcb-9621d6d798bd-metrics-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:43:03.447632 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.447638    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgfwm\" (UniqueName: \"kubernetes.io/projected/438aee58-6ca7-4d0c-adcb-9621d6d798bd-kube-api-access-fgfwm\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:43:03.811894 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.811838    2561 generic.go:356] "Generic (PLEG): container finished" podID="438aee58-6ca7-4d0c-adcb-9621d6d798bd" containerID="8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c" exitCode=0
Sep 08 14:43:03.812082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.811923    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc"
Sep 08 14:43:03.812082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.811954    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc" event={"ID":"438aee58-6ca7-4d0c-adcb-9621d6d798bd","Type":"ContainerDied","Data":"8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c"}
Sep 08 14:43:03.812082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.812040    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd98f69d7-d6kwc" event={"ID":"438aee58-6ca7-4d0c-adcb-9621d6d798bd","Type":"ContainerDied","Data":"e3879301f129647a028ff900a6ad7506368c1a7ee9a85a06486dc865653f2181"}
Sep 08 14:43:03.812082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.812062    2561 scope.go:117] "RemoveContainer" containerID="8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c"
Sep 08 14:43:03.823585 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.823566    2561 scope.go:117] "RemoveContainer" containerID="8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c"
Sep 08 14:43:03.824332 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:43:03.824299    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c\": container with ID starting with 8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c not found: ID does not exist" containerID="8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c"
Sep 08 14:43:03.824471 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.824343    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c"} err="failed to get container status \"8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c\": rpc error: code = NotFound desc = could not find container \"8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c\": container with ID starting with 8ba6e289c631102455b9e8b3128bf09a10941072d1288848e2b7f5b6ffc5091c not found: ID does not exist"
Sep 08 14:43:03.834043 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.834007    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dd98f69d7-d6kwc"]
Sep 08 14:43:03.839513 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:03.839484    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dd98f69d7-d6kwc"]
Sep 08 14:43:04.520214 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:04.520180    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="438aee58-6ca7-4d0c-adcb-9621d6d798bd" path="/var/lib/kubelet/pods/438aee58-6ca7-4d0c-adcb-9621d6d798bd/volumes"
Sep 08 14:43:35.956970 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:35.956924    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5b7992a-ef04-4088-b506-255d966c7dfa" containerID="3cd6a76b4e104f36d8dfb7c8474b0193a0170979d598b223e1293b8c29ea4cdd" exitCode=0
Sep 08 14:43:35.957417 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:35.956997    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9" event={"ID":"d5b7992a-ef04-4088-b506-255d966c7dfa","Type":"ContainerDied","Data":"3cd6a76b4e104f36d8dfb7c8474b0193a0170979d598b223e1293b8c29ea4cdd"}
Sep 08 14:43:35.957507 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:35.957489    2561 scope.go:117] "RemoveContainer" containerID="3cd6a76b4e104f36d8dfb7c8474b0193a0170979d598b223e1293b8c29ea4cdd"
Sep 08 14:43:35.958542 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:35.958515    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:43:35.958611 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:35.958589    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:43:35.958651 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:35.958622    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:43:36.963216 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:36.963180    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9" event={"ID":"d5b7992a-ef04-4088-b506-255d966c7dfa","Type":"ContainerStarted","Data":"d436aebdc7472a6ddb379a67fa9dcdef74f95c4b6e2924700466946dacadd363"}
Sep 08 14:43:37.204243 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:37.204198    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:43:37.205542 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:37.205504    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-mm2f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 08 14:43:37.205687 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:37.205583    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9" podUID="d5b7992a-ef04-4088-b506-255d966c7dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 08 14:43:38.205032 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:38.204991    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-mm2f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 08 14:43:38.205672 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:38.205634    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9" podUID="d5b7992a-ef04-4088-b506-255d966c7dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 08 14:43:39.204461 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:39.204409    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-mm2f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 08 14:43:39.204691 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:39.204489    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9" podUID="d5b7992a-ef04-4088-b506-255d966c7dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 08 14:43:40.204581 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:40.204535    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-mm2f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 08 14:43:40.205087 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:40.204618    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9" podUID="d5b7992a-ef04-4088-b506-255d966c7dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 08 14:43:41.204402 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:41.204344    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-mm2f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 08 14:43:41.204677 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:41.204422    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9" podUID="d5b7992a-ef04-4088-b506-255d966c7dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 08 14:43:41.511834 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:41.511789    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:43:42.208384 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:42.208355    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:43:42.209289 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:42.209270    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-mm2f9"
Sep 08 14:43:57.351058 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.351017    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"]
Sep 08 14:43:57.351544 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.351391    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438aee58-6ca7-4d0c-adcb-9621d6d798bd" containerName="manager"
Sep 08 14:43:57.351544 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.351405    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="438aee58-6ca7-4d0c-adcb-9621d6d798bd" containerName="manager"
Sep 08 14:43:57.351544 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.351479    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="438aee58-6ca7-4d0c-adcb-9621d6d798bd" containerName="manager"
Sep 08 14:43:57.354664 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.354645    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.356974 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.356948    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 14:43:57.357094 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.357080    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 14:43:57.357618 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.357596    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 08 14:43:57.357699 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.357677    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cmtn4\""
Sep 08 14:43:57.366816 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.366792    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"]
Sep 08 14:43:57.455540 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.455501    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmmjh\" (UniqueName: \"kubernetes.io/projected/9e5ff97a-0489-412e-8a1b-30436289aab3-kube-api-access-lmmjh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.455718 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.455569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5ff97a-0489-412e-8a1b-30436289aab3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.455718 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.455626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.455718 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.455667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.455841 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.455715    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.455841 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.455735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.557104 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.557068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.557104 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.557104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.557334 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.557131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.557334 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.557166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.557334 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.557188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmmjh\" (UniqueName: \"kubernetes.io/projected/9e5ff97a-0489-412e-8a1b-30436289aab3-kube-api-access-lmmjh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.557334 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.557230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5ff97a-0489-412e-8a1b-30436289aab3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.557626 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.557599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.557800 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.557612    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.557871 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.557682    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.559473 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.559449    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e5ff97a-0489-412e-8a1b-30436289aab3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.560169 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.560119    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5ff97a-0489-412e-8a1b-30436289aab3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.565706 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.565685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmmjh\" (UniqueName: \"kubernetes.io/projected/9e5ff97a-0489-412e-8a1b-30436289aab3-kube-api-access-lmmjh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j\" (UID: \"9e5ff97a-0489-412e-8a1b-30436289aab3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.667907 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.667800    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:43:57.941677 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:57.941650    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"]
Sep 08 14:43:57.944094 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:43:57.944056    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5ff97a_0489_412e_8a1b_30436289aab3.slice/crio-8e569cee49ddc4df57f77442ce190e67cc3dca9f93dfca95278369fd839e27e6 WatchSource:0}: Error finding container 8e569cee49ddc4df57f77442ce190e67cc3dca9f93dfca95278369fd839e27e6: Status 404 returned error can't find the container with id 8e569cee49ddc4df57f77442ce190e67cc3dca9f93dfca95278369fd839e27e6
Sep 08 14:43:58.060070 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:43:58.060032    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j" event={"ID":"9e5ff97a-0489-412e-8a1b-30436289aab3","Type":"ContainerStarted","Data":"8e569cee49ddc4df57f77442ce190e67cc3dca9f93dfca95278369fd839e27e6"}
Sep 08 14:44:00.072536 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:00.072503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j" event={"ID":"9e5ff97a-0489-412e-8a1b-30436289aab3","Type":"ContainerStarted","Data":"20c35a59f6d28f5223662f7064466c55da29803ce2f8633ed9de0ead499e6b39"}
Sep 08 14:44:00.091712 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:00.091650    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j" podStartSLOduration=1.909358388 podStartE2EDuration="3.091632012s" totalImagesPullingTime="1.182273624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:43:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:44:00.091024037 +0000 UTC m=+584.101544035" watchObservedRunningTime="2026-09-08 14:44:00.091632012 +0000 UTC m=+584.102152006"
Sep 08 14:44:07.668797 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:07.668762    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:44:07.669288 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:07.668831    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:44:07.681461 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:07.681436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:44:08.120065 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:08.120026    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j"
Sep 08 14:44:11.156918 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.156887    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"]
Sep 08 14:44:11.160313 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.160288    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.162454 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.162426    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 08 14:44:11.171804 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.171773    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"]
Sep 08 14:44:11.285753 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.285719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.285753 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.285759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rgz\" (UniqueName: \"kubernetes.io/projected/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-kube-api-access-w7rgz\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.286002 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.285780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.286002 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.285855    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.286002 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.285909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.286002 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.285942    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.386483 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.386446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.386483 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.386485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rgz\" (UniqueName: \"kubernetes.io/projected/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-kube-api-access-w7rgz\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.386700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.386516    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.386700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.386555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.386700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.386603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.386700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.386644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.386952 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.386928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.387027 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.386976    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.387111 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.387090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.388978 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.388958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.389259 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.389243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.395301 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.395282    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rgz\" (UniqueName: \"kubernetes.io/projected/f66de2e2-976b-41c0-9a3e-8db3dea6e6e3-kube-api-access-w7rgz\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs\" (UID: \"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.472112 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.472078    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:11.746425 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:11.746402    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"]
Sep 08 14:44:11.749070 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:44:11.749039    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66de2e2_976b_41c0_9a3e_8db3dea6e6e3.slice/crio-87bfb04d9ae181cf0b6bc01b8ac43f8a6b9dfca8f8f19979fba5c1c1c274ab1b WatchSource:0}: Error finding container 87bfb04d9ae181cf0b6bc01b8ac43f8a6b9dfca8f8f19979fba5c1c1c274ab1b: Status 404 returned error can't find the container with id 87bfb04d9ae181cf0b6bc01b8ac43f8a6b9dfca8f8f19979fba5c1c1c274ab1b
Sep 08 14:44:12.126969 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:12.126927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs" event={"ID":"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3","Type":"ContainerStarted","Data":"8092a0e00304540056a8c97098974ec2c3f10eb9bb69cac4d13c9db478dca491"}
Sep 08 14:44:12.127113 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:12.126992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs" event={"ID":"f66de2e2-976b-41c0-9a3e-8db3dea6e6e3","Type":"ContainerStarted","Data":"87bfb04d9ae181cf0b6bc01b8ac43f8a6b9dfca8f8f19979fba5c1c1c274ab1b"}
Sep 08 14:44:12.150832 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:12.150766    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs" podStartSLOduration=0.942262636 podStartE2EDuration="1.150742411s" totalImagesPullingTime="208.479775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:44:12.149527408 +0000 UTC m=+596.160047417" watchObservedRunningTime="2026-09-08 14:44:12.150742411 +0000 UTC m=+596.161262408"
Sep 08 14:44:16.457368 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:16.457338    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:44:16.457801 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:16.457501    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:44:21.472879 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:21.472835    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:21.473405 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:21.472913    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:21.484924 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:21.484885    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:44:22.181415 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:44:22.181387    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs"
Sep 08 14:45:00.153792 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:00.153754    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf"]
Sep 08 14:45:00.157883 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:00.157861    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf"
Sep 08 14:45:00.159997 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:00.159965    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pdpbl\""
Sep 08 14:45:00.165339 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:00.165312    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf"]
Sep 08 14:45:00.170570 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:00.170546    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf"
Sep 08 14:45:00.442584 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:00.442560    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf"]
Sep 08 14:45:00.445402 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:45:00.445373    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf84ddc_1f6b_4cd9_af94_37d610d5e965.slice/crio-99809aecb3790214a34f41bab8837aae4dc1062106307aeaf11c4138d1373378 WatchSource:0}: Error finding container 99809aecb3790214a34f41bab8837aae4dc1062106307aeaf11c4138d1373378: Status 404 returned error can't find the container with id 99809aecb3790214a34f41bab8837aae4dc1062106307aeaf11c4138d1373378
Sep 08 14:45:00.447208 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:00.447193    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:45:01.355154 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:01.355122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf" event={"ID":"9cf84ddc-1f6b-4cd9-af94-37d610d5e965","Type":"ContainerStarted","Data":"99809aecb3790214a34f41bab8837aae4dc1062106307aeaf11c4138d1373378"}
Sep 08 14:45:03.367346 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:03.367264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf" event={"ID":"9cf84ddc-1f6b-4cd9-af94-37d610d5e965","Type":"ContainerStarted","Data":"e2ace8ee37efc2cb30474b3ce057c4442a2e2aeb7f385c579fb51af19aa8ede5"}
Sep 08 14:45:03.389113 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:03.389063    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf" podStartSLOduration=0.835704987 podStartE2EDuration="3.389046841s" totalImagesPullingTime="2.553341854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:45:03.387048381 +0000 UTC m=+647.397568379" watchObservedRunningTime="2026-09-08 14:45:03.389046841 +0000 UTC m=+647.399566877"
Sep 08 14:45:04.373013 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:04.372980    2561 generic.go:356] "Generic (PLEG): container finished" podID="9cf84ddc-1f6b-4cd9-af94-37d610d5e965" containerID="e2ace8ee37efc2cb30474b3ce057c4442a2e2aeb7f385c579fb51af19aa8ede5" exitCode=0
Sep 08 14:45:04.373414 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:04.373050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf" event={"ID":"9cf84ddc-1f6b-4cd9-af94-37d610d5e965","Type":"ContainerDied","Data":"e2ace8ee37efc2cb30474b3ce057c4442a2e2aeb7f385c579fb51af19aa8ede5"}
Sep 08 14:45:05.509169 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:05.509123    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf"
Sep 08 14:45:06.382926 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:06.382895    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf"
Sep 08 14:45:06.383071 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:06.382927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-t7mhf" event={"ID":"9cf84ddc-1f6b-4cd9-af94-37d610d5e965","Type":"ContainerDied","Data":"99809aecb3790214a34f41bab8837aae4dc1062106307aeaf11c4138d1373378"}
Sep 08 14:45:06.383071 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:45:06.382968    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99809aecb3790214a34f41bab8837aae4dc1062106307aeaf11c4138d1373378"
Sep 08 14:46:02.426043 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.426005    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"]
Sep 08 14:46:02.426589 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.426375    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf84ddc-1f6b-4cd9-af94-37d610d5e965" containerName="cleanup"
Sep 08 14:46:02.426589 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.426387    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf84ddc-1f6b-4cd9-af94-37d610d5e965" containerName="cleanup"
Sep 08 14:46:02.426589 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.426447    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf84ddc-1f6b-4cd9-af94-37d610d5e965" containerName="cleanup"
Sep 08 14:46:02.429479 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.429459    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.432567 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.432543    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-798a5d-openshift-default-dockercfg-s645h\""
Sep 08 14:46:02.445739 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.445713    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"]
Sep 08 14:46:02.523890 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.523830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-token\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.523890 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.523887    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-socket\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.524094 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.523914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24f853ef-de53-4b60-8ce2-b3330ca822af-istiod-ca-cert\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.524094 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.523937    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-data\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.524094 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.523972    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxt6f\" (UniqueName: \"kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-kube-api-access-bxt6f\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.524094 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.524030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-envoy\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.524094 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.524071    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-credential-socket\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.524291 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.524101    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-certs\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.524291 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.524215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-podinfo\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.625632 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.625593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-podinfo\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.625831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.625660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-token\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.625831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.625776    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-socket\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.625831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.625811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24f853ef-de53-4b60-8ce2-b3330ca822af-istiod-ca-cert\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.625993 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.625832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-data\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.625993 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.625877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxt6f\" (UniqueName: \"kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-kube-api-access-bxt6f\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.625993 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.625913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-envoy\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.625993 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.625942    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-credential-socket\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.625993 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.625989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-certs\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.626326 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.626301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-data\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.626394 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.626358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-certs\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.626548 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.626523    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-socket\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.626677 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.626623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24f853ef-de53-4b60-8ce2-b3330ca822af-istiod-ca-cert\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.626885 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.626862    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-credential-socket\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.628496 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.628472    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-podinfo\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.628606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.628502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-envoy\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.643653 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.636075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxt6f\" (UniqueName: \"kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-kube-api-access-bxt6f\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.644556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.644532    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-token\") pod \"e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") " pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:02.742809 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:02.742775    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:03.028690 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:03.028663    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"]
Sep 08 14:46:03.030134 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:46:03.030097    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f853ef_de53_4b60_8ce2_b3330ca822af.slice/crio-671ea50f3fdcd8724f8e5d965a87e8b2662b26105c15399107c5e0f386ef5c9d WatchSource:0}: Error finding container 671ea50f3fdcd8724f8e5d965a87e8b2662b26105c15399107c5e0f386ef5c9d: Status 404 returned error can't find the container with id 671ea50f3fdcd8724f8e5d965a87e8b2662b26105c15399107c5e0f386ef5c9d
Sep 08 14:46:03.032468 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:03.032426    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:03.032541 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:03.032519    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:03.032578 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:03.032566    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:03.645002 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:03.644957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" event={"ID":"24f853ef-de53-4b60-8ce2-b3330ca822af","Type":"ContainerStarted","Data":"008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e"}
Sep 08 14:46:03.645396 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:03.645021    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" event={"ID":"24f853ef-de53-4b60-8ce2-b3330ca822af","Type":"ContainerStarted","Data":"671ea50f3fdcd8724f8e5d965a87e8b2662b26105c15399107c5e0f386ef5c9d"}
Sep 08 14:46:03.679347 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:03.679293    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" podStartSLOduration=1.679276986 podStartE2EDuration="1.679276986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:03.678133364 +0000 UTC m=+707.688653387" watchObservedRunningTime="2026-09-08 14:46:03.679276986 +0000 UTC m=+707.689796984"
Sep 08 14:46:03.742918 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:03.742886    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:04.749056 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:04.749026    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:05.655220 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:05.655184    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:05.656556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:05.656536    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:10.964288 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:10.964201    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"]
Sep 08 14:46:10.967764 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:10.967741    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:10.970155 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:10.970118    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3af37e0c-openshift-default-dockercfg-6mmlz\""
Sep 08 14:46:10.986095 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:10.986063    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"]
Sep 08 14:46:11.005898 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.005857    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjpsq\" (UniqueName: \"kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-kube-api-access-zjpsq\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.006060 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.005900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istiod-ca-cert\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.006060 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.005934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-podinfo\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.006060 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.006027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-credential-socket\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.006242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.006070    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-envoy\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.006242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.006138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-data\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.006242 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.006197    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-certs\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.006379 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.006296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-token\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.006379 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.006359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-socket\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.105629 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.105593    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"]
Sep 08 14:46:11.107890 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.107834    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-data\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108052 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.107893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-certs\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108052 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.107982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-token\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108201 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.108054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-socket\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108201 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.108121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjpsq\" (UniqueName: \"kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-kube-api-access-zjpsq\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108201 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.108175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istiod-ca-cert\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108388 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.108206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-podinfo\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108388 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.108242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-credential-socket\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108388 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.108270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-envoy\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108388 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.108307    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-data\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108388 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.108332    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-certs\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108651 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.108427    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-socket\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.108710 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.108682    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-credential-socket\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.109223 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.109184    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istiod-ca-cert\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.109372 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.109296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.110869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.110842    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-envoy\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.110991 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.110973    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-podinfo\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.115025 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.114995    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-71518b-openshift-default-dockercfg-gqsrv\""
Sep 08 14:46:11.131107 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.130786    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjpsq\" (UniqueName: \"kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-kube-api-access-zjpsq\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.136723 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.136695    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"]
Sep 08 14:46:11.139517 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.139494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-token\") pod \"e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") " pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.211351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.209601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e79fc882-4514-48ed-9dff-db183cf97c00-istiod-ca-cert\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.211351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.209654    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-certs\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.211351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.209684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-data\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.211351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.209718    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e79fc882-4514-48ed-9dff-db183cf97c00-istio-podinfo\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.211351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.209823    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-credential-socket\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.211351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.209859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn7n7\" (UniqueName: \"kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-kube-api-access-cn7n7\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.211351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.209904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-socket\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.211351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.209933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-istio-token\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.211351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.209962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-envoy\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.279052 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.279015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:11.310717 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.310684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-istio-token\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.310901 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.310736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-envoy\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.310901 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.310783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e79fc882-4514-48ed-9dff-db183cf97c00-istiod-ca-cert\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.310901 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.310807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-certs\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.310901 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.310836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-data\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.310901 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.310867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e79fc882-4514-48ed-9dff-db183cf97c00-istio-podinfo\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.311172 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.310966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-credential-socket\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.311172 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.311005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn7n7\" (UniqueName: \"kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-kube-api-access-cn7n7\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.311172 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.311057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-socket\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.311397 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.311374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-certs\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.311516 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.311447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-socket\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.311633 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.311584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e79fc882-4514-48ed-9dff-db183cf97c00-istiod-ca-cert\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.311721 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.311621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-data\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.311721 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.311707    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-credential-socket\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.313745 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.313720    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-envoy\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.314094 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.314077    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e79fc882-4514-48ed-9dff-db183cf97c00-istio-podinfo\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.319463 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.319436    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-istio-token\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.319713 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.319698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn7n7\" (UniqueName: \"kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-kube-api-access-cn7n7\") pod \"e2e-autores-71518b-openshift-default-796cf4cc46-jcq88\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") " pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.455217 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.455181    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:11.569817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.569792    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"]
Sep 08 14:46:11.571682 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:46:11.571653    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3bcf08_b3d6_4f05_9236_34c4902776c5.slice/crio-ebcff9e3686074f5016a8433f218c5e54c497ea1b57dc53f7228d6662b07b40f WatchSource:0}: Error finding container ebcff9e3686074f5016a8433f218c5e54c497ea1b57dc53f7228d6662b07b40f: Status 404 returned error can't find the container with id ebcff9e3686074f5016a8433f218c5e54c497ea1b57dc53f7228d6662b07b40f
Sep 08 14:46:11.573911 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.573876    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:11.574006 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.573964    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:11.574065 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.574008    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:11.686960 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.686923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" event={"ID":"4b3bcf08-b3d6-4f05-9236-34c4902776c5","Type":"ContainerStarted","Data":"eb448ee3c089718b81d326e672dd1fd1db8dea97c48fc989c82484dd3f29334e"}
Sep 08 14:46:11.687098 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.686985    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" event={"ID":"4b3bcf08-b3d6-4f05-9236-34c4902776c5","Type":"ContainerStarted","Data":"ebcff9e3686074f5016a8433f218c5e54c497ea1b57dc53f7228d6662b07b40f"}
Sep 08 14:46:11.714588 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.714523    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" podStartSLOduration=1.714502352 podStartE2EDuration="1.714502352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:11.711931779 +0000 UTC m=+715.722451778" watchObservedRunningTime="2026-09-08 14:46:11.714502352 +0000 UTC m=+715.725022351"
Sep 08 14:46:11.744127 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.744093    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"]
Sep 08 14:46:11.747799 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:46:11.747765    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79fc882_4514_48ed_9dff_db183cf97c00.slice/crio-85c12788b59391927488e558a60d74da661a25fd9fcdde2dfb12e360e77dd756 WatchSource:0}: Error finding container 85c12788b59391927488e558a60d74da661a25fd9fcdde2dfb12e360e77dd756: Status 404 returned error can't find the container with id 85c12788b59391927488e558a60d74da661a25fd9fcdde2dfb12e360e77dd756
Sep 08 14:46:11.750278 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.750242    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:11.750369 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.750314    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:11.750369 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:11.750341    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:12.280023 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:12.279978    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:12.285163 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:12.285123    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:12.694614 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:12.694516    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" event={"ID":"e79fc882-4514-48ed-9dff-db183cf97c00","Type":"ContainerStarted","Data":"3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b"}
Sep 08 14:46:12.694614 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:12.694573    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" event={"ID":"e79fc882-4514-48ed-9dff-db183cf97c00","Type":"ContainerStarted","Data":"85c12788b59391927488e558a60d74da661a25fd9fcdde2dfb12e360e77dd756"}
Sep 08 14:46:12.694848 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:12.694784    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:12.695908 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:12.695885    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:12.734335 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:12.734271    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" podStartSLOduration=1.7342482019999998 podStartE2EDuration="1.734248202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:12.729108592 +0000 UTC m=+716.739628590" watchObservedRunningTime="2026-09-08 14:46:12.734248202 +0000 UTC m=+716.744768200"
Sep 08 14:46:13.456343 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:13.456297    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:13.464189 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:13.464127    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:13.702559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:13.702531    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:13.707725 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:13.707631    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:16.941047 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:16.941013    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"]
Sep 08 14:46:16.944581 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:16.944564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:46:16.946890 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:16.946869    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-71518b-dockercfg-zcsl6\""
Sep 08 14:46:16.946990 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:16.946868    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-71518b\""
Sep 08 14:46:16.956261 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:16.956235    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"]
Sep 08 14:46:17.077746 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:17.077709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6t5k\" (UniqueName: \"kubernetes.io/projected/6687e7e0-a140-42f3-ad7c-0cc4a1464701-kube-api-access-p6t5k\") pod \"payload-processing-e2e-autores-71518b-579b68988f-9gdtb\" (UID: \"6687e7e0-a140-42f3-ad7c-0cc4a1464701\") " pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:46:17.077746 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:17.077750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6687e7e0-a140-42f3-ad7c-0cc4a1464701-plugins-config-volume\") pod \"payload-processing-e2e-autores-71518b-579b68988f-9gdtb\" (UID: \"6687e7e0-a140-42f3-ad7c-0cc4a1464701\") " pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:46:17.178565 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:17.178529    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6t5k\" (UniqueName: \"kubernetes.io/projected/6687e7e0-a140-42f3-ad7c-0cc4a1464701-kube-api-access-p6t5k\") pod \"payload-processing-e2e-autores-71518b-579b68988f-9gdtb\" (UID: \"6687e7e0-a140-42f3-ad7c-0cc4a1464701\") " pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:46:17.178565 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:17.178568    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6687e7e0-a140-42f3-ad7c-0cc4a1464701-plugins-config-volume\") pod \"payload-processing-e2e-autores-71518b-579b68988f-9gdtb\" (UID: \"6687e7e0-a140-42f3-ad7c-0cc4a1464701\") " pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:46:17.179256 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:17.179238    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6687e7e0-a140-42f3-ad7c-0cc4a1464701-plugins-config-volume\") pod \"payload-processing-e2e-autores-71518b-579b68988f-9gdtb\" (UID: \"6687e7e0-a140-42f3-ad7c-0cc4a1464701\") " pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:46:17.198471 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:17.188388    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6t5k\" (UniqueName: \"kubernetes.io/projected/6687e7e0-a140-42f3-ad7c-0cc4a1464701-kube-api-access-p6t5k\") pod \"payload-processing-e2e-autores-71518b-579b68988f-9gdtb\" (UID: \"6687e7e0-a140-42f3-ad7c-0cc4a1464701\") " pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:46:17.255122 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:17.255088    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:46:17.550467 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:17.550435    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"]
Sep 08 14:46:17.552422 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:46:17.552381    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6687e7e0_a140_42f3_ad7c_0cc4a1464701.slice/crio-9965c76e3ed971e8fda207513016bde08bf8e69276cd5a143000d9c3776e020f WatchSource:0}: Error finding container 9965c76e3ed971e8fda207513016bde08bf8e69276cd5a143000d9c3776e020f: Status 404 returned error can't find the container with id 9965c76e3ed971e8fda207513016bde08bf8e69276cd5a143000d9c3776e020f
Sep 08 14:46:17.726719 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:17.726682    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb" event={"ID":"6687e7e0-a140-42f3-ad7c-0cc4a1464701","Type":"ContainerStarted","Data":"9965c76e3ed971e8fda207513016bde08bf8e69276cd5a143000d9c3776e020f"}
Sep 08 14:46:21.697430 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:21.697377    2561 patch_prober.go:28] interesting pod/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 14:46:21.697896 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:21.697459    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 14:46:21.753567 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:21.753516    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb" event={"ID":"6687e7e0-a140-42f3-ad7c-0cc4a1464701","Type":"ContainerStarted","Data":"78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36"}
Sep 08 14:46:21.753782 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:21.753585    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:46:21.775466 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:21.775401    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb" podStartSLOduration=2.335695059 podStartE2EDuration="5.775380536s" totalImagesPullingTime="3.439685477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:21.77312309 +0000 UTC m=+725.783643088" watchObservedRunningTime="2026-09-08 14:46:21.775380536 +0000 UTC m=+725.785900537"
Sep 08 14:46:23.764856 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:23.764820    2561 generic.go:356] "Generic (PLEG): container finished" podID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerID="008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e" exitCode=0
Sep 08 14:46:23.765422 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:23.764897    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" event={"ID":"24f853ef-de53-4b60-8ce2-b3330ca822af","Type":"ContainerDied","Data":"008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e"}
Sep 08 14:46:23.765519 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:23.765502    2561 scope.go:117] "RemoveContainer" containerID="008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e"
Sep 08 14:46:23.766722 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:23.766687    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:23.766788 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:23.766773    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:23.766829 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:23.766817    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:24.771538 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:24.771501    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" event={"ID":"24f853ef-de53-4b60-8ce2-b3330ca822af","Type":"ContainerStarted","Data":"fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601"}
Sep 08 14:46:25.743384 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:25.743334    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:25.743697 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:25.743670    2561 patch_prober.go:28] interesting pod/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 14:46:25.743792 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:25.743736    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 14:46:26.743682 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:26.743645    2561 patch_prober.go:28] interesting pod/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 14:46:26.744176 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:26.743705    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 14:46:27.743606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:27.743555    2561 patch_prober.go:28] interesting pod/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 14:46:27.743857 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:27.743632    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 14:46:28.183066 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:28.181991    2561 patch_prober.go:28] interesting pod/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:37410->10.134.0.34:15021: read: connection reset by peer" start-of-body=
Sep 08 14:46:28.183066 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:28.182058    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:37410->10.134.0.34:15021: read: connection reset by peer"
Sep 08 14:46:28.743927 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:28.743888    2561 patch_prober.go:28] interesting pod/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 14:46:28.744447 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:28.743946    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 14:46:28.799271 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:28.799228    2561 generic.go:356] "Generic (PLEG): container finished" podID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerID="eb448ee3c089718b81d326e672dd1fd1db8dea97c48fc989c82484dd3f29334e" exitCode=0
Sep 08 14:46:28.799481 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:28.799348    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" event={"ID":"4b3bcf08-b3d6-4f05-9236-34c4902776c5","Type":"ContainerDied","Data":"eb448ee3c089718b81d326e672dd1fd1db8dea97c48fc989c82484dd3f29334e"}
Sep 08 14:46:28.799910 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:28.799882    2561 scope.go:117] "RemoveContainer" containerID="eb448ee3c089718b81d326e672dd1fd1db8dea97c48fc989c82484dd3f29334e"
Sep 08 14:46:28.801370 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:28.801328    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:28.801471 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:28.801428    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:28.801535 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:28.801475    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:29.743943 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:29.743893    2561 patch_prober.go:28] interesting pod/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 14:46:29.744994 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:29.744558    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 14:46:29.809380 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:29.809346    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" event={"ID":"4b3bcf08-b3d6-4f05-9236-34c4902776c5","Type":"ContainerStarted","Data":"9630d860cc94b57e1a88dd2e17683b09a51454a3fd51899951aee4d389f601f8"}
Sep 08 14:46:30.280293 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:30.280252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:30.280560 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:30.280344    2561 patch_prober.go:28] interesting pod/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 08 14:46:30.280674 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:30.280595    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 08 14:46:31.138543 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.138510    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:31.139436 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.139410    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:31.141113 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.141089    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:46:31.279404 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.279367    2561 patch_prober.go:28] interesting pod/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 08 14:46:31.279606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.279442    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 08 14:46:31.280808 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.280781    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"]
Sep 08 14:46:31.293589 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.293561    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.312005 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.304758    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-02a199-openshift-default-dockercfg-btkmz\""
Sep 08 14:46:31.354180 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.344893    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"]
Sep 08 14:46:31.371324 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.371273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-envoy\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.371515 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.371334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b18a94c-1cc4-4343-8428-09d822a46538-istiod-ca-cert\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.371515 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.371419    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-istio-token\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.371515 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.371461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-certs\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.371515 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.371491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-credential-socket\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.371723 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.371519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b18a94c-1cc4-4343-8428-09d822a46538-istio-podinfo\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.371723 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.371643    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-data\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.371723 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.371707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tm8r\" (UniqueName: \"kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-kube-api-access-8tm8r\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.371890 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.371739    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-socket\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.472626 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.472581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-data\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.472827 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.472640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tm8r\" (UniqueName: \"kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-kube-api-access-8tm8r\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.472827 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.472674    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-socket\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.472827 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.472744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-envoy\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.472827 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.472771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b18a94c-1cc4-4343-8428-09d822a46538-istiod-ca-cert\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.472827 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.472822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-istio-token\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.473088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.472847    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-certs\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.473088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.472877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-credential-socket\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.473088 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.472909    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b18a94c-1cc4-4343-8428-09d822a46538-istio-podinfo\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.473775 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.473386    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-data\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.473775 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.473573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-certs\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.473775 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.473687    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-socket\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.473775 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.473745    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-credential-socket\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.473972 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.473894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b18a94c-1cc4-4343-8428-09d822a46538-istiod-ca-cert\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.476425 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.476381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-envoy\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.476646 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.476624    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b18a94c-1cc4-4343-8428-09d822a46538-istio-podinfo\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.490992 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.490959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-istio-token\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.495220 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.494829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tm8r\" (UniqueName: \"kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-kube-api-access-8tm8r\") pod \"e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") " pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.640936 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.640673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:31.978234 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.978205    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"]
Sep 08 14:46:31.980927 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:46:31.980903    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b18a94c_1cc4_4343_8428_09d822a46538.slice/crio-14434c75a265fbe2dae66a8a3cf3e6fa150bee1889d9ea90dc854c05132e3686 WatchSource:0}: Error finding container 14434c75a265fbe2dae66a8a3cf3e6fa150bee1889d9ea90dc854c05132e3686: Status 404 returned error can't find the container with id 14434c75a265fbe2dae66a8a3cf3e6fa150bee1889d9ea90dc854c05132e3686
Sep 08 14:46:31.988831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.988277    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:31.988831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.988380    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:31.988831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:31.988429    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:32.279894 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:32.279779    2561 patch_prober.go:28] interesting pod/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 08 14:46:32.281084 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:32.280672    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 08 14:46:32.760427 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:32.760223    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:46:32.848286 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:32.848231    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" event={"ID":"7b18a94c-1cc4-4343-8428-09d822a46538","Type":"ContainerStarted","Data":"05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88"}
Sep 08 14:46:32.848479 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:32.848313    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" event={"ID":"7b18a94c-1cc4-4343-8428-09d822a46538","Type":"ContainerStarted","Data":"14434c75a265fbe2dae66a8a3cf3e6fa150bee1889d9ea90dc854c05132e3686"}
Sep 08 14:46:32.877546 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:32.877481    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" podStartSLOduration=1.877463252 podStartE2EDuration="1.877463252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:32.875032152 +0000 UTC m=+736.885552151" watchObservedRunningTime="2026-09-08 14:46:32.877463252 +0000 UTC m=+736.887983248"
Sep 08 14:46:33.280333 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:33.280293    2561 patch_prober.go:28] interesting pod/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 08 14:46:33.280792 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:33.280358    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 08 14:46:33.641767 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:33.641662    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:33.648412 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:33.648378    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:33.853465 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:33.853432    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:33.854429 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:33.854405    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:34.279639 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:34.279601    2561 patch_prober.go:28] interesting pod/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 08 14:46:34.279829 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:34.279665    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 08 14:46:35.439027 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:35.438987    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:35.439589 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:35.439416    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:35.441067 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:35.441039    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:37.270050 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.270019    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"]
Sep 08 14:46:37.273813 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.273789    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:46:37.276346 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.276321    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-02a199-dockercfg-twlcz\""
Sep 08 14:46:37.276480 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.276321    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-02a199\""
Sep 08 14:46:37.296335 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.288790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"]
Sep 08 14:46:37.347081 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.345377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279dfb57-6a0e-4d06-818b-b718ff975c1f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9\" (UID: \"279dfb57-6a0e-4d06-818b-b718ff975c1f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:46:37.348502 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.348215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwvxn\" (UniqueName: \"kubernetes.io/projected/279dfb57-6a0e-4d06-818b-b718ff975c1f-kube-api-access-kwvxn\") pod \"payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9\" (UID: \"279dfb57-6a0e-4d06-818b-b718ff975c1f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:46:37.449840 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.449800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279dfb57-6a0e-4d06-818b-b718ff975c1f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9\" (UID: \"279dfb57-6a0e-4d06-818b-b718ff975c1f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:46:37.450109 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.449867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwvxn\" (UniqueName: \"kubernetes.io/projected/279dfb57-6a0e-4d06-818b-b718ff975c1f-kube-api-access-kwvxn\") pod \"payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9\" (UID: \"279dfb57-6a0e-4d06-818b-b718ff975c1f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:46:37.450562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.450540    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279dfb57-6a0e-4d06-818b-b718ff975c1f-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9\" (UID: \"279dfb57-6a0e-4d06-818b-b718ff975c1f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:46:37.458329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.458292    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwvxn\" (UniqueName: \"kubernetes.io/projected/279dfb57-6a0e-4d06-818b-b718ff975c1f-kube-api-access-kwvxn\") pod \"payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9\" (UID: \"279dfb57-6a0e-4d06-818b-b718ff975c1f\") " pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:46:37.585819 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.585730    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:46:37.864442 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.864416    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"]
Sep 08 14:46:37.865842 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:46:37.865810    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279dfb57_6a0e_4d06_818b_b718ff975c1f.slice/crio-492a0fa13bdf9b8daed5b33741a79c20a61cc0152acdac1ead88af499790b852 WatchSource:0}: Error finding container 492a0fa13bdf9b8daed5b33741a79c20a61cc0152acdac1ead88af499790b852: Status 404 returned error can't find the container with id 492a0fa13bdf9b8daed5b33741a79c20a61cc0152acdac1ead88af499790b852
Sep 08 14:46:37.878531 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.878504    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9" event={"ID":"279dfb57-6a0e-4d06-818b-b718ff975c1f","Type":"ContainerStarted","Data":"492a0fa13bdf9b8daed5b33741a79c20a61cc0152acdac1ead88af499790b852"}
Sep 08 14:46:37.880102 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.880080    2561 generic.go:356] "Generic (PLEG): container finished" podID="e79fc882-4514-48ed-9dff-db183cf97c00" containerID="3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b" exitCode=0
Sep 08 14:46:37.880209 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.880191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" event={"ID":"e79fc882-4514-48ed-9dff-db183cf97c00","Type":"ContainerDied","Data":"3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b"}
Sep 08 14:46:37.880700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.880683    2561 scope.go:117] "RemoveContainer" containerID="3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b"
Sep 08 14:46:37.881864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.881838    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:37.881927 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.881905    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:37.881964 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:37.881945    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:38.582763 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.582705    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"]
Sep 08 14:46:38.590629 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.590594    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"
Sep 08 14:46:38.592864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.592834    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pdpbl\""
Sep 08 14:46:38.593764 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.593727    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"]
Sep 08 14:46:38.665228 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.665191    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca1b1eed-59d9-46d7-b8b0-5110d87fba29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm\" (UID: \"ca1b1eed-59d9-46d7-b8b0-5110d87fba29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"
Sep 08 14:46:38.766685 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.766646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca1b1eed-59d9-46d7-b8b0-5110d87fba29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm\" (UID: \"ca1b1eed-59d9-46d7-b8b0-5110d87fba29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"
Sep 08 14:46:38.767297 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.767280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca1b1eed-59d9-46d7-b8b0-5110d87fba29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm\" (UID: \"ca1b1eed-59d9-46d7-b8b0-5110d87fba29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"
Sep 08 14:46:38.888876 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.888766    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9" event={"ID":"279dfb57-6a0e-4d06-818b-b718ff975c1f","Type":"ContainerStarted","Data":"abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24"}
Sep 08 14:46:38.889749 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.889720    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:46:38.892566 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.892530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" event={"ID":"e79fc882-4514-48ed-9dff-db183cf97c00","Type":"ContainerStarted","Data":"dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca"}
Sep 08 14:46:38.907654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.907613    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"
Sep 08 14:46:38.935165 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:38.935089    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9" podStartSLOduration=1.935064005 podStartE2EDuration="1.935064005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:38.933434748 +0000 UTC m=+742.943954756" watchObservedRunningTime="2026-09-08 14:46:38.935064005 +0000 UTC m=+742.945584004"
Sep 08 14:46:39.186608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:39.186507    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"]
Sep 08 14:46:39.208173 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:46:39.207072    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca1b1eed_59d9_46d7_b8b0_5110d87fba29.slice/crio-bd07f48904d04449404c940f6f66183cd24c3fcad0d5b8fb3cc525c34c4366ba WatchSource:0}: Error finding container bd07f48904d04449404c940f6f66183cd24c3fcad0d5b8fb3cc525c34c4366ba: Status 404 returned error can't find the container with id bd07f48904d04449404c940f6f66183cd24c3fcad0d5b8fb3cc525c34c4366ba
Sep 08 14:46:39.456078 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:39.455971    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:39.457343 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:39.457314    2561 patch_prober.go:28] interesting pod/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:46:39.457489 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:39.457367    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:46:39.902832 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:39.902787    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm" event={"ID":"ca1b1eed-59d9-46d7-b8b0-5110d87fba29","Type":"ContainerStarted","Data":"a20356ff81896eea87e0b21b51c8572a8974faf66cf8df4afe433cd5e54c5da9"}
Sep 08 14:46:39.903916 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:39.903881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm" event={"ID":"ca1b1eed-59d9-46d7-b8b0-5110d87fba29","Type":"ContainerStarted","Data":"bd07f48904d04449404c940f6f66183cd24c3fcad0d5b8fb3cc525c34c4366ba"}
Sep 08 14:46:39.920631 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:39.920339    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm" podStartSLOduration=1.920317801 podStartE2EDuration="1.920317801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:39.919024906 +0000 UTC m=+743.929544904" watchObservedRunningTime="2026-09-08 14:46:39.920317801 +0000 UTC m=+743.930837803"
Sep 08 14:46:40.455638 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:40.455592    2561 patch_prober.go:28] interesting pod/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:46:40.455828 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:40.455667    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:46:40.911250 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:40.911214    2561 generic.go:356] "Generic (PLEG): container finished" podID="ca1b1eed-59d9-46d7-b8b0-5110d87fba29" containerID="a20356ff81896eea87e0b21b51c8572a8974faf66cf8df4afe433cd5e54c5da9" exitCode=0
Sep 08 14:46:40.911641 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:40.911297    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm" event={"ID":"ca1b1eed-59d9-46d7-b8b0-5110d87fba29","Type":"ContainerDied","Data":"a20356ff81896eea87e0b21b51c8572a8974faf66cf8df4afe433cd5e54c5da9"}
Sep 08 14:46:41.456398 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:41.456362    2561 patch_prober.go:28] interesting pod/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:46:41.456603 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:41.456424    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:46:42.065165 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:42.065115    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"
Sep 08 14:46:42.214277 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:42.214171    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca1b1eed-59d9-46d7-b8b0-5110d87fba29-maas-api-service-ca\") pod \"ca1b1eed-59d9-46d7-b8b0-5110d87fba29\" (UID: \"ca1b1eed-59d9-46d7-b8b0-5110d87fba29\") "
Sep 08 14:46:42.214512 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:42.214488    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca1b1eed-59d9-46d7-b8b0-5110d87fba29-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ca1b1eed-59d9-46d7-b8b0-5110d87fba29" (UID: "ca1b1eed-59d9-46d7-b8b0-5110d87fba29"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:46:42.315551 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:42.315510    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca1b1eed-59d9-46d7-b8b0-5110d87fba29-maas-api-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:46:42.456505 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:42.456466    2561 patch_prober.go:28] interesting pod/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:46:42.456703 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:42.456533    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:46:42.921886 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:42.921804    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"
Sep 08 14:46:42.921886 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:42.921818    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm" event={"ID":"ca1b1eed-59d9-46d7-b8b0-5110d87fba29","Type":"ContainerDied","Data":"bd07f48904d04449404c940f6f66183cd24c3fcad0d5b8fb3cc525c34c4366ba"}
Sep 08 14:46:42.921886 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:42.921860    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd07f48904d04449404c940f6f66183cd24c3fcad0d5b8fb3cc525c34c4366ba"
Sep 08 14:46:43.456538 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:43.456495    2561 patch_prober.go:28] interesting pod/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:46:43.456909 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:43.456557    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:46:43.703017 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:43.702974    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:44.459713 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:44.459684    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:44.460790 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:44.460769    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:46:45.598683 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:45.598639    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"]
Sep 08 14:46:45.602635 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:45.602587    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3af37e0c-gl5bm"]
Sep 08 14:46:45.752854 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:45.752820    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"]
Sep 08 14:46:45.753062 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:45.753038    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy" containerID="cri-o://9630d860cc94b57e1a88dd2e17683b09a51454a3fd51899951aee4d389f601f8" gracePeriod=30
Sep 08 14:46:46.527990 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:46.527951    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca1b1eed-59d9-46d7-b8b0-5110d87fba29" path="/var/lib/kubelet/pods/ca1b1eed-59d9-46d7-b8b0-5110d87fba29/volumes"
Sep 08 14:46:50.441830 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:50.441786    2561 patch_prober.go:28] interesting pod/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:46:50.442249 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:50.441853    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:46:50.913735 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:50.913701    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:46:50.969299 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:50.969199    2561 generic.go:356] "Generic (PLEG): container finished" podID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerID="9630d860cc94b57e1a88dd2e17683b09a51454a3fd51899951aee4d389f601f8" exitCode=0
Sep 08 14:46:50.969299 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:50.969282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" event={"ID":"4b3bcf08-b3d6-4f05-9236-34c4902776c5","Type":"ContainerDied","Data":"9630d860cc94b57e1a88dd2e17683b09a51454a3fd51899951aee4d389f601f8"}
Sep 08 14:46:50.969528 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:50.969379    2561 scope.go:117] "RemoveContainer" containerID="eb448ee3c089718b81d326e672dd1fd1db8dea97c48fc989c82484dd3f29334e"
Sep 08 14:46:51.020054 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.019990    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:51.118756 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.118722    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-token\") pod \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") "
Sep 08 14:46:51.118931 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.118775    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-podinfo\") pod \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") "
Sep 08 14:46:51.118931 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.118836    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istiod-ca-cert\") pod \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") "
Sep 08 14:46:51.118931 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.118863    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-credential-socket\") pod \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") "
Sep 08 14:46:51.118931 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.118900    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjpsq\" (UniqueName: \"kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-kube-api-access-zjpsq\") pod \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") "
Sep 08 14:46:51.119207 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.119006    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-data\") pod \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") "
Sep 08 14:46:51.119207 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.119066    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-envoy\") pod \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") "
Sep 08 14:46:51.119207 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.119106    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-certs\") pod \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") "
Sep 08 14:46:51.119207 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.119137    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-socket\") pod \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\" (UID: \"4b3bcf08-b3d6-4f05-9236-34c4902776c5\") "
Sep 08 14:46:51.119413 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.119257    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b3bcf08-b3d6-4f05-9236-34c4902776c5" (UID: "4b3bcf08-b3d6-4f05-9236-34c4902776c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:46:51.119413 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.119300    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b3bcf08-b3d6-4f05-9236-34c4902776c5" (UID: "4b3bcf08-b3d6-4f05-9236-34c4902776c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:46:51.119413 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.119395    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b3bcf08-b3d6-4f05-9236-34c4902776c5" (UID: "4b3bcf08-b3d6-4f05-9236-34c4902776c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:46:51.119568 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.119496    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b3bcf08-b3d6-4f05-9236-34c4902776c5" (UID: "4b3bcf08-b3d6-4f05-9236-34c4902776c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:46:51.119616 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.119562    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b3bcf08-b3d6-4f05-9236-34c4902776c5" (UID: "4b3bcf08-b3d6-4f05-9236-34c4902776c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:46:51.120276 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.120253    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:46:51.120470 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.120296    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:46:51.120470 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.120311    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:46:51.120470 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.120324    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:46:51.120470 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.120336    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:46:51.121828 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.121795    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b3bcf08-b3d6-4f05-9236-34c4902776c5" (UID: "4b3bcf08-b3d6-4f05-9236-34c4902776c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:46:51.122052 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.122025    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b3bcf08-b3d6-4f05-9236-34c4902776c5" (UID: "4b3bcf08-b3d6-4f05-9236-34c4902776c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:46:51.130466 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.130414    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-kube-api-access-zjpsq" (OuterVolumeSpecName: "kube-api-access-zjpsq") pod "4b3bcf08-b3d6-4f05-9236-34c4902776c5" (UID: "4b3bcf08-b3d6-4f05-9236-34c4902776c5"). InnerVolumeSpecName "kube-api-access-zjpsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:46:51.131962 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.131936    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b3bcf08-b3d6-4f05-9236-34c4902776c5" (UID: "4b3bcf08-b3d6-4f05-9236-34c4902776c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:46:51.221394 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.221349    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:46:51.221394 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.221382    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:46:51.221394 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.221392    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b3bcf08-b3d6-4f05-9236-34c4902776c5-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:46:51.221394 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.221402    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjpsq\" (UniqueName: \"kubernetes.io/projected/4b3bcf08-b3d6-4f05-9236-34c4902776c5-kube-api-access-zjpsq\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:46:51.979131 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.979090    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj" event={"ID":"4b3bcf08-b3d6-4f05-9236-34c4902776c5","Type":"ContainerDied","Data":"ebcff9e3686074f5016a8433f218c5e54c497ea1b57dc53f7228d6662b07b40f"}
Sep 08 14:46:51.979593 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.979173    2561 scope.go:117] "RemoveContainer" containerID="9630d860cc94b57e1a88dd2e17683b09a51454a3fd51899951aee4d389f601f8"
Sep 08 14:46:51.979593 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:51.979103    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"
Sep 08 14:46:52.010812 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:52.010775    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"]
Sep 08 14:46:52.015692 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:52.015661    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3af37e0c-openshift-default-648c9fc768-swrrj"]
Sep 08 14:46:52.520989 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:52.520936    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" path="/var/lib/kubelet/pods/4b3bcf08-b3d6-4f05-9236-34c4902776c5/volumes"
Sep 08 14:46:53.041653 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.041618    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"]
Sep 08 14:46:53.042178 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.042140    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy"
Sep 08 14:46:53.042270 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.042180    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy"
Sep 08 14:46:53.042270 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.042213    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca1b1eed-59d9-46d7-b8b0-5110d87fba29" containerName="revoke-keys"
Sep 08 14:46:53.042270 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.042221    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca1b1eed-59d9-46d7-b8b0-5110d87fba29" containerName="revoke-keys"
Sep 08 14:46:53.042415 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.042318    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca1b1eed-59d9-46d7-b8b0-5110d87fba29" containerName="revoke-keys"
Sep 08 14:46:53.042415 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.042333    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy"
Sep 08 14:46:53.042415 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.042343    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy"
Sep 08 14:46:53.046787 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.046764    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:46:53.049059 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.049035    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-8ac49eaa\""
Sep 08 14:46:53.062209 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.062169    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"]
Sep 08 14:46:53.138849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.138805    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-plugins-config-volume\") pod \"payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s\" (UID: \"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:46:53.139023 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.138867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s7fv\" (UniqueName: \"kubernetes.io/projected/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-kube-api-access-6s7fv\") pod \"payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s\" (UID: \"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:46:53.239419 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.239383    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-plugins-config-volume\") pod \"payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s\" (UID: \"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:46:53.239419 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.239428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s7fv\" (UniqueName: \"kubernetes.io/projected/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-kube-api-access-6s7fv\") pod \"payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s\" (UID: \"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:46:53.240140 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.240120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-plugins-config-volume\") pod \"payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s\" (UID: \"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:46:53.247582 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.247555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s7fv\" (UniqueName: \"kubernetes.io/projected/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-kube-api-access-6s7fv\") pod \"payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s\" (UID: \"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:46:53.356556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.356476    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:46:53.634254 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.634223    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"]
Sep 08 14:46:53.636057 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:46:53.636023    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba49a2f1_ed07_44d4_a3ca_cfec45f4b944.slice/crio-8e4f16dc6f96f5ffe8ab8d9b3ebe23f4b15b3805e76d5c92ea7264ddaa1ab87d WatchSource:0}: Error finding container 8e4f16dc6f96f5ffe8ab8d9b3ebe23f4b15b3805e76d5c92ea7264ddaa1ab87d: Status 404 returned error can't find the container with id 8e4f16dc6f96f5ffe8ab8d9b3ebe23f4b15b3805e76d5c92ea7264ddaa1ab87d
Sep 08 14:46:53.993016 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.992967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s" event={"ID":"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944","Type":"ContainerStarted","Data":"c317bbd7bf4df0ac2438208b097124e6c56f3a0549daccd6d09092bc3119d4e8"}
Sep 08 14:46:53.993302 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.993029    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s" event={"ID":"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944","Type":"ContainerStarted","Data":"8e4f16dc6f96f5ffe8ab8d9b3ebe23f4b15b3805e76d5c92ea7264ddaa1ab87d"}
Sep 08 14:46:53.993302 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.993126    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:46:53.994696 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.994671    2561 generic.go:356] "Generic (PLEG): container finished" podID="7b18a94c-1cc4-4343-8428-09d822a46538" containerID="05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88" exitCode=0
Sep 08 14:46:53.994834 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.994730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" event={"ID":"7b18a94c-1cc4-4343-8428-09d822a46538","Type":"ContainerDied","Data":"05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88"}
Sep 08 14:46:53.995133 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.995115    2561 scope.go:117] "RemoveContainer" containerID="05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88"
Sep 08 14:46:53.996225 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.996185    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:53.996319 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.996258    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:53.996319 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:53.996290    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:46:54.012707 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:54.012652    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s" podStartSLOduration=1.012629458 podStartE2EDuration="1.012629458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:54.011322574 +0000 UTC m=+758.021842572" watchObservedRunningTime="2026-09-08 14:46:54.012629458 +0000 UTC m=+758.023149458"
Sep 08 14:46:55.007328 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:55.006895    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" event={"ID":"7b18a94c-1cc4-4343-8428-09d822a46538","Type":"ContainerStarted","Data":"34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd"}
Sep 08 14:46:55.641046 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:55.641013    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:46:55.641250 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:55.641214    2561 patch_prober.go:28] interesting pod/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 14:46:55.641304 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:55.641273    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 14:46:56.641072 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:56.641035    2561 patch_prober.go:28] interesting pod/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 14:46:56.641477 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:56.641092    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 14:46:57.642026 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:57.641994    2561 patch_prober.go:28] interesting pod/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 14:46:57.642451 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:57.642047    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 14:46:58.641782 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:58.641744    2561 patch_prober.go:28] interesting pod/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 14:46:58.642003 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:58.641854    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 14:46:59.641680 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:59.641643    2561 patch_prober.go:28] interesting pod/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 14:46:59.642067 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:46:59.641709    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 14:47:00.646141 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:00.646103    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:47:00.646553 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:00.646419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:47:00.647043 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:00.647022    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:47:05.008856 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:05.008824    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:47:16.982241 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:16.982207    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"]
Sep 08 14:47:16.982665 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:16.982651    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy"
Sep 08 14:47:16.982725 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:16.982670    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b3bcf08-b3d6-4f05-9236-34c4902776c5" containerName="istio-proxy"
Sep 08 14:47:16.987022 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:16.987007    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"
Sep 08 14:47:16.989356 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:16.989337    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pdpbl\""
Sep 08 14:47:16.993843 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:16.993815    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"]
Sep 08 14:47:17.083002 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:17.082962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30e06baa-a0f3-4a42-9c98-5028967fd668-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz\" (UID: \"30e06baa-a0f3-4a42-9c98-5028967fd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"
Sep 08 14:47:17.184557 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:17.184518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30e06baa-a0f3-4a42-9c98-5028967fd668-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz\" (UID: \"30e06baa-a0f3-4a42-9c98-5028967fd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"
Sep 08 14:47:17.185224 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:17.185192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30e06baa-a0f3-4a42-9c98-5028967fd668-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz\" (UID: \"30e06baa-a0f3-4a42-9c98-5028967fd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"
Sep 08 14:47:17.298831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:17.298753    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"
Sep 08 14:47:17.571016 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:17.570990    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"]
Sep 08 14:47:17.573204 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:47:17.573173    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e06baa_a0f3_4a42_9c98_5028967fd668.slice/crio-c0f39868a0ef7126c15a9bad4b5cfe046ed74fcc67d7f8611618af313be369cd WatchSource:0}: Error finding container c0f39868a0ef7126c15a9bad4b5cfe046ed74fcc67d7f8611618af313be369cd: Status 404 returned error can't find the container with id c0f39868a0ef7126c15a9bad4b5cfe046ed74fcc67d7f8611618af313be369cd
Sep 08 14:47:18.133951 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:18.133916    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz" event={"ID":"30e06baa-a0f3-4a42-9c98-5028967fd668","Type":"ContainerStarted","Data":"1d38aa520ac3b582d99f8b21fd3449570231cba63dd49927756ff2f6eb04a819"}
Sep 08 14:47:18.134373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:18.133974    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz" event={"ID":"30e06baa-a0f3-4a42-9c98-5028967fd668","Type":"ContainerStarted","Data":"c0f39868a0ef7126c15a9bad4b5cfe046ed74fcc67d7f8611618af313be369cd"}
Sep 08 14:47:18.149496 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:18.149447    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz" podStartSLOduration=2.149431911 podStartE2EDuration="2.149431911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:47:18.148270816 +0000 UTC m=+782.158790814" watchObservedRunningTime="2026-09-08 14:47:18.149431911 +0000 UTC m=+782.159951909"
Sep 08 14:47:18.432949 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:47:18.432915    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e06baa_a0f3_4a42_9c98_5028967fd668.slice/crio-conmon-1d38aa520ac3b582d99f8b21fd3449570231cba63dd49927756ff2f6eb04a819.scope\": RecentStats: unable to find data in memory cache]"
Sep 08 14:47:19.141045 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:19.141012    2561 generic.go:356] "Generic (PLEG): container finished" podID="30e06baa-a0f3-4a42-9c98-5028967fd668" containerID="1d38aa520ac3b582d99f8b21fd3449570231cba63dd49927756ff2f6eb04a819" exitCode=0
Sep 08 14:47:19.141462 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:19.141067    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz" event={"ID":"30e06baa-a0f3-4a42-9c98-5028967fd668","Type":"ContainerDied","Data":"1d38aa520ac3b582d99f8b21fd3449570231cba63dd49927756ff2f6eb04a819"}
Sep 08 14:47:20.286382 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:20.286350    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"
Sep 08 14:47:20.424603 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:20.424504    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30e06baa-a0f3-4a42-9c98-5028967fd668-maas-api-service-ca\") pod \"30e06baa-a0f3-4a42-9c98-5028967fd668\" (UID: \"30e06baa-a0f3-4a42-9c98-5028967fd668\") "
Sep 08 14:47:20.424913 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:20.424885    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30e06baa-a0f3-4a42-9c98-5028967fd668-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "30e06baa-a0f3-4a42-9c98-5028967fd668" (UID: "30e06baa-a0f3-4a42-9c98-5028967fd668"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:47:20.526222 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:20.526191    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30e06baa-a0f3-4a42-9c98-5028967fd668-maas-api-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:47:21.152381 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:21.152352    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"
Sep 08 14:47:21.152569 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:21.152343    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz" event={"ID":"30e06baa-a0f3-4a42-9c98-5028967fd668","Type":"ContainerDied","Data":"c0f39868a0ef7126c15a9bad4b5cfe046ed74fcc67d7f8611618af313be369cd"}
Sep 08 14:47:21.152569 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:21.152493    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0f39868a0ef7126c15a9bad4b5cfe046ed74fcc67d7f8611618af313be369cd"
Sep 08 14:47:22.999312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:22.999279    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"]
Sep 08 14:47:22.999777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:22.999656    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s" podUID="ba49a2f1-ed07-44d4-a3ca-cfec45f4b944" containerName="payload-processing" containerID="cri-o://c317bbd7bf4df0ac2438208b097124e6c56f3a0549daccd6d09092bc3119d4e8" gracePeriod=30
Sep 08 14:47:23.164038 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.164005    2561 generic.go:356] "Generic (PLEG): container finished" podID="ba49a2f1-ed07-44d4-a3ca-cfec45f4b944" containerID="c317bbd7bf4df0ac2438208b097124e6c56f3a0549daccd6d09092bc3119d4e8" exitCode=0
Sep 08 14:47:23.164235 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.164086    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s" event={"ID":"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944","Type":"ContainerDied","Data":"c317bbd7bf4df0ac2438208b097124e6c56f3a0549daccd6d09092bc3119d4e8"}
Sep 08 14:47:23.199737 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.199704    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"]
Sep 08 14:47:23.204998 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.204966    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8ac49eaa-jg2qz"]
Sep 08 14:47:23.264220 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.264140    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:47:23.358464 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.358431    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-plugins-config-volume\") pod \"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944\" (UID: \"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944\") "
Sep 08 14:47:23.358650 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.358479    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s7fv\" (UniqueName: \"kubernetes.io/projected/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-kube-api-access-6s7fv\") pod \"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944\" (UID: \"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944\") "
Sep 08 14:47:23.358857 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.358828    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba49a2f1-ed07-44d4-a3ca-cfec45f4b944" (UID: "ba49a2f1-ed07-44d4-a3ca-cfec45f4b944"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:47:23.361291 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.361250    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-kube-api-access-6s7fv" (OuterVolumeSpecName: "kube-api-access-6s7fv") pod "ba49a2f1-ed07-44d4-a3ca-cfec45f4b944" (UID: "ba49a2f1-ed07-44d4-a3ca-cfec45f4b944"). InnerVolumeSpecName "kube-api-access-6s7fv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:47:23.462868 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.460213    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:47:23.462868 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:23.460253    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s7fv\" (UniqueName: \"kubernetes.io/projected/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944-kube-api-access-6s7fv\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:47:24.159090 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.159052    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"]
Sep 08 14:47:24.159490 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.159458    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba49a2f1-ed07-44d4-a3ca-cfec45f4b944" containerName="payload-processing"
Sep 08 14:47:24.159490 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.159470    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba49a2f1-ed07-44d4-a3ca-cfec45f4b944" containerName="payload-processing"
Sep 08 14:47:24.159490 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.159487    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30e06baa-a0f3-4a42-9c98-5028967fd668" containerName="revoke-keys"
Sep 08 14:47:24.159490 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.159492    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="30e06baa-a0f3-4a42-9c98-5028967fd668" containerName="revoke-keys"
Sep 08 14:47:24.159622 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.159557    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="30e06baa-a0f3-4a42-9c98-5028967fd668" containerName="revoke-keys"
Sep 08 14:47:24.159622 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.159565    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba49a2f1-ed07-44d4-a3ca-cfec45f4b944" containerName="payload-processing"
Sep 08 14:47:24.162840 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.162818    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.165733 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.165698    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8066138e-openshift-default-dockercfg-6qvnz\""
Sep 08 14:47:24.171643 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.171621    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"
Sep 08 14:47:24.171747 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.171622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s" event={"ID":"ba49a2f1-ed07-44d4-a3ca-cfec45f4b944","Type":"ContainerDied","Data":"8e4f16dc6f96f5ffe8ab8d9b3ebe23f4b15b3805e76d5c92ea7264ddaa1ab87d"}
Sep 08 14:47:24.171793 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.171760    2561 scope.go:117] "RemoveContainer" containerID="c317bbd7bf4df0ac2438208b097124e6c56f3a0549daccd6d09092bc3119d4e8"
Sep 08 14:47:24.199606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.199569    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"]
Sep 08 14:47:24.273359 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.273321    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj62n\" (UniqueName: \"kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-kube-api-access-qj62n\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.273694 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.273672    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-data\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.291196 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.278970    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"]
Sep 08 14:47:24.291401 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.291188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-envoy\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.291401 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.291337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-credential-socket\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.291567 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.291528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-socket\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.292127 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.292099    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-podinfo\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.292291 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.292137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-token\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.292291 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.292275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca6e881-e52b-44d7-9db2-649f48e01af7-istiod-ca-cert\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.292414 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.292339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-certs\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.294822 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.294797    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ac49eaa-c585cfb6-xvb9s"]
Sep 08 14:47:24.393786 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.393749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-credential-socket\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.393962 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.393820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-socket\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.393962 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.393850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-podinfo\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.393962 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.393866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-token\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.393962 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.393914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca6e881-e52b-44d7-9db2-649f48e01af7-istiod-ca-cert\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.393962 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.393957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-certs\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.394234 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.393994    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj62n\" (UniqueName: \"kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-kube-api-access-qj62n\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.394234 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.394026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-data\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.394347 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.394253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-envoy\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.394347 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.394262    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-credential-socket\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.394347 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.394305    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-socket\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.394502 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.394353    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-data\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.394502 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.394433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-certs\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.394715 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.394697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca6e881-e52b-44d7-9db2-649f48e01af7-istiod-ca-cert\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.396644 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.396624    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-envoy\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.396791 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.396771    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-podinfo\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.403559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.403536    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj62n\" (UniqueName: \"kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-kube-api-access-qj62n\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.403708 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.403617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-token\") pod \"e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") " pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.475429 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.475398    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:24.523042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.523003    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30e06baa-a0f3-4a42-9c98-5028967fd668" path="/var/lib/kubelet/pods/30e06baa-a0f3-4a42-9c98-5028967fd668/volumes"
Sep 08 14:47:24.523431 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.523417    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba49a2f1-ed07-44d4-a3ca-cfec45f4b944" path="/var/lib/kubelet/pods/ba49a2f1-ed07-44d4-a3ca-cfec45f4b944/volumes"
Sep 08 14:47:24.757965 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.757936    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"]
Sep 08 14:47:24.759911 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:47:24.759884    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca6e881_e52b_44d7_9db2_649f48e01af7.slice/crio-f9fbd508377f033b1f840a6cccc086858b76ddc263a0e61149ae90e7a4e7a272 WatchSource:0}: Error finding container f9fbd508377f033b1f840a6cccc086858b76ddc263a0e61149ae90e7a4e7a272: Status 404 returned error can't find the container with id f9fbd508377f033b1f840a6cccc086858b76ddc263a0e61149ae90e7a4e7a272
Sep 08 14:47:24.762280 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.762247    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:47:24.762366 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.762315    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:47:24.762366 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:24.762345    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:47:25.179443 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:25.179352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" event={"ID":"aca6e881-e52b-44d7-9db2-649f48e01af7","Type":"ContainerStarted","Data":"9e74878c454963d369f819224060c32ba2cde2d9d51e9865c89e6328db13048e"}
Sep 08 14:47:25.179443 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:25.179401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" event={"ID":"aca6e881-e52b-44d7-9db2-649f48e01af7","Type":"ContainerStarted","Data":"f9fbd508377f033b1f840a6cccc086858b76ddc263a0e61149ae90e7a4e7a272"}
Sep 08 14:47:25.202351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:25.202280    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" podStartSLOduration=1.2022566399999999 podStartE2EDuration="1.20225664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:47:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:47:25.199716195 +0000 UTC m=+789.210236221" watchObservedRunningTime="2026-09-08 14:47:25.20225664 +0000 UTC m=+789.212776641"
Sep 08 14:47:25.476292 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:25.476258    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:25.481360 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:25.481327    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:26.184209 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:26.184177    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:26.185192 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:26.185174    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:28.417338 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:28.417291    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"]
Sep 08 14:47:28.420828 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:28.420806    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:28.425570 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:47:28.425539    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv\" is forbidden: User \"system:node:ip-10-0-129-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-248.ec2.internal' and this object" podUID="11762d08-b4ce-4d9d-b5e1-2741ec44d555" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:28.425702 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:47:28.425590    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-ait-8066138e\" is forbidden: User \"system:node:ip-10-0-129-248.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-248.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8066138e\"" type="*v1.ConfigMap"
Sep 08 14:47:28.444613 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:28.444578    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"]
Sep 08 14:47:28.538741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:28.538700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvlpl\" (UniqueName: \"kubernetes.io/projected/11762d08-b4ce-4d9d-b5e1-2741ec44d555-kube-api-access-zvlpl\") pod \"payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv\" (UID: \"11762d08-b4ce-4d9d-b5e1-2741ec44d555\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:28.539038 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:28.539012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11762d08-b4ce-4d9d-b5e1-2741ec44d555-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv\" (UID: \"11762d08-b4ce-4d9d-b5e1-2741ec44d555\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:28.640241 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:28.640188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlpl\" (UniqueName: \"kubernetes.io/projected/11762d08-b4ce-4d9d-b5e1-2741ec44d555-kube-api-access-zvlpl\") pod \"payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv\" (UID: \"11762d08-b4ce-4d9d-b5e1-2741ec44d555\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:28.640456 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:28.640279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11762d08-b4ce-4d9d-b5e1-2741ec44d555-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv\" (UID: \"11762d08-b4ce-4d9d-b5e1-2741ec44d555\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:28.654671 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:28.654635    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvlpl\" (UniqueName: \"kubernetes.io/projected/11762d08-b4ce-4d9d-b5e1-2741ec44d555-kube-api-access-zvlpl\") pod \"payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv\" (UID: \"11762d08-b4ce-4d9d-b5e1-2741ec44d555\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:29.639934 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:29.639904    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8066138e\""
Sep 08 14:47:29.641527 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:29.641504    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11762d08-b4ce-4d9d-b5e1-2741ec44d555-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv\" (UID: \"11762d08-b4ce-4d9d-b5e1-2741ec44d555\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:29.934371 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:29.934272    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:30.206743 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:30.206709    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"]
Sep 08 14:47:30.208560 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:47:30.208538    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11762d08_b4ce_4d9d_b5e1_2741ec44d555.slice/crio-fa084c96b80e6ba7fb26bc0a02148300c1b41aa20bb764813a35c8849d93f286 WatchSource:0}: Error finding container fa084c96b80e6ba7fb26bc0a02148300c1b41aa20bb764813a35c8849d93f286: Status 404 returned error can't find the container with id fa084c96b80e6ba7fb26bc0a02148300c1b41aa20bb764813a35c8849d93f286
Sep 08 14:47:31.209762 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:31.209727    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv" event={"ID":"11762d08-b4ce-4d9d-b5e1-2741ec44d555","Type":"ContainerStarted","Data":"6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca"}
Sep 08 14:47:31.210248 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:31.209787    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv" event={"ID":"11762d08-b4ce-4d9d-b5e1-2741ec44d555","Type":"ContainerStarted","Data":"fa084c96b80e6ba7fb26bc0a02148300c1b41aa20bb764813a35c8849d93f286"}
Sep 08 14:47:31.210248 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:31.209820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:31.228292 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:31.228240    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv" podStartSLOduration=3.228223957 podStartE2EDuration="3.228223957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:47:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:47:31.225662529 +0000 UTC m=+795.236182529" watchObservedRunningTime="2026-09-08 14:47:31.228223957 +0000 UTC m=+795.238744007"
Sep 08 14:47:42.217000 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:42.216966    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:42.226300 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:42.226264    2561 patch_prober.go:28] interesting pod/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 14:47:42.226469 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:42.226336    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 14:47:44.281255 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:44.281136    2561 generic.go:356] "Generic (PLEG): container finished" podID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerID="9e74878c454963d369f819224060c32ba2cde2d9d51e9865c89e6328db13048e" exitCode=0
Sep 08 14:47:44.281255 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:44.281176    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" event={"ID":"aca6e881-e52b-44d7-9db2-649f48e01af7","Type":"ContainerDied","Data":"9e74878c454963d369f819224060c32ba2cde2d9d51e9865c89e6328db13048e"}
Sep 08 14:47:44.281675 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:44.281626    2561 scope.go:117] "RemoveContainer" containerID="9e74878c454963d369f819224060c32ba2cde2d9d51e9865c89e6328db13048e"
Sep 08 14:47:44.282847 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:44.282813    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:47:44.282932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:44.282916    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:47:44.282986 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:44.282956    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:47:45.292925 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:45.292882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" event={"ID":"aca6e881-e52b-44d7-9db2-649f48e01af7","Type":"ContainerStarted","Data":"8a7098c79c885e4e3d6cfb97a587db740b32bb04b555d31f589c401349e77ca0"}
Sep 08 14:47:45.475624 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:45.475585    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:45.475867 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:45.475845    2561 patch_prober.go:28] interesting pod/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 14:47:45.475919 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:45.475898    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 14:47:46.476385 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:46.476344    2561 patch_prober.go:28] interesting pod/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 14:47:46.476793 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:46.476406    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 14:47:47.476817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:47.476767    2561 patch_prober.go:28] interesting pod/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 14:47:47.477334 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:47.476831    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 14:47:48.475843 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:48.475802    2561 patch_prober.go:28] interesting pod/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 14:47:48.476007 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:48.475873    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 14:47:49.476668 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:49.476628    2561 patch_prober.go:28] interesting pod/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 14:47:49.477063 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:49.476688    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 14:47:50.723401 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:50.723363    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:50.723936 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:50.723808    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:50.725599 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:50.725563    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:47:52.304109 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:52.304074    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"]
Sep 08 14:47:52.308722 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:52.308703    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"
Sep 08 14:47:52.310966 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:52.310946    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pdpbl\""
Sep 08 14:47:52.315378 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:52.315348    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"]
Sep 08 14:47:52.493975 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:52.493833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb546661-6d09-4e90-badf-e3c2633b77f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8066138e-qfzkl\" (UID: \"fb546661-6d09-4e90-badf-e3c2633b77f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"
Sep 08 14:47:52.597008 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:52.595415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb546661-6d09-4e90-badf-e3c2633b77f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8066138e-qfzkl\" (UID: \"fb546661-6d09-4e90-badf-e3c2633b77f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"
Sep 08 14:47:52.597465 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:52.596623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb546661-6d09-4e90-badf-e3c2633b77f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8066138e-qfzkl\" (UID: \"fb546661-6d09-4e90-badf-e3c2633b77f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"
Sep 08 14:47:52.621409 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:52.621370    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"
Sep 08 14:47:52.899583 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:52.899459    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"]
Sep 08 14:47:52.902365 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:47:52.902336    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb546661_6d09_4e90_badf_e3c2633b77f4.slice/crio-6d31f63f2ad666f3fa5a703242e1aec0ab244a60052175900f4c457e0539aef4 WatchSource:0}: Error finding container 6d31f63f2ad666f3fa5a703242e1aec0ab244a60052175900f4c457e0539aef4: Status 404 returned error can't find the container with id 6d31f63f2ad666f3fa5a703242e1aec0ab244a60052175900f4c457e0539aef4
Sep 08 14:47:53.347244 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:53.347191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl" event={"ID":"fb546661-6d09-4e90-badf-e3c2633b77f4","Type":"ContainerStarted","Data":"ffd0db42ac77d3a17df4a541024fb57a82a28d722e3dec38899c4ec00c846556"}
Sep 08 14:47:53.347748 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:53.347269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl" event={"ID":"fb546661-6d09-4e90-badf-e3c2633b77f4","Type":"ContainerStarted","Data":"6d31f63f2ad666f3fa5a703242e1aec0ab244a60052175900f4c457e0539aef4"}
Sep 08 14:47:53.365495 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:53.365438    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl" podStartSLOduration=1.365417695 podStartE2EDuration="1.365417695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:47:53.362856714 +0000 UTC m=+817.373376714" watchObservedRunningTime="2026-09-08 14:47:53.365417695 +0000 UTC m=+817.375937695"
Sep 08 14:47:54.354336 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:54.354304    2561 generic.go:356] "Generic (PLEG): container finished" podID="fb546661-6d09-4e90-badf-e3c2633b77f4" containerID="ffd0db42ac77d3a17df4a541024fb57a82a28d722e3dec38899c4ec00c846556" exitCode=0
Sep 08 14:47:54.354718 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:54.354390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl" event={"ID":"fb546661-6d09-4e90-badf-e3c2633b77f4","Type":"ContainerDied","Data":"ffd0db42ac77d3a17df4a541024fb57a82a28d722e3dec38899c4ec00c846556"}
Sep 08 14:47:55.496839 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:55.496804    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"
Sep 08 14:47:55.527563 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:55.527532    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb546661-6d09-4e90-badf-e3c2633b77f4-maas-api-service-ca\") pod \"fb546661-6d09-4e90-badf-e3c2633b77f4\" (UID: \"fb546661-6d09-4e90-badf-e3c2633b77f4\") "
Sep 08 14:47:55.527960 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:55.527931    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb546661-6d09-4e90-badf-e3c2633b77f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fb546661-6d09-4e90-badf-e3c2633b77f4" (UID: "fb546661-6d09-4e90-badf-e3c2633b77f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:47:55.528112 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:55.528016    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb546661-6d09-4e90-badf-e3c2633b77f4-maas-api-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:47:56.365213 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:56.365179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl" event={"ID":"fb546661-6d09-4e90-badf-e3c2633b77f4","Type":"ContainerDied","Data":"6d31f63f2ad666f3fa5a703242e1aec0ab244a60052175900f4c457e0539aef4"}
Sep 08 14:47:56.365367 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:56.365222    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"
Sep 08 14:47:56.365367 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:56.365257    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d31f63f2ad666f3fa5a703242e1aec0ab244a60052175900f4c457e0539aef4"
Sep 08 14:47:58.537041 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.537008    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"]
Sep 08 14:47:58.537532 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.537295    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv" podUID="11762d08-b4ce-4d9d-b5e1-2741ec44d555" containerName="payload-pre-processing" containerID="cri-o://6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca" gracePeriod=30
Sep 08 14:47:58.751880 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.751845    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"]
Sep 08 14:47:58.755062 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.755033    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8066138e-qfzkl"]
Sep 08 14:47:58.813103 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.813077    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:58.862692 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.862655    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11762d08-b4ce-4d9d-b5e1-2741ec44d555-plugins-config-volume\") pod \"11762d08-b4ce-4d9d-b5e1-2741ec44d555\" (UID: \"11762d08-b4ce-4d9d-b5e1-2741ec44d555\") "
Sep 08 14:47:58.862896 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.862877    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvlpl\" (UniqueName: \"kubernetes.io/projected/11762d08-b4ce-4d9d-b5e1-2741ec44d555-kube-api-access-zvlpl\") pod \"11762d08-b4ce-4d9d-b5e1-2741ec44d555\" (UID: \"11762d08-b4ce-4d9d-b5e1-2741ec44d555\") "
Sep 08 14:47:58.863168 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.863119    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11762d08-b4ce-4d9d-b5e1-2741ec44d555-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "11762d08-b4ce-4d9d-b5e1-2741ec44d555" (UID: "11762d08-b4ce-4d9d-b5e1-2741ec44d555"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:47:58.863299 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.863279    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11762d08-b4ce-4d9d-b5e1-2741ec44d555-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:47:58.865332 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.865297    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11762d08-b4ce-4d9d-b5e1-2741ec44d555-kube-api-access-zvlpl" (OuterVolumeSpecName: "kube-api-access-zvlpl") pod "11762d08-b4ce-4d9d-b5e1-2741ec44d555" (UID: "11762d08-b4ce-4d9d-b5e1-2741ec44d555"). InnerVolumeSpecName "kube-api-access-zvlpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:47:58.964524 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:58.964488    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvlpl\" (UniqueName: \"kubernetes.io/projected/11762d08-b4ce-4d9d-b5e1-2741ec44d555-kube-api-access-zvlpl\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:47:59.383340 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.383303    2561 generic.go:356] "Generic (PLEG): container finished" podID="11762d08-b4ce-4d9d-b5e1-2741ec44d555" containerID="6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca" exitCode=0
Sep 08 14:47:59.383562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.383350    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"
Sep 08 14:47:59.383562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.383403    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv" event={"ID":"11762d08-b4ce-4d9d-b5e1-2741ec44d555","Type":"ContainerDied","Data":"6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca"}
Sep 08 14:47:59.383562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.383476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv" event={"ID":"11762d08-b4ce-4d9d-b5e1-2741ec44d555","Type":"ContainerDied","Data":"fa084c96b80e6ba7fb26bc0a02148300c1b41aa20bb764813a35c8849d93f286"}
Sep 08 14:47:59.383562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.383505    2561 scope.go:117] "RemoveContainer" containerID="6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca"
Sep 08 14:47:59.393030 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.393013    2561 scope.go:117] "RemoveContainer" containerID="6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca"
Sep 08 14:47:59.393340 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:47:59.393318    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca\": container with ID starting with 6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca not found: ID does not exist" containerID="6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca"
Sep 08 14:47:59.393442 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.393346    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca"} err="failed to get container status \"6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca\": rpc error: code = NotFound desc = could not find container \"6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca\": container with ID starting with 6f83835e9c94d80f78d0a67563fa8bb713f39800010187d25512273d7b9058ca not found: ID does not exist"
Sep 08 14:47:59.407295 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.407271    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"]
Sep 08 14:47:59.412062 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.412033    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8066138e-c5f96fbfd-s8xsv"]
Sep 08 14:47:59.846166 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.845072    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"]
Sep 08 14:47:59.846166 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:47:59.845368    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy" containerID="cri-o://8a7098c79c885e4e3d6cfb97a587db740b32bb04b555d31f589c401349e77ca0" gracePeriod=30
Sep 08 14:48:00.521473 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:00.521439    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11762d08-b4ce-4d9d-b5e1-2741ec44d555" path="/var/lib/kubelet/pods/11762d08-b4ce-4d9d-b5e1-2741ec44d555/volumes"
Sep 08 14:48:00.521839 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:00.521826    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb546661-6d09-4e90-badf-e3c2633b77f4" path="/var/lib/kubelet/pods/fb546661-6d09-4e90-badf-e3c2633b77f4/volumes"
Sep 08 14:48:03.602714 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:03.602677    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"]
Sep 08 14:48:03.603314 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:03.602933    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb" podUID="6687e7e0-a140-42f3-ad7c-0cc4a1464701" containerName="payload-processing" containerID="cri-o://78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36" gracePeriod=30
Sep 08 14:48:03.902553 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:03.902528    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:48:04.038116 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.038071    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6687e7e0-a140-42f3-ad7c-0cc4a1464701-plugins-config-volume\") pod \"6687e7e0-a140-42f3-ad7c-0cc4a1464701\" (UID: \"6687e7e0-a140-42f3-ad7c-0cc4a1464701\") "
Sep 08 14:48:04.038116 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.038123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6t5k\" (UniqueName: \"kubernetes.io/projected/6687e7e0-a140-42f3-ad7c-0cc4a1464701-kube-api-access-p6t5k\") pod \"6687e7e0-a140-42f3-ad7c-0cc4a1464701\" (UID: \"6687e7e0-a140-42f3-ad7c-0cc4a1464701\") "
Sep 08 14:48:04.038527 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.038499    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6687e7e0-a140-42f3-ad7c-0cc4a1464701-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6687e7e0-a140-42f3-ad7c-0cc4a1464701" (UID: "6687e7e0-a140-42f3-ad7c-0cc4a1464701"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:48:04.040462 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.040442    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6687e7e0-a140-42f3-ad7c-0cc4a1464701-kube-api-access-p6t5k" (OuterVolumeSpecName: "kube-api-access-p6t5k") pod "6687e7e0-a140-42f3-ad7c-0cc4a1464701" (UID: "6687e7e0-a140-42f3-ad7c-0cc4a1464701"). InnerVolumeSpecName "kube-api-access-p6t5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:04.139811 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.139715    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6687e7e0-a140-42f3-ad7c-0cc4a1464701-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:04.139811 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.139744    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6t5k\" (UniqueName: \"kubernetes.io/projected/6687e7e0-a140-42f3-ad7c-0cc4a1464701-kube-api-access-p6t5k\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:04.412363 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.412266    2561 generic.go:356] "Generic (PLEG): container finished" podID="6687e7e0-a140-42f3-ad7c-0cc4a1464701" containerID="78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36" exitCode=0
Sep 08 14:48:04.412363 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.412318    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"
Sep 08 14:48:04.412559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.412312    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb" event={"ID":"6687e7e0-a140-42f3-ad7c-0cc4a1464701","Type":"ContainerDied","Data":"78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36"}
Sep 08 14:48:04.412559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.412442    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb" event={"ID":"6687e7e0-a140-42f3-ad7c-0cc4a1464701","Type":"ContainerDied","Data":"9965c76e3ed971e8fda207513016bde08bf8e69276cd5a143000d9c3776e020f"}
Sep 08 14:48:04.412559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.412475    2561 scope.go:117] "RemoveContainer" containerID="78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36"
Sep 08 14:48:04.422831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.422811    2561 scope.go:117] "RemoveContainer" containerID="78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36"
Sep 08 14:48:04.423112 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:48:04.423092    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36\": container with ID starting with 78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36 not found: ID does not exist" containerID="78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36"
Sep 08 14:48:04.423191 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.423120    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36"} err="failed to get container status \"78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36\": rpc error: code = NotFound desc = could not find container \"78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36\": container with ID starting with 78b316e755e82dbe8890aae4cbce7062bbaa2b610f7a9f0ec9c3fc873e366c36 not found: ID does not exist"
Sep 08 14:48:04.437740 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.437713    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"]
Sep 08 14:48:04.446218 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.446156    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-71518b-579b68988f-9gdtb"]
Sep 08 14:48:04.521279 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:04.521248    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6687e7e0-a140-42f3-ad7c-0cc4a1464701" path="/var/lib/kubelet/pods/6687e7e0-a140-42f3-ad7c-0cc4a1464701/volumes"
Sep 08 14:48:05.006708 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.006674    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"]
Sep 08 14:48:05.007083 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.007061    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11762d08-b4ce-4d9d-b5e1-2741ec44d555" containerName="payload-pre-processing"
Sep 08 14:48:05.007083 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.007072    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="11762d08-b4ce-4d9d-b5e1-2741ec44d555" containerName="payload-pre-processing"
Sep 08 14:48:05.007188 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.007086    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb546661-6d09-4e90-badf-e3c2633b77f4" containerName="revoke-keys"
Sep 08 14:48:05.007188 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.007093    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb546661-6d09-4e90-badf-e3c2633b77f4" containerName="revoke-keys"
Sep 08 14:48:05.007188 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.007112    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6687e7e0-a140-42f3-ad7c-0cc4a1464701" containerName="payload-processing"
Sep 08 14:48:05.007188 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.007119    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6687e7e0-a140-42f3-ad7c-0cc4a1464701" containerName="payload-processing"
Sep 08 14:48:05.007318 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.007208    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6687e7e0-a140-42f3-ad7c-0cc4a1464701" containerName="payload-processing"
Sep 08 14:48:05.007318 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.007222    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb546661-6d09-4e90-badf-e3c2633b77f4" containerName="revoke-keys"
Sep 08 14:48:05.007318 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.007230    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="11762d08-b4ce-4d9d-b5e1-2741ec44d555" containerName="payload-pre-processing"
Sep 08 14:48:05.010487 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.010462    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:05.012467 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.012437    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"]
Sep 08 14:48:05.013464 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.013444    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-02cfd933-dockercfg-nh5qw\""
Sep 08 14:48:05.013754 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.013738    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-02cfd933\""
Sep 08 14:48:05.015651 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.015632    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:05.025437 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.025413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"]
Sep 08 14:48:05.028401 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.028379    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"]
Sep 08 14:48:05.149995 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.149885    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aa855e1-92f5-4d0a-9b09-64e0553644c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9\" (UID: \"1aa855e1-92f5-4d0a-9b09-64e0553644c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:05.150218 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.149991    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92a13a86-9fa8-4200-a2bb-e815b7125c35-plugins-config-volume\") pod \"payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7\" (UID: \"92a13a86-9fa8-4200-a2bb-e815b7125c35\") " pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:05.150218 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.150085    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzkvb\" (UniqueName: \"kubernetes.io/projected/92a13a86-9fa8-4200-a2bb-e815b7125c35-kube-api-access-hzkvb\") pod \"payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7\" (UID: \"92a13a86-9fa8-4200-a2bb-e815b7125c35\") " pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:05.150218 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.150207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcfwq\" (UniqueName: \"kubernetes.io/projected/1aa855e1-92f5-4d0a-9b09-64e0553644c5-kube-api-access-pcfwq\") pod \"payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9\" (UID: \"1aa855e1-92f5-4d0a-9b09-64e0553644c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:05.250788 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.250750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aa855e1-92f5-4d0a-9b09-64e0553644c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9\" (UID: \"1aa855e1-92f5-4d0a-9b09-64e0553644c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:05.250972 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.250810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92a13a86-9fa8-4200-a2bb-e815b7125c35-plugins-config-volume\") pod \"payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7\" (UID: \"92a13a86-9fa8-4200-a2bb-e815b7125c35\") " pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:05.250972 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.250856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzkvb\" (UniqueName: \"kubernetes.io/projected/92a13a86-9fa8-4200-a2bb-e815b7125c35-kube-api-access-hzkvb\") pod \"payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7\" (UID: \"92a13a86-9fa8-4200-a2bb-e815b7125c35\") " pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:05.251096 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.251022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcfwq\" (UniqueName: \"kubernetes.io/projected/1aa855e1-92f5-4d0a-9b09-64e0553644c5-kube-api-access-pcfwq\") pod \"payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9\" (UID: \"1aa855e1-92f5-4d0a-9b09-64e0553644c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:05.251552 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.251534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aa855e1-92f5-4d0a-9b09-64e0553644c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9\" (UID: \"1aa855e1-92f5-4d0a-9b09-64e0553644c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:05.251629 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.251611    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92a13a86-9fa8-4200-a2bb-e815b7125c35-plugins-config-volume\") pod \"payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7\" (UID: \"92a13a86-9fa8-4200-a2bb-e815b7125c35\") " pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:05.259259 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.259235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcfwq\" (UniqueName: \"kubernetes.io/projected/1aa855e1-92f5-4d0a-9b09-64e0553644c5-kube-api-access-pcfwq\") pod \"payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9\" (UID: \"1aa855e1-92f5-4d0a-9b09-64e0553644c5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:05.259440 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.259421    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzkvb\" (UniqueName: \"kubernetes.io/projected/92a13a86-9fa8-4200-a2bb-e815b7125c35-kube-api-access-hzkvb\") pod \"payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7\" (UID: \"92a13a86-9fa8-4200-a2bb-e815b7125c35\") " pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:05.321348 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.321310    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:05.330513 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.330487    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:05.424204 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.424175    2561 generic.go:356] "Generic (PLEG): container finished" podID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerID="8a7098c79c885e4e3d6cfb97a587db740b32bb04b555d31f589c401349e77ca0" exitCode=0
Sep 08 14:48:05.424387 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.424280    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" event={"ID":"aca6e881-e52b-44d7-9db2-649f48e01af7","Type":"ContainerDied","Data":"8a7098c79c885e4e3d6cfb97a587db740b32bb04b555d31f589c401349e77ca0"}
Sep 08 14:48:05.424387 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.424368    2561 scope.go:117] "RemoveContainer" containerID="9e74878c454963d369f819224060c32ba2cde2d9d51e9865c89e6328db13048e"
Sep 08 14:48:05.524612 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.524586    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:48:05.619288 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.618866    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"]
Sep 08 14:48:05.619288 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:48:05.619219    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa855e1_92f5_4d0a_9b09_64e0553644c5.slice/crio-32c033f84f66b596b99613f39894152c3fa837641aa844080550e1aa6203ae98 WatchSource:0}: Error finding container 32c033f84f66b596b99613f39894152c3fa837641aa844080550e1aa6203ae98: Status 404 returned error can't find the container with id 32c033f84f66b596b99613f39894152c3fa837641aa844080550e1aa6203ae98
Sep 08 14:48:05.621457 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.621436    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"]
Sep 08 14:48:05.622797 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:48:05.622774    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a13a86_9fa8_4200_a2bb_e815b7125c35.slice/crio-6b503b596d3a5303619a0cf5180a1f8ba6e431f0b153c442e2b974222d184cee WatchSource:0}: Error finding container 6b503b596d3a5303619a0cf5180a1f8ba6e431f0b153c442e2b974222d184cee: Status 404 returned error can't find the container with id 6b503b596d3a5303619a0cf5180a1f8ba6e431f0b153c442e2b974222d184cee
Sep 08 14:48:05.654820 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.654800    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj62n\" (UniqueName: \"kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-kube-api-access-qj62n\") pod \"aca6e881-e52b-44d7-9db2-649f48e01af7\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") "
Sep 08 14:48:05.654927 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.654842    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca6e881-e52b-44d7-9db2-649f48e01af7-istiod-ca-cert\") pod \"aca6e881-e52b-44d7-9db2-649f48e01af7\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") "
Sep 08 14:48:05.654927 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.654868    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-podinfo\") pod \"aca6e881-e52b-44d7-9db2-649f48e01af7\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") "
Sep 08 14:48:05.654927 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.654923    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-envoy\") pod \"aca6e881-e52b-44d7-9db2-649f48e01af7\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") "
Sep 08 14:48:05.655073 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.654953    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-data\") pod \"aca6e881-e52b-44d7-9db2-649f48e01af7\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") "
Sep 08 14:48:05.655073 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.654988    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-socket\") pod \"aca6e881-e52b-44d7-9db2-649f48e01af7\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") "
Sep 08 14:48:05.655073 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655032    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-token\") pod \"aca6e881-e52b-44d7-9db2-649f48e01af7\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") "
Sep 08 14:48:05.655073 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655066    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-credential-socket\") pod \"aca6e881-e52b-44d7-9db2-649f48e01af7\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") "
Sep 08 14:48:05.655315 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-certs\") pod \"aca6e881-e52b-44d7-9db2-649f48e01af7\" (UID: \"aca6e881-e52b-44d7-9db2-649f48e01af7\") "
Sep 08 14:48:05.655388 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655315    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aca6e881-e52b-44d7-9db2-649f48e01af7" (UID: "aca6e881-e52b-44d7-9db2-649f48e01af7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:05.655388 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655334    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aca6e881-e52b-44d7-9db2-649f48e01af7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aca6e881-e52b-44d7-9db2-649f48e01af7" (UID: "aca6e881-e52b-44d7-9db2-649f48e01af7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:48:05.655489 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655331    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-data" (OuterVolumeSpecName: "istio-data") pod "aca6e881-e52b-44d7-9db2-649f48e01af7" (UID: "aca6e881-e52b-44d7-9db2-649f48e01af7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:05.655551 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655531    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aca6e881-e52b-44d7-9db2-649f48e01af7" (UID: "aca6e881-e52b-44d7-9db2-649f48e01af7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:05.655551 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655542    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aca6e881-e52b-44d7-9db2-649f48e01af7" (UID: "aca6e881-e52b-44d7-9db2-649f48e01af7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:05.655882 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655859    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:05.655948 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655886    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca6e881-e52b-44d7-9db2-649f48e01af7-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:05.655948 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655900    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:05.655948 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655912    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:05.655948 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.655926    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:05.657461 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.657423    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-kube-api-access-qj62n" (OuterVolumeSpecName: "kube-api-access-qj62n") pod "aca6e881-e52b-44d7-9db2-649f48e01af7" (UID: "aca6e881-e52b-44d7-9db2-649f48e01af7"). InnerVolumeSpecName "kube-api-access-qj62n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:05.657976 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.657951    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aca6e881-e52b-44d7-9db2-649f48e01af7" (UID: "aca6e881-e52b-44d7-9db2-649f48e01af7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:05.657976 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.657964    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-token" (OuterVolumeSpecName: "istio-token") pod "aca6e881-e52b-44d7-9db2-649f48e01af7" (UID: "aca6e881-e52b-44d7-9db2-649f48e01af7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:05.658184 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.657974    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aca6e881-e52b-44d7-9db2-649f48e01af7" (UID: "aca6e881-e52b-44d7-9db2-649f48e01af7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:48:05.757549 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.757514    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:05.757549 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.757549    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj62n\" (UniqueName: \"kubernetes.io/projected/aca6e881-e52b-44d7-9db2-649f48e01af7-kube-api-access-qj62n\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:05.757762 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.757566    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:05.757762 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:05.757581    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca6e881-e52b-44d7-9db2-649f48e01af7-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:06.431566 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.431529    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"
Sep 08 14:48:06.431566 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.431558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb" event={"ID":"aca6e881-e52b-44d7-9db2-649f48e01af7","Type":"ContainerDied","Data":"f9fbd508377f033b1f840a6cccc086858b76ddc263a0e61149ae90e7a4e7a272"}
Sep 08 14:48:06.432136 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.431633    2561 scope.go:117] "RemoveContainer" containerID="8a7098c79c885e4e3d6cfb97a587db740b32bb04b555d31f589c401349e77ca0"
Sep 08 14:48:06.433535 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.433510    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7" event={"ID":"92a13a86-9fa8-4200-a2bb-e815b7125c35","Type":"ContainerStarted","Data":"545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1"}
Sep 08 14:48:06.433659 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.433559    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7" event={"ID":"92a13a86-9fa8-4200-a2bb-e815b7125c35","Type":"ContainerStarted","Data":"6b503b596d3a5303619a0cf5180a1f8ba6e431f0b153c442e2b974222d184cee"}
Sep 08 14:48:06.433659 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.433589    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:06.438428 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.438392    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9" event={"ID":"1aa855e1-92f5-4d0a-9b09-64e0553644c5","Type":"ContainerStarted","Data":"c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a"}
Sep 08 14:48:06.438559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.438439    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9" event={"ID":"1aa855e1-92f5-4d0a-9b09-64e0553644c5","Type":"ContainerStarted","Data":"32c033f84f66b596b99613f39894152c3fa837641aa844080550e1aa6203ae98"}
Sep 08 14:48:06.438559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.438469    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:06.453639 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.453594    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7" podStartSLOduration=2.4535791 podStartE2EDuration="2.4535791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:48:06.451610959 +0000 UTC m=+830.462130959" watchObservedRunningTime="2026-09-08 14:48:06.4535791 +0000 UTC m=+830.464099099"
Sep 08 14:48:06.465523 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.465492    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"]
Sep 08 14:48:06.471711 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.471683    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8066138e-openshift-default-7bcd9974b6-crpzb"]
Sep 08 14:48:06.484718 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.484657    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9" podStartSLOduration=2.484639945 podStartE2EDuration="2.484639945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:48:06.484577036 +0000 UTC m=+830.495097035" watchObservedRunningTime="2026-09-08 14:48:06.484639945 +0000 UTC m=+830.495159945"
Sep 08 14:48:06.523672 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:06.523636    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" path="/var/lib/kubelet/pods/aca6e881-e52b-44d7-9db2-649f48e01af7/volumes"
Sep 08 14:48:10.834731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:10.834687    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"]
Sep 08 14:48:10.835232 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:10.834995    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy" containerID="cri-o://dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca" gracePeriod=30
Sep 08 14:48:14.462487 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:14.462447    2561 patch_prober.go:28] interesting pod/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:48:14.462894 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:14.462514    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:48:16.078522 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.078494    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:48:16.270265 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270229    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn7n7\" (UniqueName: \"kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-kube-api-access-cn7n7\") pod \"e79fc882-4514-48ed-9dff-db183cf97c00\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") "
Sep 08 14:48:16.270453 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270277    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-data\") pod \"e79fc882-4514-48ed-9dff-db183cf97c00\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") "
Sep 08 14:48:16.270453 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270297    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-credential-socket\") pod \"e79fc882-4514-48ed-9dff-db183cf97c00\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") "
Sep 08 14:48:16.270453 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270316    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-istio-token\") pod \"e79fc882-4514-48ed-9dff-db183cf97c00\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") "
Sep 08 14:48:16.270453 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270375    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e79fc882-4514-48ed-9dff-db183cf97c00-istiod-ca-cert\") pod \"e79fc882-4514-48ed-9dff-db183cf97c00\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") "
Sep 08 14:48:16.270453 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270398    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e79fc882-4514-48ed-9dff-db183cf97c00-istio-podinfo\") pod \"e79fc882-4514-48ed-9dff-db183cf97c00\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") "
Sep 08 14:48:16.270717 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270487    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-envoy\") pod \"e79fc882-4514-48ed-9dff-db183cf97c00\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") "
Sep 08 14:48:16.270717 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270532    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-certs\") pod \"e79fc882-4514-48ed-9dff-db183cf97c00\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") "
Sep 08 14:48:16.270717 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270546    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-data" (OuterVolumeSpecName: "istio-data") pod "e79fc882-4514-48ed-9dff-db183cf97c00" (UID: "e79fc882-4514-48ed-9dff-db183cf97c00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:16.270717 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270559    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-socket\") pod \"e79fc882-4514-48ed-9dff-db183cf97c00\" (UID: \"e79fc882-4514-48ed-9dff-db183cf97c00\") "
Sep 08 14:48:16.270717 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270575    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e79fc882-4514-48ed-9dff-db183cf97c00" (UID: "e79fc882-4514-48ed-9dff-db183cf97c00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:16.270717 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270710    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e79fc882-4514-48ed-9dff-db183cf97c00" (UID: "e79fc882-4514-48ed-9dff-db183cf97c00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:16.271018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270759    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e79fc882-4514-48ed-9dff-db183cf97c00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e79fc882-4514-48ed-9dff-db183cf97c00" (UID: "e79fc882-4514-48ed-9dff-db183cf97c00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:48:16.271018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.270908    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e79fc882-4514-48ed-9dff-db183cf97c00" (UID: "e79fc882-4514-48ed-9dff-db183cf97c00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:16.271125 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.271020    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e79fc882-4514-48ed-9dff-db183cf97c00-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:16.271125 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.271041    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:16.271125 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.271055    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:16.271125 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.271069    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:16.271125 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.271083    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:16.272828 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.272797    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-istio-token" (OuterVolumeSpecName: "istio-token") pod "e79fc882-4514-48ed-9dff-db183cf97c00" (UID: "e79fc882-4514-48ed-9dff-db183cf97c00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:16.272828 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.272819    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-kube-api-access-cn7n7" (OuterVolumeSpecName: "kube-api-access-cn7n7") pod "e79fc882-4514-48ed-9dff-db183cf97c00" (UID: "e79fc882-4514-48ed-9dff-db183cf97c00"). InnerVolumeSpecName "kube-api-access-cn7n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:16.273011 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.272946    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e79fc882-4514-48ed-9dff-db183cf97c00" (UID: "e79fc882-4514-48ed-9dff-db183cf97c00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:16.273170 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.273119    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e79fc882-4514-48ed-9dff-db183cf97c00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e79fc882-4514-48ed-9dff-db183cf97c00" (UID: "e79fc882-4514-48ed-9dff-db183cf97c00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:48:16.372606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.372572    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn7n7\" (UniqueName: \"kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-kube-api-access-cn7n7\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:16.372606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.372600    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e79fc882-4514-48ed-9dff-db183cf97c00-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:16.372606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.372609    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e79fc882-4514-48ed-9dff-db183cf97c00-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:16.372606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.372617    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e79fc882-4514-48ed-9dff-db183cf97c00-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:16.492393 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.492353    2561 generic.go:356] "Generic (PLEG): container finished" podID="e79fc882-4514-48ed-9dff-db183cf97c00" containerID="dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca" exitCode=0
Sep 08 14:48:16.492570 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.492420    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"
Sep 08 14:48:16.492570 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.492435    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" event={"ID":"e79fc882-4514-48ed-9dff-db183cf97c00","Type":"ContainerDied","Data":"dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca"}
Sep 08 14:48:16.492570 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.492519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88" event={"ID":"e79fc882-4514-48ed-9dff-db183cf97c00","Type":"ContainerDied","Data":"85c12788b59391927488e558a60d74da661a25fd9fcdde2dfb12e360e77dd756"}
Sep 08 14:48:16.492570 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.492541    2561 scope.go:117] "RemoveContainer" containerID="dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca"
Sep 08 14:48:16.502320 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.502302    2561 scope.go:117] "RemoveContainer" containerID="3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b"
Sep 08 14:48:16.510711 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.510693    2561 scope.go:117] "RemoveContainer" containerID="dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca"
Sep 08 14:48:16.511002 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:48:16.510980    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca\": container with ID starting with dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca not found: ID does not exist" containerID="dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca"
Sep 08 14:48:16.511055 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.511012    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca"} err="failed to get container status \"dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca\": rpc error: code = NotFound desc = could not find container \"dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca\": container with ID starting with dbf4e9e2616c4770186396d8db844e707e5dc32eccec42234bc648d9789e3eca not found: ID does not exist"
Sep 08 14:48:16.511055 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.511031    2561 scope.go:117] "RemoveContainer" containerID="3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b"
Sep 08 14:48:16.511344 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:48:16.511323    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b\": container with ID starting with 3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b not found: ID does not exist" containerID="3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b"
Sep 08 14:48:16.511411 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.511348    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b"} err="failed to get container status \"3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b\": rpc error: code = NotFound desc = could not find container \"3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b\": container with ID starting with 3e7762e856d5dba1b602a90228b7c2e3d00c77638a34acc3a0f7c845be57ac6b not found: ID does not exist"
Sep 08 14:48:16.524239 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.524219    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"]
Sep 08 14:48:16.524314 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.524252    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-71518b-openshift-default-796cf4cc46-jcq88"]
Sep 08 14:48:16.778983 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.778883    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"]
Sep 08 14:48:16.779390 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.779363    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy"
Sep 08 14:48:16.779390 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.779387    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy"
Sep 08 14:48:16.779574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.779401    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy"
Sep 08 14:48:16.779574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.779409    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy"
Sep 08 14:48:16.779574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.779436    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy"
Sep 08 14:48:16.779574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.779445    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy"
Sep 08 14:48:16.779574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.779544    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy"
Sep 08 14:48:16.779574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.779559    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy"
Sep 08 14:48:16.779574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.779566    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy"
Sep 08 14:48:16.779574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.779572    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" containerName="istio-proxy"
Sep 08 14:48:16.784341 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.784313    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:48:16.786602 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.786579    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-222cd5-dockercfg-wkrv5\""
Sep 08 14:48:16.786885 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.786864    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-222cd5\""
Sep 08 14:48:16.794865 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.794839    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"]
Sep 08 14:48:16.880609 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.877489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37967376-bccd-4164-bb12-d0f92864a8af-plugins-config-volume\") pod \"payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h\" (UID: \"37967376-bccd-4164-bb12-d0f92864a8af\") " pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:48:16.880609 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.877558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chfmn\" (UniqueName: \"kubernetes.io/projected/37967376-bccd-4164-bb12-d0f92864a8af-kube-api-access-chfmn\") pod \"payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h\" (UID: \"37967376-bccd-4164-bb12-d0f92864a8af\") " pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:48:16.978868 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.978823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chfmn\" (UniqueName: \"kubernetes.io/projected/37967376-bccd-4164-bb12-d0f92864a8af-kube-api-access-chfmn\") pod \"payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h\" (UID: \"37967376-bccd-4164-bb12-d0f92864a8af\") " pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:48:16.979073 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.978966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37967376-bccd-4164-bb12-d0f92864a8af-plugins-config-volume\") pod \"payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h\" (UID: \"37967376-bccd-4164-bb12-d0f92864a8af\") " pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:48:16.979671 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.979652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37967376-bccd-4164-bb12-d0f92864a8af-plugins-config-volume\") pod \"payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h\" (UID: \"37967376-bccd-4164-bb12-d0f92864a8af\") " pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:48:16.987733 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:16.987702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chfmn\" (UniqueName: \"kubernetes.io/projected/37967376-bccd-4164-bb12-d0f92864a8af-kube-api-access-chfmn\") pod \"payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h\" (UID: \"37967376-bccd-4164-bb12-d0f92864a8af\") " pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:48:17.098746 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:17.098654    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:48:17.375574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:17.375538    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"]
Sep 08 14:48:17.376953 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:48:17.376921    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37967376_bccd_4164_bb12_d0f92864a8af.slice/crio-3aa26295cb91a163b8f0e91cbcbc079d60df5e0c88f646743d8b371354ad547d WatchSource:0}: Error finding container 3aa26295cb91a163b8f0e91cbcbc079d60df5e0c88f646743d8b371354ad547d: Status 404 returned error can't find the container with id 3aa26295cb91a163b8f0e91cbcbc079d60df5e0c88f646743d8b371354ad547d
Sep 08 14:48:17.447096 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:17.447074    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:17.447262 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:17.447136    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:17.508235 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:17.503248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h" event={"ID":"37967376-bccd-4164-bb12-d0f92864a8af","Type":"ContainerStarted","Data":"a1ea2ba4f30473af3ffb885652cf1769ade18c07b9b72804585a36430eb0eda4"}
Sep 08 14:48:17.508235 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:17.503321    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h" event={"ID":"37967376-bccd-4164-bb12-d0f92864a8af","Type":"ContainerStarted","Data":"3aa26295cb91a163b8f0e91cbcbc079d60df5e0c88f646743d8b371354ad547d"}
Sep 08 14:48:17.508235 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:17.503407    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:48:17.525672 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:17.525612    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h" podStartSLOduration=1.52559514 podStartE2EDuration="1.52559514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:48:17.523067922 +0000 UTC m=+841.533587923" watchObservedRunningTime="2026-09-08 14:48:17.52559514 +0000 UTC m=+841.536115168"
Sep 08 14:48:18.521053 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:18.521022    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e79fc882-4514-48ed-9dff-db183cf97c00" path="/var/lib/kubelet/pods/e79fc882-4514-48ed-9dff-db183cf97c00/volumes"
Sep 08 14:48:28.512518 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:28.512486    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:48:35.113235 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.113199    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"]
Sep 08 14:48:35.113674 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.113464    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7" podUID="92a13a86-9fa8-4200-a2bb-e815b7125c35" containerName="payload-processing" containerID="cri-o://545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1" gracePeriod=30
Sep 08 14:48:35.120203 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.120132    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"]
Sep 08 14:48:35.120601 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.120551    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9" podUID="1aa855e1-92f5-4d0a-9b09-64e0553644c5" containerName="payload-pre-processing" containerID="cri-o://c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a" gracePeriod=30
Sep 08 14:48:35.364929 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.364860    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:35.428023 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.427993    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:35.456038 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.454128    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzkvb\" (UniqueName: \"kubernetes.io/projected/92a13a86-9fa8-4200-a2bb-e815b7125c35-kube-api-access-hzkvb\") pod \"92a13a86-9fa8-4200-a2bb-e815b7125c35\" (UID: \"92a13a86-9fa8-4200-a2bb-e815b7125c35\") "
Sep 08 14:48:35.456038 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.454617    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92a13a86-9fa8-4200-a2bb-e815b7125c35-plugins-config-volume\") pod \"92a13a86-9fa8-4200-a2bb-e815b7125c35\" (UID: \"92a13a86-9fa8-4200-a2bb-e815b7125c35\") "
Sep 08 14:48:35.456038 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.455356    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a13a86-9fa8-4200-a2bb-e815b7125c35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "92a13a86-9fa8-4200-a2bb-e815b7125c35" (UID: "92a13a86-9fa8-4200-a2bb-e815b7125c35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:48:35.458545 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.458512    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a13a86-9fa8-4200-a2bb-e815b7125c35-kube-api-access-hzkvb" (OuterVolumeSpecName: "kube-api-access-hzkvb") pod "92a13a86-9fa8-4200-a2bb-e815b7125c35" (UID: "92a13a86-9fa8-4200-a2bb-e815b7125c35"). InnerVolumeSpecName "kube-api-access-hzkvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:35.555359 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.555321    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcfwq\" (UniqueName: \"kubernetes.io/projected/1aa855e1-92f5-4d0a-9b09-64e0553644c5-kube-api-access-pcfwq\") pod \"1aa855e1-92f5-4d0a-9b09-64e0553644c5\" (UID: \"1aa855e1-92f5-4d0a-9b09-64e0553644c5\") "
Sep 08 14:48:35.555518 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.555373    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aa855e1-92f5-4d0a-9b09-64e0553644c5-plugins-config-volume\") pod \"1aa855e1-92f5-4d0a-9b09-64e0553644c5\" (UID: \"1aa855e1-92f5-4d0a-9b09-64e0553644c5\") "
Sep 08 14:48:35.555781 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.555756    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzkvb\" (UniqueName: \"kubernetes.io/projected/92a13a86-9fa8-4200-a2bb-e815b7125c35-kube-api-access-hzkvb\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:35.555914 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.555786    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92a13a86-9fa8-4200-a2bb-e815b7125c35-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:35.555914 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.555812    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aa855e1-92f5-4d0a-9b09-64e0553644c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1aa855e1-92f5-4d0a-9b09-64e0553644c5" (UID: "1aa855e1-92f5-4d0a-9b09-64e0553644c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:48:35.557581 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.557558    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa855e1-92f5-4d0a-9b09-64e0553644c5-kube-api-access-pcfwq" (OuterVolumeSpecName: "kube-api-access-pcfwq") pod "1aa855e1-92f5-4d0a-9b09-64e0553644c5" (UID: "1aa855e1-92f5-4d0a-9b09-64e0553644c5"). InnerVolumeSpecName "kube-api-access-pcfwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:35.602421 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.602380    2561 generic.go:356] "Generic (PLEG): container finished" podID="92a13a86-9fa8-4200-a2bb-e815b7125c35" containerID="545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1" exitCode=0
Sep 08 14:48:35.602421 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.602432    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"
Sep 08 14:48:35.602687 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.602472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7" event={"ID":"92a13a86-9fa8-4200-a2bb-e815b7125c35","Type":"ContainerDied","Data":"545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1"}
Sep 08 14:48:35.602687 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.602535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7" event={"ID":"92a13a86-9fa8-4200-a2bb-e815b7125c35","Type":"ContainerDied","Data":"6b503b596d3a5303619a0cf5180a1f8ba6e431f0b153c442e2b974222d184cee"}
Sep 08 14:48:35.602687 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.602585    2561 scope.go:117] "RemoveContainer" containerID="545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1"
Sep 08 14:48:35.605181 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.605114    2561 generic.go:356] "Generic (PLEG): container finished" podID="1aa855e1-92f5-4d0a-9b09-64e0553644c5" containerID="c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a" exitCode=0
Sep 08 14:48:35.605299 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.605266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9" event={"ID":"1aa855e1-92f5-4d0a-9b09-64e0553644c5","Type":"ContainerDied","Data":"c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a"}
Sep 08 14:48:35.605441 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.605420    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"
Sep 08 14:48:35.605772 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.605307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9" event={"ID":"1aa855e1-92f5-4d0a-9b09-64e0553644c5","Type":"ContainerDied","Data":"32c033f84f66b596b99613f39894152c3fa837641aa844080550e1aa6203ae98"}
Sep 08 14:48:35.618951 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.618819    2561 scope.go:117] "RemoveContainer" containerID="545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1"
Sep 08 14:48:35.620501 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:48:35.619986    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1\": container with ID starting with 545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1 not found: ID does not exist" containerID="545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1"
Sep 08 14:48:35.620501 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.620041    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1"} err="failed to get container status \"545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1\": rpc error: code = NotFound desc = could not find container \"545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1\": container with ID starting with 545b42eba0b6bc13d293597d7e962b0938c97e347a070b5dea05aa5552dbddf1 not found: ID does not exist"
Sep 08 14:48:35.620501 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.620066    2561 scope.go:117] "RemoveContainer" containerID="c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a"
Sep 08 14:48:35.632568 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.632543    2561 scope.go:117] "RemoveContainer" containerID="c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a"
Sep 08 14:48:35.632905 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:48:35.632881    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a\": container with ID starting with c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a not found: ID does not exist" containerID="c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a"
Sep 08 14:48:35.632994 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.632916    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a"} err="failed to get container status \"c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a\": rpc error: code = NotFound desc = could not find container \"c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a\": container with ID starting with c381babe24b7fe160487aac84737dc34c4ef92961c8f3aa9306b2cf4af01608a not found: ID does not exist"
Sep 08 14:48:35.641138 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.641112    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"]
Sep 08 14:48:35.644468 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.644444    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-02cfd933-7c5d5ffd77-v9rj7"]
Sep 08 14:48:35.656974 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.656944    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aa855e1-92f5-4d0a-9b09-64e0553644c5-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:35.657247 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.656991    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcfwq\" (UniqueName: \"kubernetes.io/projected/1aa855e1-92f5-4d0a-9b09-64e0553644c5-kube-api-access-pcfwq\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:48:35.657247 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.657078    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"]
Sep 08 14:48:35.659607 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:35.659580    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-02cfd933-689f7776c8-znlh9"]
Sep 08 14:48:36.528538 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:36.528493    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa855e1-92f5-4d0a-9b09-64e0553644c5" path="/var/lib/kubelet/pods/1aa855e1-92f5-4d0a-9b09-64e0553644c5/volumes"
Sep 08 14:48:36.529014 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:48:36.528975    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92a13a86-9fa8-4200-a2bb-e815b7125c35" path="/var/lib/kubelet/pods/92a13a86-9fa8-4200-a2bb-e815b7125c35/volumes"
Sep 08 14:49:09.156784 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.156697    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"]
Sep 08 14:49:09.157292 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.157272    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a13a86-9fa8-4200-a2bb-e815b7125c35" containerName="payload-processing"
Sep 08 14:49:09.157384 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.157297    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a13a86-9fa8-4200-a2bb-e815b7125c35" containerName="payload-processing"
Sep 08 14:49:09.157384 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.157340    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy"
Sep 08 14:49:09.157384 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.157349    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca6e881-e52b-44d7-9db2-649f48e01af7" containerName="istio-proxy"
Sep 08 14:49:09.157384 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.157363    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa855e1-92f5-4d0a-9b09-64e0553644c5" containerName="payload-pre-processing"
Sep 08 14:49:09.157384 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.157371    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa855e1-92f5-4d0a-9b09-64e0553644c5" containerName="payload-pre-processing"
Sep 08 14:49:09.157579 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.157461    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa855e1-92f5-4d0a-9b09-64e0553644c5" containerName="payload-pre-processing"
Sep 08 14:49:09.157579 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.157480    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a13a86-9fa8-4200-a2bb-e815b7125c35" containerName="payload-processing"
Sep 08 14:49:09.161077 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.161054    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"
Sep 08 14:49:09.163470 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.163448    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pdpbl\""
Sep 08 14:49:09.171389 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.171355    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"]
Sep 08 14:49:09.214258 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.214222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/489962a4-7138-46cc-9677-e4f3548a0448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr\" (UID: \"489962a4-7138-46cc-9677-e4f3548a0448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"
Sep 08 14:49:09.315246 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.315212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/489962a4-7138-46cc-9677-e4f3548a0448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr\" (UID: \"489962a4-7138-46cc-9677-e4f3548a0448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"
Sep 08 14:49:09.316023 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.316000    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/489962a4-7138-46cc-9677-e4f3548a0448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr\" (UID: \"489962a4-7138-46cc-9677-e4f3548a0448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"
Sep 08 14:49:09.496499 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.496461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"
Sep 08 14:49:09.770949 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.770919    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"]
Sep 08 14:49:09.772787 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:49:09.772752    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489962a4_7138_46cc_9677_e4f3548a0448.slice/crio-e7a6ee3a8275854c68148e0bf870d62b12437af196dcd68d6837ac85e92133aa WatchSource:0}: Error finding container e7a6ee3a8275854c68148e0bf870d62b12437af196dcd68d6837ac85e92133aa: Status 404 returned error can't find the container with id e7a6ee3a8275854c68148e0bf870d62b12437af196dcd68d6837ac85e92133aa
Sep 08 14:49:09.786684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:09.786604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr" event={"ID":"489962a4-7138-46cc-9677-e4f3548a0448","Type":"ContainerStarted","Data":"e7a6ee3a8275854c68148e0bf870d62b12437af196dcd68d6837ac85e92133aa"}
Sep 08 14:49:10.794111 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:10.794019    2561 generic.go:356] "Generic (PLEG): container finished" podID="489962a4-7138-46cc-9677-e4f3548a0448" containerID="eb2b32daf3f6cd79bcf28ce7dc5aa116f2209674015d409cd1331d77363812fb" exitCode=0
Sep 08 14:49:10.794111 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:10.794074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr" event={"ID":"489962a4-7138-46cc-9677-e4f3548a0448","Type":"ContainerDied","Data":"eb2b32daf3f6cd79bcf28ce7dc5aa116f2209674015d409cd1331d77363812fb"}
Sep 08 14:49:11.934246 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:11.934215    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"
Sep 08 14:49:12.044543 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:12.044509    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/489962a4-7138-46cc-9677-e4f3548a0448-maas-api-service-ca\") pod \"489962a4-7138-46cc-9677-e4f3548a0448\" (UID: \"489962a4-7138-46cc-9677-e4f3548a0448\") "
Sep 08 14:49:12.044884 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:12.044861    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/489962a4-7138-46cc-9677-e4f3548a0448-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "489962a4-7138-46cc-9677-e4f3548a0448" (UID: "489962a4-7138-46cc-9677-e4f3548a0448"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:49:12.145556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:12.145460    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/489962a4-7138-46cc-9677-e4f3548a0448-maas-api-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:49:12.806487 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:12.806400    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"
Sep 08 14:49:12.806652 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:12.806406    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr" event={"ID":"489962a4-7138-46cc-9677-e4f3548a0448","Type":"ContainerDied","Data":"e7a6ee3a8275854c68148e0bf870d62b12437af196dcd68d6837ac85e92133aa"}
Sep 08 14:49:12.806652 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:12.806537    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7a6ee3a8275854c68148e0bf870d62b12437af196dcd68d6837ac85e92133aa"
Sep 08 14:49:16.491396 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:16.491365    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:49:16.493077 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:16.493050    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:49:19.666814 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:19.666775    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"]
Sep 08 14:49:19.667261 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:19.667066    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h" podUID="37967376-bccd-4164-bb12-d0f92864a8af" containerName="payload-processing" containerID="cri-o://a1ea2ba4f30473af3ffb885652cf1769ade18c07b9b72804585a36430eb0eda4" gracePeriod=30
Sep 08 14:49:19.830261 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:19.830227    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"]
Sep 08 14:49:19.838346 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:19.838313    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-222cd5-xpzcr"]
Sep 08 14:49:19.844574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:19.844535    2561 generic.go:356] "Generic (PLEG): container finished" podID="37967376-bccd-4164-bb12-d0f92864a8af" containerID="a1ea2ba4f30473af3ffb885652cf1769ade18c07b9b72804585a36430eb0eda4" exitCode=0
Sep 08 14:49:19.844722 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:19.844666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h" event={"ID":"37967376-bccd-4164-bb12-d0f92864a8af","Type":"ContainerDied","Data":"a1ea2ba4f30473af3ffb885652cf1769ade18c07b9b72804585a36430eb0eda4"}
Sep 08 14:49:19.939842 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:19.939817    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:49:20.027429 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.027373    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chfmn\" (UniqueName: \"kubernetes.io/projected/37967376-bccd-4164-bb12-d0f92864a8af-kube-api-access-chfmn\") pod \"37967376-bccd-4164-bb12-d0f92864a8af\" (UID: \"37967376-bccd-4164-bb12-d0f92864a8af\") "
Sep 08 14:49:20.027641 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.027475    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37967376-bccd-4164-bb12-d0f92864a8af-plugins-config-volume\") pod \"37967376-bccd-4164-bb12-d0f92864a8af\" (UID: \"37967376-bccd-4164-bb12-d0f92864a8af\") "
Sep 08 14:49:20.028210 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.028171    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37967376-bccd-4164-bb12-d0f92864a8af-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "37967376-bccd-4164-bb12-d0f92864a8af" (UID: "37967376-bccd-4164-bb12-d0f92864a8af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:49:20.030616 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.030589    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37967376-bccd-4164-bb12-d0f92864a8af-kube-api-access-chfmn" (OuterVolumeSpecName: "kube-api-access-chfmn") pod "37967376-bccd-4164-bb12-d0f92864a8af" (UID: "37967376-bccd-4164-bb12-d0f92864a8af"). InnerVolumeSpecName "kube-api-access-chfmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:49:20.128903 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.128865    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chfmn\" (UniqueName: \"kubernetes.io/projected/37967376-bccd-4164-bb12-d0f92864a8af-kube-api-access-chfmn\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:49:20.128903 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.128899    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37967376-bccd-4164-bb12-d0f92864a8af-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:49:20.520514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.520468    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="489962a4-7138-46cc-9677-e4f3548a0448" path="/var/lib/kubelet/pods/489962a4-7138-46cc-9677-e4f3548a0448/volumes"
Sep 08 14:49:20.850924 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.850838    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"
Sep 08 14:49:20.851416 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.850845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h" event={"ID":"37967376-bccd-4164-bb12-d0f92864a8af","Type":"ContainerDied","Data":"3aa26295cb91a163b8f0e91cbcbc079d60df5e0c88f646743d8b371354ad547d"}
Sep 08 14:49:20.851416 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.851017    2561 scope.go:117] "RemoveContainer" containerID="a1ea2ba4f30473af3ffb885652cf1769ade18c07b9b72804585a36430eb0eda4"
Sep 08 14:49:20.868058 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.868023    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"]
Sep 08 14:49:20.875019 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:20.874989    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-222cd5-dbd5dd9f7-27q4h"]
Sep 08 14:49:22.520684 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:22.520650    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37967376-bccd-4164-bb12-d0f92864a8af" path="/var/lib/kubelet/pods/37967376-bccd-4164-bb12-d0f92864a8af/volumes"
Sep 08 14:49:27.602032 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.601996    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"]
Sep 08 14:49:27.602554 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.602539    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="489962a4-7138-46cc-9677-e4f3548a0448" containerName="revoke-keys"
Sep 08 14:49:27.602598 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.602558    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="489962a4-7138-46cc-9677-e4f3548a0448" containerName="revoke-keys"
Sep 08 14:49:27.602636 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.602596    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37967376-bccd-4164-bb12-d0f92864a8af" containerName="payload-processing"
Sep 08 14:49:27.602636 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.602605    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="37967376-bccd-4164-bb12-d0f92864a8af" containerName="payload-processing"
Sep 08 14:49:27.602726 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.602714    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="37967376-bccd-4164-bb12-d0f92864a8af" containerName="payload-processing"
Sep 08 14:49:27.602762 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.602734    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="489962a4-7138-46cc-9677-e4f3548a0448" containerName="revoke-keys"
Sep 08 14:49:27.607256 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.607235    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.610521 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.610495    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-f020ee-openshift-default-dockercfg-8gtqq\""
Sep 08 14:49:27.712362 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.712320    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"]
Sep 08 14:49:27.803824 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.803772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-istio-token\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.804017 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.803839    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44acd5ca-d590-4b32-8962-9d203e992a80-istiod-ca-cert\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.804017 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.803866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-certs\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.804017 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.803907    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-envoy\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.804017 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.803983    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44acd5ca-d590-4b32-8962-9d203e992a80-istio-podinfo\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.804017 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.804011    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z96zw\" (UniqueName: \"kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-kube-api-access-z96zw\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.804233 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.804049    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-credential-socket\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.804233 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.804078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-socket\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.804233 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.804130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-data\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.904942 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.904845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44acd5ca-d590-4b32-8962-9d203e992a80-istiod-ca-cert\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.904942 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.904897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-certs\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.904942 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.904941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-envoy\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905244 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.904988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44acd5ca-d590-4b32-8962-9d203e992a80-istio-podinfo\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905244 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.905018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z96zw\" (UniqueName: \"kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-kube-api-access-z96zw\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905244 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.905064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-credential-socket\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905244 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.905092    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-socket\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905244 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.905121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-data\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905512 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.905253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-istio-token\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905512 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.905370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-certs\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905678 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.905657    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-socket\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905750 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.905698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44acd5ca-d590-4b32-8962-9d203e992a80-istiod-ca-cert\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905971 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.905741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-data\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.905971 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.905815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-credential-socket\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.907550 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.907525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-envoy\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.907755 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.907736    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44acd5ca-d590-4b32-8962-9d203e992a80-istio-podinfo\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.913681 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.913647    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-istio-token\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.913838 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.913819    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z96zw\" (UniqueName: \"kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-kube-api-access-z96zw\") pod \"e2e-noten-f020ee-openshift-default-6689d54d88-967h9\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") " pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:27.920831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:27.920795    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:28.211302 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:28.211276    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"]
Sep 08 14:49:28.212768 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:49:28.212740    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44acd5ca_d590_4b32_8962_9d203e992a80.slice/crio-c2e0721410a7ffb251ee1a0b276692adefb80d5b7fd45a8fcb178df2391f4dbe WatchSource:0}: Error finding container c2e0721410a7ffb251ee1a0b276692adefb80d5b7fd45a8fcb178df2391f4dbe: Status 404 returned error can't find the container with id c2e0721410a7ffb251ee1a0b276692adefb80d5b7fd45a8fcb178df2391f4dbe
Sep 08 14:49:28.215159 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:28.215110    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:49:28.215249 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:28.215196    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:49:28.215249 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:28.215225    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:49:28.897228 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:28.897181    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9" event={"ID":"44acd5ca-d590-4b32-8962-9d203e992a80","Type":"ContainerStarted","Data":"a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113"}
Sep 08 14:49:28.897694 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:28.897269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9" event={"ID":"44acd5ca-d590-4b32-8962-9d203e992a80","Type":"ContainerStarted","Data":"c2e0721410a7ffb251ee1a0b276692adefb80d5b7fd45a8fcb178df2391f4dbe"}
Sep 08 14:49:28.921194 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:28.921137    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:28.924769 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:28.924717    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9" podStartSLOduration=1.924702156 podStartE2EDuration="1.924702156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:49:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:49:28.922828244 +0000 UTC m=+912.933348271" watchObservedRunningTime="2026-09-08 14:49:28.924702156 +0000 UTC m=+912.935222155"
Sep 08 14:49:29.926555 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:29.926524    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:30.907289 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:30.907251    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:30.908264 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:30.908245    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:49:59.022982 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:59.022943    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"]
Sep 08 14:49:59.023490 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:49:59.023256    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9" podUID="44acd5ca-d590-4b32-8962-9d203e992a80" containerName="istio-proxy" containerID="cri-o://a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113" gracePeriod=30
Sep 08 14:50:00.910232 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:00.910185    2561 patch_prober.go:28] interesting pod/e2e-noten-f020ee-openshift-default-6689d54d88-967h9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:50:00.910738 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:00.910279    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9" podUID="44acd5ca-d590-4b32-8962-9d203e992a80" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:50:01.926874 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:01.926838    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"]
Sep 08 14:50:01.930892 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:01.930873    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"
Sep 08 14:50:01.932926 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:01.932904    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pdpbl\""
Sep 08 14:50:01.938068 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:01.938032    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"]
Sep 08 14:50:02.050448 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:02.050405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a088920e-524d-4e9a-b79d-f1f420e2ff5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn\" (UID: \"a088920e-524d-4e9a-b79d-f1f420e2ff5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"
Sep 08 14:50:02.151237 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:02.151189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a088920e-524d-4e9a-b79d-f1f420e2ff5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn\" (UID: \"a088920e-524d-4e9a-b79d-f1f420e2ff5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"
Sep 08 14:50:02.151864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:02.151842    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a088920e-524d-4e9a-b79d-f1f420e2ff5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn\" (UID: \"a088920e-524d-4e9a-b79d-f1f420e2ff5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"
Sep 08 14:50:02.243605 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:02.243555    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"
Sep 08 14:50:02.526805 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:50:02.526769    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda088920e_524d_4e9a_b79d_f1f420e2ff5b.slice/crio-8f24be3ba9d3cbcd31de055632ffc1875814d610d9c142262bbe8faf00a809db WatchSource:0}: Error finding container 8f24be3ba9d3cbcd31de055632ffc1875814d610d9c142262bbe8faf00a809db: Status 404 returned error can't find the container with id 8f24be3ba9d3cbcd31de055632ffc1875814d610d9c142262bbe8faf00a809db
Sep 08 14:50:02.529199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:02.529172    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"]
Sep 08 14:50:03.072636 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:03.072536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn" event={"ID":"a088920e-524d-4e9a-b79d-f1f420e2ff5b","Type":"ContainerStarted","Data":"446ddcff0f5b8a15cae3f979f480de7fdda619e7a56982331d9bff5a899793ba"}
Sep 08 14:50:03.072636 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:03.072595    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn" event={"ID":"a088920e-524d-4e9a-b79d-f1f420e2ff5b","Type":"ContainerStarted","Data":"8f24be3ba9d3cbcd31de055632ffc1875814d610d9c142262bbe8faf00a809db"}
Sep 08 14:50:04.079550 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.079507    2561 generic.go:356] "Generic (PLEG): container finished" podID="a088920e-524d-4e9a-b79d-f1f420e2ff5b" containerID="446ddcff0f5b8a15cae3f979f480de7fdda619e7a56982331d9bff5a899793ba" exitCode=0
Sep 08 14:50:04.079969 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.079582    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn" event={"ID":"a088920e-524d-4e9a-b79d-f1f420e2ff5b","Type":"ContainerDied","Data":"446ddcff0f5b8a15cae3f979f480de7fdda619e7a56982331d9bff5a899793ba"}
Sep 08 14:50:04.286007 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.285927    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:50:04.373946 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.373910    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-envoy\") pod \"44acd5ca-d590-4b32-8962-9d203e992a80\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") "
Sep 08 14:50:04.374189 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374042    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-certs\") pod \"44acd5ca-d590-4b32-8962-9d203e992a80\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") "
Sep 08 14:50:04.374189 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374091    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-socket\") pod \"44acd5ca-d590-4b32-8962-9d203e992a80\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") "
Sep 08 14:50:04.374189 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374167    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z96zw\" (UniqueName: \"kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-kube-api-access-z96zw\") pod \"44acd5ca-d590-4b32-8962-9d203e992a80\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") "
Sep 08 14:50:04.374371 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374258    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-credential-socket\") pod \"44acd5ca-d590-4b32-8962-9d203e992a80\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") "
Sep 08 14:50:04.374371 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374313    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-data\") pod \"44acd5ca-d590-4b32-8962-9d203e992a80\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") "
Sep 08 14:50:04.374371 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374341    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-istio-token\") pod \"44acd5ca-d590-4b32-8962-9d203e992a80\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") "
Sep 08 14:50:04.374514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374368    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "44acd5ca-d590-4b32-8962-9d203e992a80" (UID: "44acd5ca-d590-4b32-8962-9d203e992a80"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:04.374514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374386    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44acd5ca-d590-4b32-8962-9d203e992a80-istiod-ca-cert\") pod \"44acd5ca-d590-4b32-8962-9d203e992a80\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") "
Sep 08 14:50:04.374514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374389    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "44acd5ca-d590-4b32-8962-9d203e992a80" (UID: "44acd5ca-d590-4b32-8962-9d203e992a80"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:04.374514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374426    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44acd5ca-d590-4b32-8962-9d203e992a80-istio-podinfo\") pod \"44acd5ca-d590-4b32-8962-9d203e992a80\" (UID: \"44acd5ca-d590-4b32-8962-9d203e992a80\") "
Sep 08 14:50:04.374697 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374576    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-data" (OuterVolumeSpecName: "istio-data") pod "44acd5ca-d590-4b32-8962-9d203e992a80" (UID: "44acd5ca-d590-4b32-8962-9d203e992a80"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:04.374801 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374775    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:04.374801 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374798    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:04.374921 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374811    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:04.374921 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374776    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "44acd5ca-d590-4b32-8962-9d203e992a80" (UID: "44acd5ca-d590-4b32-8962-9d203e992a80"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:04.375022 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.374958    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44acd5ca-d590-4b32-8962-9d203e992a80-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "44acd5ca-d590-4b32-8962-9d203e992a80" (UID: "44acd5ca-d590-4b32-8962-9d203e992a80"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:04.376828 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.376788    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44acd5ca-d590-4b32-8962-9d203e992a80-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "44acd5ca-d590-4b32-8962-9d203e992a80" (UID: "44acd5ca-d590-4b32-8962-9d203e992a80"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:50:04.377026 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.376999    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-istio-token" (OuterVolumeSpecName: "istio-token") pod "44acd5ca-d590-4b32-8962-9d203e992a80" (UID: "44acd5ca-d590-4b32-8962-9d203e992a80"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:04.377110 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.377046    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "44acd5ca-d590-4b32-8962-9d203e992a80" (UID: "44acd5ca-d590-4b32-8962-9d203e992a80"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:04.377110 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.377066    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-kube-api-access-z96zw" (OuterVolumeSpecName: "kube-api-access-z96zw") pod "44acd5ca-d590-4b32-8962-9d203e992a80" (UID: "44acd5ca-d590-4b32-8962-9d203e992a80"). InnerVolumeSpecName "kube-api-access-z96zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:04.475876 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.475834    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44acd5ca-d590-4b32-8962-9d203e992a80-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:04.475876 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.475867    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44acd5ca-d590-4b32-8962-9d203e992a80-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:04.475876 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.475880    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:04.475876 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.475889    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z96zw\" (UniqueName: \"kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-kube-api-access-z96zw\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:04.476199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.475897    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44acd5ca-d590-4b32-8962-9d203e992a80-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:04.476199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:04.475905    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44acd5ca-d590-4b32-8962-9d203e992a80-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:05.086753 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.086718    2561 generic.go:356] "Generic (PLEG): container finished" podID="44acd5ca-d590-4b32-8962-9d203e992a80" containerID="a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113" exitCode=0
Sep 08 14:50:05.087204 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.086765    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"
Sep 08 14:50:05.087204 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.086804    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9" event={"ID":"44acd5ca-d590-4b32-8962-9d203e992a80","Type":"ContainerDied","Data":"a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113"}
Sep 08 14:50:05.087204 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.086872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9" event={"ID":"44acd5ca-d590-4b32-8962-9d203e992a80","Type":"ContainerDied","Data":"c2e0721410a7ffb251ee1a0b276692adefb80d5b7fd45a8fcb178df2391f4dbe"}
Sep 08 14:50:05.087204 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.086903    2561 scope.go:117] "RemoveContainer" containerID="a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113"
Sep 08 14:50:05.099886 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.099838    2561 scope.go:117] "RemoveContainer" containerID="a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113"
Sep 08 14:50:05.100630 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:50:05.100597    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113\": container with ID starting with a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113 not found: ID does not exist" containerID="a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113"
Sep 08 14:50:05.100771 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.100636    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113"} err="failed to get container status \"a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113\": rpc error: code = NotFound desc = could not find container \"a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113\": container with ID starting with a32aa66afdb3004d12e22cc2fc05d4bb18a6a09b6f2d566a2af81bcddffd0113 not found: ID does not exist"
Sep 08 14:50:05.106267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.106233    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"]
Sep 08 14:50:05.111473 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.111438    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-f020ee-openshift-default-6689d54d88-967h9"]
Sep 08 14:50:05.254358 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.254324    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"
Sep 08 14:50:05.284987 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.284949    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a088920e-524d-4e9a-b79d-f1f420e2ff5b-maas-api-service-ca\") pod \"a088920e-524d-4e9a-b79d-f1f420e2ff5b\" (UID: \"a088920e-524d-4e9a-b79d-f1f420e2ff5b\") "
Sep 08 14:50:05.285382 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.285354    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a088920e-524d-4e9a-b79d-f1f420e2ff5b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a088920e-524d-4e9a-b79d-f1f420e2ff5b" (UID: "a088920e-524d-4e9a-b79d-f1f420e2ff5b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:05.386614 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:05.386502    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a088920e-524d-4e9a-b79d-f1f420e2ff5b-maas-api-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:06.094000 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:06.093971    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"
Sep 08 14:50:06.094426 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:06.093970    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn" event={"ID":"a088920e-524d-4e9a-b79d-f1f420e2ff5b","Type":"ContainerDied","Data":"8f24be3ba9d3cbcd31de055632ffc1875814d610d9c142262bbe8faf00a809db"}
Sep 08 14:50:06.094426 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:06.094099    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f24be3ba9d3cbcd31de055632ffc1875814d610d9c142262bbe8faf00a809db"
Sep 08 14:50:06.522412 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:06.522376    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44acd5ca-d590-4b32-8962-9d203e992a80" path="/var/lib/kubelet/pods/44acd5ca-d590-4b32-8962-9d203e992a80/volumes"
Sep 08 14:50:12.781967 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:12.781930    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"]
Sep 08 14:50:12.786907 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:12.786875    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-798a5d-nwlpn"]
Sep 08 14:50:14.521411 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:14.521377    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a088920e-524d-4e9a-b79d-f1f420e2ff5b" path="/var/lib/kubelet/pods/a088920e-524d-4e9a-b79d-f1f420e2ff5b/volumes"
Sep 08 14:50:17.592977 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.592935    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"]
Sep 08 14:50:17.593373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.593334    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44acd5ca-d590-4b32-8962-9d203e992a80" containerName="istio-proxy"
Sep 08 14:50:17.593373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.593346    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44acd5ca-d590-4b32-8962-9d203e992a80" containerName="istio-proxy"
Sep 08 14:50:17.593373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.593365    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a088920e-524d-4e9a-b79d-f1f420e2ff5b" containerName="revoke-keys"
Sep 08 14:50:17.593373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.593370    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a088920e-524d-4e9a-b79d-f1f420e2ff5b" containerName="revoke-keys"
Sep 08 14:50:17.593505 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.593437    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="44acd5ca-d590-4b32-8962-9d203e992a80" containerName="istio-proxy"
Sep 08 14:50:17.593505 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.593446    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a088920e-524d-4e9a-b79d-f1f420e2ff5b" containerName="revoke-keys"
Sep 08 14:50:17.598011 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.597992    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:17.601087 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.601059    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-653c2a83-dockercfg-q46g5\""
Sep 08 14:50:17.601526 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.601496    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-653c2a83\""
Sep 08 14:50:17.610268 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.610239    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"]
Sep 08 14:50:17.616599 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.616568    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"]
Sep 08 14:50:17.620878 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.620852    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:17.632436 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.632387    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"]
Sep 08 14:50:17.705935 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.705895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnbq7\" (UniqueName: \"kubernetes.io/projected/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-kube-api-access-bnbq7\") pod \"payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk\" (UID: \"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:17.706114 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.705971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27wfr\" (UniqueName: \"kubernetes.io/projected/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-kube-api-access-27wfr\") pod \"payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb\" (UID: \"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c\") " pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:17.706114 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.706014    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk\" (UID: \"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:17.706114 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.706045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-plugins-config-volume\") pod \"payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb\" (UID: \"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c\") " pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:17.807670 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.807633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk\" (UID: \"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:17.807865 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.807678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-plugins-config-volume\") pod \"payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb\" (UID: \"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c\") " pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:17.807865 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.807740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnbq7\" (UniqueName: \"kubernetes.io/projected/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-kube-api-access-bnbq7\") pod \"payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk\" (UID: \"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:17.807865 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.807809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27wfr\" (UniqueName: \"kubernetes.io/projected/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-kube-api-access-27wfr\") pod \"payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb\" (UID: \"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c\") " pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:17.808525 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.808505    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-plugins-config-volume\") pod \"payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb\" (UID: \"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c\") " pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:17.808583 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.808550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk\" (UID: \"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:17.816730 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.816705    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnbq7\" (UniqueName: \"kubernetes.io/projected/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-kube-api-access-bnbq7\") pod \"payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk\" (UID: \"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:17.816991 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.816968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27wfr\" (UniqueName: \"kubernetes.io/projected/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-kube-api-access-27wfr\") pod \"payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb\" (UID: \"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c\") " pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:17.909977 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.909884    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:17.933272 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:17.933243    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:18.191689 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:18.191664    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"]
Sep 08 14:50:18.193181 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:50:18.193136    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e099432_74cc_4ad5_b5b8_a5aadfb5dac4.slice/crio-a1af1a6667d34c7cb7996a01331763742b2c9916efb4873fc44725e0974ead70 WatchSource:0}: Error finding container a1af1a6667d34c7cb7996a01331763742b2c9916efb4873fc44725e0974ead70: Status 404 returned error can't find the container with id a1af1a6667d34c7cb7996a01331763742b2c9916efb4873fc44725e0974ead70
Sep 08 14:50:18.223578 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:18.223547    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"]
Sep 08 14:50:18.228398 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:50:18.228372    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c8dbf1_d9ba_4e11_8864_6cde5a1ef51c.slice/crio-323185247bf5c7ec88a453406951426ae008f8f37b0b674fa30d8c678cc9d24b WatchSource:0}: Error finding container 323185247bf5c7ec88a453406951426ae008f8f37b0b674fa30d8c678cc9d24b: Status 404 returned error can't find the container with id 323185247bf5c7ec88a453406951426ae008f8f37b0b674fa30d8c678cc9d24b
Sep 08 14:50:19.163782 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:19.163740    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk" event={"ID":"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4","Type":"ContainerStarted","Data":"c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8"}
Sep 08 14:50:19.164316 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:19.163843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk" event={"ID":"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4","Type":"ContainerStarted","Data":"a1af1a6667d34c7cb7996a01331763742b2c9916efb4873fc44725e0974ead70"}
Sep 08 14:50:19.164316 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:19.163876    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:19.165470 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:19.165435    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb" event={"ID":"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c","Type":"ContainerStarted","Data":"5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064"}
Sep 08 14:50:19.165605 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:19.165490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb" event={"ID":"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c","Type":"ContainerStarted","Data":"323185247bf5c7ec88a453406951426ae008f8f37b0b674fa30d8c678cc9d24b"}
Sep 08 14:50:19.165605 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:19.165515    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:19.183101 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:19.183045    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk" podStartSLOduration=2.183025337 podStartE2EDuration="2.183025337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:50:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:50:19.182714379 +0000 UTC m=+963.193234382" watchObservedRunningTime="2026-09-08 14:50:19.183025337 +0000 UTC m=+963.193545337"
Sep 08 14:50:19.205333 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:19.205280    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb" podStartSLOduration=2.20526473 podStartE2EDuration="2.20526473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:50:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:50:19.202697013 +0000 UTC m=+963.213217012" watchObservedRunningTime="2026-09-08 14:50:19.20526473 +0000 UTC m=+963.215784729"
Sep 08 14:50:20.149483 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:20.149449    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"]
Sep 08 14:50:20.149709 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:20.149664    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy" containerID="cri-o://fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601" gracePeriod=30
Sep 08 14:50:25.404859 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.404827    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:50:25.493587 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.493548    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-envoy\") pod \"24f853ef-de53-4b60-8ce2-b3330ca822af\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") "
Sep 08 14:50:25.493587 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.493591    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-certs\") pod \"24f853ef-de53-4b60-8ce2-b3330ca822af\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") "
Sep 08 14:50:25.493848 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.493612    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-token\") pod \"24f853ef-de53-4b60-8ce2-b3330ca822af\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") "
Sep 08 14:50:25.493848 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.493644    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-data\") pod \"24f853ef-de53-4b60-8ce2-b3330ca822af\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") "
Sep 08 14:50:25.493848 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.493673    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxt6f\" (UniqueName: \"kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-kube-api-access-bxt6f\") pod \"24f853ef-de53-4b60-8ce2-b3330ca822af\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") "
Sep 08 14:50:25.493848 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.493719    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-socket\") pod \"24f853ef-de53-4b60-8ce2-b3330ca822af\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") "
Sep 08 14:50:25.493848 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.493734    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24f853ef-de53-4b60-8ce2-b3330ca822af-istiod-ca-cert\") pod \"24f853ef-de53-4b60-8ce2-b3330ca822af\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") "
Sep 08 14:50:25.493848 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.493769    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-credential-socket\") pod \"24f853ef-de53-4b60-8ce2-b3330ca822af\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") "
Sep 08 14:50:25.493848 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.493791    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-podinfo\") pod \"24f853ef-de53-4b60-8ce2-b3330ca822af\" (UID: \"24f853ef-de53-4b60-8ce2-b3330ca822af\") "
Sep 08 14:50:25.494247 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.493907    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24f853ef-de53-4b60-8ce2-b3330ca822af" (UID: "24f853ef-de53-4b60-8ce2-b3330ca822af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:25.494247 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.494184    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:25.494357 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.494299    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-data" (OuterVolumeSpecName: "istio-data") pod "24f853ef-de53-4b60-8ce2-b3330ca822af" (UID: "24f853ef-de53-4b60-8ce2-b3330ca822af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:25.494422 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.494386    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24f853ef-de53-4b60-8ce2-b3330ca822af" (UID: "24f853ef-de53-4b60-8ce2-b3330ca822af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:25.494514 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.494316    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24f853ef-de53-4b60-8ce2-b3330ca822af" (UID: "24f853ef-de53-4b60-8ce2-b3330ca822af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:25.494562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.494488    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24f853ef-de53-4b60-8ce2-b3330ca822af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24f853ef-de53-4b60-8ce2-b3330ca822af" (UID: "24f853ef-de53-4b60-8ce2-b3330ca822af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:25.495958 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.495934    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-token" (OuterVolumeSpecName: "istio-token") pod "24f853ef-de53-4b60-8ce2-b3330ca822af" (UID: "24f853ef-de53-4b60-8ce2-b3330ca822af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:25.496361 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.496340    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-kube-api-access-bxt6f" (OuterVolumeSpecName: "kube-api-access-bxt6f") pod "24f853ef-de53-4b60-8ce2-b3330ca822af" (UID: "24f853ef-de53-4b60-8ce2-b3330ca822af"). InnerVolumeSpecName "kube-api-access-bxt6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:25.496540 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.496517    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24f853ef-de53-4b60-8ce2-b3330ca822af" (UID: "24f853ef-de53-4b60-8ce2-b3330ca822af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:50:25.496602 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.496519    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24f853ef-de53-4b60-8ce2-b3330ca822af" (UID: "24f853ef-de53-4b60-8ce2-b3330ca822af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:25.594780 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.594740    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:25.594780 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.594775    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:25.594780 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.594791    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:25.595045 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.594805    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:25.595045 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.594816    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:25.595045 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.594827    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxt6f\" (UniqueName: \"kubernetes.io/projected/24f853ef-de53-4b60-8ce2-b3330ca822af-kube-api-access-bxt6f\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:25.595045 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.594839    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24f853ef-de53-4b60-8ce2-b3330ca822af-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:25.595045 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:25.594850    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24f853ef-de53-4b60-8ce2-b3330ca822af-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:26.201543 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.201506    2561 generic.go:356] "Generic (PLEG): container finished" podID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerID="fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601" exitCode=0
Sep 08 14:50:26.201753 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.201587    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"
Sep 08 14:50:26.201753 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.201587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" event={"ID":"24f853ef-de53-4b60-8ce2-b3330ca822af","Type":"ContainerDied","Data":"fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601"}
Sep 08 14:50:26.201753 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.201645    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs" event={"ID":"24f853ef-de53-4b60-8ce2-b3330ca822af","Type":"ContainerDied","Data":"671ea50f3fdcd8724f8e5d965a87e8b2662b26105c15399107c5e0f386ef5c9d"}
Sep 08 14:50:26.201753 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.201667    2561 scope.go:117] "RemoveContainer" containerID="fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601"
Sep 08 14:50:26.211089 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.211069    2561 scope.go:117] "RemoveContainer" containerID="008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e"
Sep 08 14:50:26.220314 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.220291    2561 scope.go:117] "RemoveContainer" containerID="fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601"
Sep 08 14:50:26.220646 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:50:26.220624    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601\": container with ID starting with fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601 not found: ID does not exist" containerID="fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601"
Sep 08 14:50:26.220726 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.220661    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601"} err="failed to get container status \"fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601\": rpc error: code = NotFound desc = could not find container \"fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601\": container with ID starting with fc6a2a1169709fb7cd1cc79f0acc0fbf1708e8a8d339216bb7ae511facf12601 not found: ID does not exist"
Sep 08 14:50:26.220726 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.220689    2561 scope.go:117] "RemoveContainer" containerID="008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e"
Sep 08 14:50:26.221022 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:50:26.221005    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e\": container with ID starting with 008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e not found: ID does not exist" containerID="008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e"
Sep 08 14:50:26.221063 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.221029    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e"} err="failed to get container status \"008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e\": rpc error: code = NotFound desc = could not find container \"008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e\": container with ID starting with 008f3a46c21241585cc6d4f8fc9bafe9a4304dba240fa3b787fa8e63d87a9e8e not found: ID does not exist"
Sep 08 14:50:26.226757 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.226724    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"]
Sep 08 14:50:26.237254 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.237223    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-798a5d-openshift-default-6c55bdf478-mmpcs"]
Sep 08 14:50:26.521285 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:26.521250    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" path="/var/lib/kubelet/pods/24f853ef-de53-4b60-8ce2-b3330ca822af/volumes"
Sep 08 14:50:30.172983 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:30.172948    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:30.173392 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:30.173019    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:31.377897 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:31.377861    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"]
Sep 08 14:50:31.378338 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:31.378103    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9" podUID="279dfb57-6a0e-4d06-818b-b718ff975c1f" containerName="payload-processing" containerID="cri-o://abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24" gracePeriod=30
Sep 08 14:50:31.631379 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:31.631305    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:50:31.756907 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:31.756871    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwvxn\" (UniqueName: \"kubernetes.io/projected/279dfb57-6a0e-4d06-818b-b718ff975c1f-kube-api-access-kwvxn\") pod \"279dfb57-6a0e-4d06-818b-b718ff975c1f\" (UID: \"279dfb57-6a0e-4d06-818b-b718ff975c1f\") "
Sep 08 14:50:31.757111 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:31.757016    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279dfb57-6a0e-4d06-818b-b718ff975c1f-plugins-config-volume\") pod \"279dfb57-6a0e-4d06-818b-b718ff975c1f\" (UID: \"279dfb57-6a0e-4d06-818b-b718ff975c1f\") "
Sep 08 14:50:31.757440 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:31.757414    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279dfb57-6a0e-4d06-818b-b718ff975c1f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "279dfb57-6a0e-4d06-818b-b718ff975c1f" (UID: "279dfb57-6a0e-4d06-818b-b718ff975c1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:31.759234 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:31.759211    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279dfb57-6a0e-4d06-818b-b718ff975c1f-kube-api-access-kwvxn" (OuterVolumeSpecName: "kube-api-access-kwvxn") pod "279dfb57-6a0e-4d06-818b-b718ff975c1f" (UID: "279dfb57-6a0e-4d06-818b-b718ff975c1f"). InnerVolumeSpecName "kube-api-access-kwvxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:31.857917 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:31.857876    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/279dfb57-6a0e-4d06-818b-b718ff975c1f-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:31.857917 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:31.857910    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwvxn\" (UniqueName: \"kubernetes.io/projected/279dfb57-6a0e-4d06-818b-b718ff975c1f-kube-api-access-kwvxn\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:32.235479 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:32.235444    2561 generic.go:356] "Generic (PLEG): container finished" podID="279dfb57-6a0e-4d06-818b-b718ff975c1f" containerID="abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24" exitCode=0
Sep 08 14:50:32.235700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:32.235492    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"
Sep 08 14:50:32.235700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:32.235524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9" event={"ID":"279dfb57-6a0e-4d06-818b-b718ff975c1f","Type":"ContainerDied","Data":"abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24"}
Sep 08 14:50:32.235700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:32.235575    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9" event={"ID":"279dfb57-6a0e-4d06-818b-b718ff975c1f","Type":"ContainerDied","Data":"492a0fa13bdf9b8daed5b33741a79c20a61cc0152acdac1ead88af499790b852"}
Sep 08 14:50:32.235700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:32.235599    2561 scope.go:117] "RemoveContainer" containerID="abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24"
Sep 08 14:50:32.246059 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:32.246029    2561 scope.go:117] "RemoveContainer" containerID="abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24"
Sep 08 14:50:32.246445 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:50:32.246419    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24\": container with ID starting with abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24 not found: ID does not exist" containerID="abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24"
Sep 08 14:50:32.246544 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:32.246454    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24"} err="failed to get container status \"abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24\": rpc error: code = NotFound desc = could not find container \"abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24\": container with ID starting with abf63f771fcccc168a30f1f801737fd0120a03abcbb96283264e69b8da116a24 not found: ID does not exist"
Sep 08 14:50:32.259981 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:32.259952    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"]
Sep 08 14:50:32.263436 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:32.263412    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-02a199-5878dccff5-r7lm9"]
Sep 08 14:50:32.522465 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:32.522377    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="279dfb57-6a0e-4d06-818b-b718ff975c1f" path="/var/lib/kubelet/pods/279dfb57-6a0e-4d06-818b-b718ff975c1f/volumes"
Sep 08 14:50:38.317241 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:38.317139    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"]
Sep 08 14:50:38.317639 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:38.317400    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy" containerID="cri-o://34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd" gracePeriod=30
Sep 08 14:50:39.237443 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.237405    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"]
Sep 08 14:50:39.237887 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.237868    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy"
Sep 08 14:50:39.237887 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.237888    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy"
Sep 08 14:50:39.238064 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.237922    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279dfb57-6a0e-4d06-818b-b718ff975c1f" containerName="payload-processing"
Sep 08 14:50:39.238064 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.237932    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="279dfb57-6a0e-4d06-818b-b718ff975c1f" containerName="payload-processing"
Sep 08 14:50:39.238064 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.238050    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="279dfb57-6a0e-4d06-818b-b718ff975c1f" containerName="payload-processing"
Sep 08 14:50:39.238064 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.238063    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy"
Sep 08 14:50:39.238311 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.238077    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy"
Sep 08 14:50:39.242726 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.242696    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.244799 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.244776    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-ef8f61-openshift-default-dockercfg-f7nmb\""
Sep 08 14:50:39.257357 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.257328    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"]
Sep 08 14:50:39.331034 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.330963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-data\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.331492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.331055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-credential-socket\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.331492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.331088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-envoy\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.331492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.331115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-socket\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.331492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.331264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtlpb\" (UniqueName: \"kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-kube-api-access-rtlpb\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.331492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.331303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30723475-874e-40fd-aa27-3b91cd129fcb-istiod-ca-cert\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.331492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.331337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-istio-token\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.331492 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.331459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30723475-874e-40fd-aa27-3b91cd129fcb-istio-podinfo\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.331770 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.331530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-certs\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432054 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-credential-socket\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432054 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-envoy\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-socket\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtlpb\" (UniqueName: \"kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-kube-api-access-rtlpb\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30723475-874e-40fd-aa27-3b91cd129fcb-istiod-ca-cert\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-istio-token\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30723475-874e-40fd-aa27-3b91cd129fcb-istio-podinfo\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432321    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-certs\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432633 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-data\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432707 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432674    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-credential-socket\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432796 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432774    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-socket\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.432903 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.432881    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-certs\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.433241 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.433219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-data\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.433350 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.433328    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30723475-874e-40fd-aa27-3b91cd129fcb-istiod-ca-cert\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.434815 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.434795    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-envoy\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.435041 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.435019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30723475-874e-40fd-aa27-3b91cd129fcb-istio-podinfo\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.442435 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.442401    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtlpb\" (UniqueName: \"kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-kube-api-access-rtlpb\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.445388 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.445359    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-istio-token\") pod \"e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") " pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.554366 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.554273    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:39.860730 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.860705    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"]
Sep 08 14:50:39.862456 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:50:39.862426    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30723475_874e_40fd_aa27_3b91cd129fcb.slice/crio-7f7447951654c8f9b2f1a2e018767759a6923d22e63675a1113460427db52429 WatchSource:0}: Error finding container 7f7447951654c8f9b2f1a2e018767759a6923d22e63675a1113460427db52429: Status 404 returned error can't find the container with id 7f7447951654c8f9b2f1a2e018767759a6923d22e63675a1113460427db52429
Sep 08 14:50:39.864735 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.864699    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:50:39.864818 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.864766    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:50:39.864818 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:39.864796    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:50:40.283233 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:40.283197    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" event={"ID":"30723475-874e-40fd-aa27-3b91cd129fcb","Type":"ContainerStarted","Data":"7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2"}
Sep 08 14:50:40.283414 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:40.283254    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" event={"ID":"30723475-874e-40fd-aa27-3b91cd129fcb","Type":"ContainerStarted","Data":"7f7447951654c8f9b2f1a2e018767759a6923d22e63675a1113460427db52429"}
Sep 08 14:50:40.310054 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:40.309995    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" podStartSLOduration=1.309977891 podStartE2EDuration="1.309977891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:50:40.307726186 +0000 UTC m=+984.318246186" watchObservedRunningTime="2026-09-08 14:50:40.309977891 +0000 UTC m=+984.320497889"
Sep 08 14:50:40.555425 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:40.555311    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:40.560813 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:40.560784    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:41.289230 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:41.289202    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:41.290412 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:41.290387    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:43.563312 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.563286    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:50:43.676237 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676134    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-istio-token\") pod \"7b18a94c-1cc4-4343-8428-09d822a46538\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") "
Sep 08 14:50:43.676237 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676193    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-credential-socket\") pod \"7b18a94c-1cc4-4343-8428-09d822a46538\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") "
Sep 08 14:50:43.676237 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676219    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-socket\") pod \"7b18a94c-1cc4-4343-8428-09d822a46538\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") "
Sep 08 14:50:43.676500 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676257    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b18a94c-1cc4-4343-8428-09d822a46538-istio-podinfo\") pod \"7b18a94c-1cc4-4343-8428-09d822a46538\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") "
Sep 08 14:50:43.676500 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676346    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-data\") pod \"7b18a94c-1cc4-4343-8428-09d822a46538\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") "
Sep 08 14:50:43.676500 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676381    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-envoy\") pod \"7b18a94c-1cc4-4343-8428-09d822a46538\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") "
Sep 08 14:50:43.676500 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676432    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-certs\") pod \"7b18a94c-1cc4-4343-8428-09d822a46538\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") "
Sep 08 14:50:43.676500 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676468    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tm8r\" (UniqueName: \"kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-kube-api-access-8tm8r\") pod \"7b18a94c-1cc4-4343-8428-09d822a46538\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") "
Sep 08 14:50:43.676500 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676500    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b18a94c-1cc4-4343-8428-09d822a46538-istiod-ca-cert\") pod \"7b18a94c-1cc4-4343-8428-09d822a46538\" (UID: \"7b18a94c-1cc4-4343-8428-09d822a46538\") "
Sep 08 14:50:43.676809 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676592    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b18a94c-1cc4-4343-8428-09d822a46538" (UID: "7b18a94c-1cc4-4343-8428-09d822a46538"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:43.676809 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676610    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b18a94c-1cc4-4343-8428-09d822a46538" (UID: "7b18a94c-1cc4-4343-8428-09d822a46538"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:43.676911 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676822    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b18a94c-1cc4-4343-8428-09d822a46538" (UID: "7b18a94c-1cc4-4343-8428-09d822a46538"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:43.676967 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676952    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:43.676967 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676954    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b18a94c-1cc4-4343-8428-09d822a46538" (UID: "7b18a94c-1cc4-4343-8428-09d822a46538"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:43.677117 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676971    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:43.677117 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.676988    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:43.677117 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.677087    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b18a94c-1cc4-4343-8428-09d822a46538-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b18a94c-1cc4-4343-8428-09d822a46538" (UID: "7b18a94c-1cc4-4343-8428-09d822a46538"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:43.679026 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.678966    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b18a94c-1cc4-4343-8428-09d822a46538-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b18a94c-1cc4-4343-8428-09d822a46538" (UID: "7b18a94c-1cc4-4343-8428-09d822a46538"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:50:43.679181 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.679080    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-kube-api-access-8tm8r" (OuterVolumeSpecName: "kube-api-access-8tm8r") pod "7b18a94c-1cc4-4343-8428-09d822a46538" (UID: "7b18a94c-1cc4-4343-8428-09d822a46538"). InnerVolumeSpecName "kube-api-access-8tm8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:43.679373 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.679335    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b18a94c-1cc4-4343-8428-09d822a46538" (UID: "7b18a94c-1cc4-4343-8428-09d822a46538"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:43.679614 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.679594    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b18a94c-1cc4-4343-8428-09d822a46538" (UID: "7b18a94c-1cc4-4343-8428-09d822a46538"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:43.778556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.778515    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:43.778556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.778554    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b18a94c-1cc4-4343-8428-09d822a46538-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:43.778785 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.778570    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tm8r\" (UniqueName: \"kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-kube-api-access-8tm8r\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:43.778785 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.778584    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b18a94c-1cc4-4343-8428-09d822a46538-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:43.778785 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.778598    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b18a94c-1cc4-4343-8428-09d822a46538-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:43.778785 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:43.778609    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b18a94c-1cc4-4343-8428-09d822a46538-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:44.306650 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.306618    2561 generic.go:356] "Generic (PLEG): container finished" podID="7b18a94c-1cc4-4343-8428-09d822a46538" containerID="34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd" exitCode=0
Sep 08 14:50:44.306837 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.306676    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"
Sep 08 14:50:44.306837 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.306706    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" event={"ID":"7b18a94c-1cc4-4343-8428-09d822a46538","Type":"ContainerDied","Data":"34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd"}
Sep 08 14:50:44.306837 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.306763    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6" event={"ID":"7b18a94c-1cc4-4343-8428-09d822a46538","Type":"ContainerDied","Data":"14434c75a265fbe2dae66a8a3cf3e6fa150bee1889d9ea90dc854c05132e3686"}
Sep 08 14:50:44.306837 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.306790    2561 scope.go:117] "RemoveContainer" containerID="34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd"
Sep 08 14:50:44.317372 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.317336    2561 scope.go:117] "RemoveContainer" containerID="05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88"
Sep 08 14:50:44.326773 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.326751    2561 scope.go:117] "RemoveContainer" containerID="34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd"
Sep 08 14:50:44.327098 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:50:44.327074    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd\": container with ID starting with 34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd not found: ID does not exist" containerID="34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd"
Sep 08 14:50:44.327208 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.327113    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd"} err="failed to get container status \"34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd\": rpc error: code = NotFound desc = could not find container \"34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd\": container with ID starting with 34171bd87dc2a2fe5f9b2f78e522be1895a1304087fd06d5aaa55641ff307bdd not found: ID does not exist"
Sep 08 14:50:44.327208 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.327139    2561 scope.go:117] "RemoveContainer" containerID="05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88"
Sep 08 14:50:44.327432 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:50:44.327412    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88\": container with ID starting with 05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88 not found: ID does not exist" containerID="05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88"
Sep 08 14:50:44.327489 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.327440    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88"} err="failed to get container status \"05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88\": rpc error: code = NotFound desc = could not find container \"05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88\": container with ID starting with 05806b880530327605a324fcc512f6bb60043d48c09265a2dc483e2906c87b88 not found: ID does not exist"
Sep 08 14:50:44.339493 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.339468    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"]
Sep 08 14:50:44.343777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.343752    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-02a199-openshift-default-77fc5ffd9b-q58t6"]
Sep 08 14:50:44.439035 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.438997    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"]
Sep 08 14:50:44.439401 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.439387    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy"
Sep 08 14:50:44.439457 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.439403    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f853ef-de53-4b60-8ce2-b3330ca822af" containerName="istio-proxy"
Sep 08 14:50:44.439457 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.439421    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy"
Sep 08 14:50:44.439457 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.439426    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy"
Sep 08 14:50:44.439457 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.439435    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy"
Sep 08 14:50:44.439457 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.439442    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy"
Sep 08 14:50:44.439622 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.439509    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy"
Sep 08 14:50:44.444191 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.444172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 14:50:44.447232 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.447212    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-ef8f61-dockercfg-fjhjj\""
Sep 08 14:50:44.447417 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.447389    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-ef8f61\""
Sep 08 14:50:44.456022 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.455998    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"]
Sep 08 14:50:44.486335 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.486301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knzpf\" (UniqueName: \"kubernetes.io/projected/b828aec2-65e6-4011-8a97-067eb69a1792-kube-api-access-knzpf\") pod \"payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6\" (UID: \"b828aec2-65e6-4011-8a97-067eb69a1792\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 14:50:44.486539 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.486385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b828aec2-65e6-4011-8a97-067eb69a1792-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6\" (UID: \"b828aec2-65e6-4011-8a97-067eb69a1792\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 14:50:44.524559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.524525    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" path="/var/lib/kubelet/pods/7b18a94c-1cc4-4343-8428-09d822a46538/volumes"
Sep 08 14:50:44.587985 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.587897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b828aec2-65e6-4011-8a97-067eb69a1792-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6\" (UID: \"b828aec2-65e6-4011-8a97-067eb69a1792\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 14:50:44.588395 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.588006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knzpf\" (UniqueName: \"kubernetes.io/projected/b828aec2-65e6-4011-8a97-067eb69a1792-kube-api-access-knzpf\") pod \"payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6\" (UID: \"b828aec2-65e6-4011-8a97-067eb69a1792\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 14:50:44.588661 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.588641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b828aec2-65e6-4011-8a97-067eb69a1792-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6\" (UID: \"b828aec2-65e6-4011-8a97-067eb69a1792\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 14:50:44.599822 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.599782    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knzpf\" (UniqueName: \"kubernetes.io/projected/b828aec2-65e6-4011-8a97-067eb69a1792-kube-api-access-knzpf\") pod \"payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6\" (UID: \"b828aec2-65e6-4011-8a97-067eb69a1792\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 14:50:44.755154 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:44.755121    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 14:50:45.030040 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:45.030008    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"]
Sep 08 14:50:45.032174 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:50:45.032118    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb828aec2_65e6_4011_8a97_067eb69a1792.slice/crio-279715a1dbff2387ed8d3b3cbe6e91e49ee965b0954853296648b2e69bf0fe2c WatchSource:0}: Error finding container 279715a1dbff2387ed8d3b3cbe6e91e49ee965b0954853296648b2e69bf0fe2c: Status 404 returned error can't find the container with id 279715a1dbff2387ed8d3b3cbe6e91e49ee965b0954853296648b2e69bf0fe2c
Sep 08 14:50:45.314353 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:45.314263    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6" event={"ID":"b828aec2-65e6-4011-8a97-067eb69a1792","Type":"ContainerStarted","Data":"635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f"}
Sep 08 14:50:45.314353 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:45.314315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6" event={"ID":"b828aec2-65e6-4011-8a97-067eb69a1792","Type":"ContainerStarted","Data":"279715a1dbff2387ed8d3b3cbe6e91e49ee965b0954853296648b2e69bf0fe2c"}
Sep 08 14:50:45.314538 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:45.314421    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 14:50:45.332073 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:45.332018    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6" podStartSLOduration=1.332000794 podStartE2EDuration="1.332000794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:50:45.330532042 +0000 UTC m=+989.341052043" watchObservedRunningTime="2026-09-08 14:50:45.332000794 +0000 UTC m=+989.342520794"
Sep 08 14:50:48.404081 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:48.404037    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"]
Sep 08 14:50:48.404944 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:48.404914    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b18a94c-1cc4-4343-8428-09d822a46538" containerName="istio-proxy"
Sep 08 14:50:48.408832 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:48.408808    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"
Sep 08 14:50:48.411768 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:48.411742    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pdpbl\""
Sep 08 14:50:48.421801 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:48.421772    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"]
Sep 08 14:50:48.526807 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:48.526766    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/338d00e6-f586-4083-8360-f7117a9bb82a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s\" (UID: \"338d00e6-f586-4083-8360-f7117a9bb82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"
Sep 08 14:50:48.628207 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:48.628115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/338d00e6-f586-4083-8360-f7117a9bb82a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s\" (UID: \"338d00e6-f586-4083-8360-f7117a9bb82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"
Sep 08 14:50:48.628772 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:48.628754    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/338d00e6-f586-4083-8360-f7117a9bb82a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s\" (UID: \"338d00e6-f586-4083-8360-f7117a9bb82a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"
Sep 08 14:50:48.719858 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:48.719819    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"
Sep 08 14:50:49.023522 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:49.023480    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"]
Sep 08 14:50:49.025666 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:50:49.025637    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338d00e6_f586_4083_8360_f7117a9bb82a.slice/crio-905a4ecae0599e192be7665246ac4ff4e12f8010162d341a235ed89a623e1e7e WatchSource:0}: Error finding container 905a4ecae0599e192be7665246ac4ff4e12f8010162d341a235ed89a623e1e7e: Status 404 returned error can't find the container with id 905a4ecae0599e192be7665246ac4ff4e12f8010162d341a235ed89a623e1e7e
Sep 08 14:50:49.337642 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:49.337606    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s" event={"ID":"338d00e6-f586-4083-8360-f7117a9bb82a","Type":"ContainerStarted","Data":"905a4ecae0599e192be7665246ac4ff4e12f8010162d341a235ed89a623e1e7e"}
Sep 08 14:50:50.343993 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:50.343895    2561 generic.go:356] "Generic (PLEG): container finished" podID="338d00e6-f586-4083-8360-f7117a9bb82a" containerID="4fd55c6c5ba76e07be3accbb7afc22c41610cb93a8919c400210cd7c0ae72ce2" exitCode=0
Sep 08 14:50:50.344375 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:50.343989    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s" event={"ID":"338d00e6-f586-4083-8360-f7117a9bb82a","Type":"ContainerDied","Data":"4fd55c6c5ba76e07be3accbb7afc22c41610cb93a8919c400210cd7c0ae72ce2"}
Sep 08 14:50:51.516112 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:51.516081    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"
Sep 08 14:50:51.554673 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:51.554642    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/338d00e6-f586-4083-8360-f7117a9bb82a-maas-api-service-ca\") pod \"338d00e6-f586-4083-8360-f7117a9bb82a\" (UID: \"338d00e6-f586-4083-8360-f7117a9bb82a\") "
Sep 08 14:50:51.555030 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:51.555006    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/338d00e6-f586-4083-8360-f7117a9bb82a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "338d00e6-f586-4083-8360-f7117a9bb82a" (UID: "338d00e6-f586-4083-8360-f7117a9bb82a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:51.655547 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:51.655455    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/338d00e6-f586-4083-8360-f7117a9bb82a-maas-api-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:52.355550 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:52.355514    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"
Sep 08 14:50:52.355550 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:52.355542    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s" event={"ID":"338d00e6-f586-4083-8360-f7117a9bb82a","Type":"ContainerDied","Data":"905a4ecae0599e192be7665246ac4ff4e12f8010162d341a235ed89a623e1e7e"}
Sep 08 14:50:52.355768 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:52.355594    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="905a4ecae0599e192be7665246ac4ff4e12f8010162d341a235ed89a623e1e7e"
Sep 08 14:50:56.290992 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:56.290957    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 14:50:56.291445 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:56.291016    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 14:50:56.322598 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:56.322566    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 14:50:56.383848 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:56.383750    2561 generic.go:356] "Generic (PLEG): container finished" podID="30723475-874e-40fd-aa27-3b91cd129fcb" containerID="7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2" exitCode=0
Sep 08 14:50:56.384016 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:56.383834    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" event={"ID":"30723475-874e-40fd-aa27-3b91cd129fcb","Type":"ContainerDied","Data":"7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2"}
Sep 08 14:50:56.384334 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:56.384317    2561 scope.go:117] "RemoveContainer" containerID="7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2"
Sep 08 14:50:56.385463 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:56.385435    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:50:56.385539 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:56.385502    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:50:56.385578 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:56.385536    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:50:57.395164 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:57.395095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" event={"ID":"30723475-874e-40fd-aa27-3b91cd129fcb","Type":"ContainerStarted","Data":"3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af"}
Sep 08 14:50:57.554827 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:57.554796    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:50:57.555039 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:57.555014    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 14:50:57.555089 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:57.555070    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 14:50:58.554741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:58.554705    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 14:50:58.555114 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:58.554794    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 14:50:58.949330 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:58.949226    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"]
Sep 08 14:50:58.949510 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:58.949481    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb" podUID="c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c" containerName="payload-processing" containerID="cri-o://5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064" gracePeriod=30
Sep 08 14:50:58.954998 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:58.954968    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"]
Sep 08 14:50:58.955433 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:58.955328    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk" podUID="2e099432-74cc-4ad5-b5b8-a5aadfb5dac4" containerName="payload-pre-processing" containerID="cri-o://c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8" gracePeriod=30
Sep 08 14:50:59.111677 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.111599    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"]
Sep 08 14:50:59.115163 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.115109    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-653c2a83-bbl6s"]
Sep 08 14:50:59.256631 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.256602    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:59.325265 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.325234    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:59.334725 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.334699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-plugins-config-volume\") pod \"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c\" (UID: \"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c\") "
Sep 08 14:50:59.334871 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.334732    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27wfr\" (UniqueName: \"kubernetes.io/projected/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-kube-api-access-27wfr\") pod \"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c\" (UID: \"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c\") "
Sep 08 14:50:59.335193 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.335165    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c" (UID: "c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:59.337101 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.337080    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-kube-api-access-27wfr" (OuterVolumeSpecName: "kube-api-access-27wfr") pod "c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c" (UID: "c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c"). InnerVolumeSpecName "kube-api-access-27wfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:59.412032 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.411992    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e099432-74cc-4ad5-b5b8-a5aadfb5dac4" containerID="c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8" exitCode=0
Sep 08 14:50:59.412032 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.412039    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"
Sep 08 14:50:59.412351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.412084    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk" event={"ID":"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4","Type":"ContainerDied","Data":"c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8"}
Sep 08 14:50:59.412351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.412173    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk" event={"ID":"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4","Type":"ContainerDied","Data":"a1af1a6667d34c7cb7996a01331763742b2c9916efb4873fc44725e0974ead70"}
Sep 08 14:50:59.412351 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.412207    2561 scope.go:117] "RemoveContainer" containerID="c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8"
Sep 08 14:50:59.413534 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.413507    2561 generic.go:356] "Generic (PLEG): container finished" podID="c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c" containerID="5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064" exitCode=0
Sep 08 14:50:59.413649 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.413547    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"
Sep 08 14:50:59.413649 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.413590    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb" event={"ID":"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c","Type":"ContainerDied","Data":"5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064"}
Sep 08 14:50:59.413649 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.413644    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb" event={"ID":"c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c","Type":"ContainerDied","Data":"323185247bf5c7ec88a453406951426ae008f8f37b0b674fa30d8c678cc9d24b"}
Sep 08 14:50:59.422204 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.422188    2561 scope.go:117] "RemoveContainer" containerID="c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8"
Sep 08 14:50:59.422517 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:50:59.422491    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8\": container with ID starting with c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8 not found: ID does not exist" containerID="c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8"
Sep 08 14:50:59.422584 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.422530    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8"} err="failed to get container status \"c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8\": rpc error: code = NotFound desc = could not find container \"c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8\": container with ID starting with c869b514c5f2cccb00d6695e9ba785c1a2189910edf9c7600aa6646b38414ce8 not found: ID does not exist"
Sep 08 14:50:59.422584 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.422551    2561 scope.go:117] "RemoveContainer" containerID="5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064"
Sep 08 14:50:59.430976 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.430960    2561 scope.go:117] "RemoveContainer" containerID="5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064"
Sep 08 14:50:59.431319 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:50:59.431298    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064\": container with ID starting with 5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064 not found: ID does not exist" containerID="5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064"
Sep 08 14:50:59.431408 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.431327    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064"} err="failed to get container status \"5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064\": rpc error: code = NotFound desc = could not find container \"5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064\": container with ID starting with 5ce853431f1378ce8e5a3df1f4a68911b3085742d151ee6cf9a9f37bf0d12064 not found: ID does not exist"
Sep 08 14:50:59.435659 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.435639    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnbq7\" (UniqueName: \"kubernetes.io/projected/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-kube-api-access-bnbq7\") pod \"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4\" (UID: \"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4\") "
Sep 08 14:50:59.435771 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.435760    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-plugins-config-volume\") pod \"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4\" (UID: \"2e099432-74cc-4ad5-b5b8-a5aadfb5dac4\") "
Sep 08 14:50:59.435973 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.435957    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:59.436013 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.435977    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27wfr\" (UniqueName: \"kubernetes.io/projected/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c-kube-api-access-27wfr\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:59.436193 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.436137    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e099432-74cc-4ad5-b5b8-a5aadfb5dac4" (UID: "2e099432-74cc-4ad5-b5b8-a5aadfb5dac4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:59.438038 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.437999    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-kube-api-access-bnbq7" (OuterVolumeSpecName: "kube-api-access-bnbq7") pod "2e099432-74cc-4ad5-b5b8-a5aadfb5dac4" (UID: "2e099432-74cc-4ad5-b5b8-a5aadfb5dac4"). InnerVolumeSpecName "kube-api-access-bnbq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:59.445781 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.440962    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"]
Sep 08 14:50:59.450235 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.450195    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-653c2a83-5d6cbc77bf-h8pvb"]
Sep 08 14:50:59.537417 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.537317    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:59.537417 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.537361    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnbq7\" (UniqueName: \"kubernetes.io/projected/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4-kube-api-access-bnbq7\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:50:59.555428 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.555394    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 14:50:59.555773 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.555451    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 14:50:59.733744 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.733714    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"]
Sep 08 14:50:59.739368 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:50:59.739339    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-653c2a83-7cbb67b9c4-qcndk"]
Sep 08 14:51:00.521227 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:00.521192    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e099432-74cc-4ad5-b5b8-a5aadfb5dac4" path="/var/lib/kubelet/pods/2e099432-74cc-4ad5-b5b8-a5aadfb5dac4/volumes"
Sep 08 14:51:00.521554 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:00.521541    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="338d00e6-f586-4083-8360-f7117a9bb82a" path="/var/lib/kubelet/pods/338d00e6-f586-4083-8360-f7117a9bb82a/volumes"
Sep 08 14:51:00.521860 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:00.521848    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c" path="/var/lib/kubelet/pods/c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c/volumes"
Sep 08 14:51:00.555337 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:00.555298    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 14:51:00.555434 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:00.555359    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 14:51:01.555156 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:01.555116    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 14:51:01.555558 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:01.555214    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 14:51:02.736526 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:02.736483    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:51:02.737080 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:02.737025    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:51:02.739025 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:02.739002    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 14:51:12.925195 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.925131    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"]
Sep 08 14:51:12.925556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.925512    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e099432-74cc-4ad5-b5b8-a5aadfb5dac4" containerName="payload-pre-processing"
Sep 08 14:51:12.925556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.925523    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e099432-74cc-4ad5-b5b8-a5aadfb5dac4" containerName="payload-pre-processing"
Sep 08 14:51:12.925556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.925538    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="338d00e6-f586-4083-8360-f7117a9bb82a" containerName="revoke-keys"
Sep 08 14:51:12.925556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.925543    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="338d00e6-f586-4083-8360-f7117a9bb82a" containerName="revoke-keys"
Sep 08 14:51:12.925556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.925556    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c" containerName="payload-processing"
Sep 08 14:51:12.925735 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.925563    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c" containerName="payload-processing"
Sep 08 14:51:12.925735 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.925622    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="338d00e6-f586-4083-8360-f7117a9bb82a" containerName="revoke-keys"
Sep 08 14:51:12.925735 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.925631    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e099432-74cc-4ad5-b5b8-a5aadfb5dac4" containerName="payload-pre-processing"
Sep 08 14:51:12.925735 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.925638    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6c8dbf1-d9ba-4e11-8864-6cde5a1ef51c" containerName="payload-processing"
Sep 08 14:51:12.928631 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.928615    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 14:51:12.934571 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.934547    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-f83533\""
Sep 08 14:51:12.934943 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.934922    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-f83533-dockercfg-7lpfg\""
Sep 08 14:51:12.947346 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.947314    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"]
Sep 08 14:51:12.962003 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.961966    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"]
Sep 08 14:51:12.965596 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.965574    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 14:51:12.982481 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:12.982444    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"]
Sep 08 14:51:13.076798 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.076763    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn9qd\" (UniqueName: \"kubernetes.io/projected/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-kube-api-access-gn9qd\") pod \"payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m\" (UID: \"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 14:51:13.077006 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.076821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b969ee6-05ab-4706-9f3e-2cda18ad451e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l\" (UID: \"1b969ee6-05ab-4706-9f3e-2cda18ad451e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 14:51:13.077006 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.076876    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m\" (UID: \"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 14:51:13.077122 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.077017    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc7t4\" (UniqueName: \"kubernetes.io/projected/1b969ee6-05ab-4706-9f3e-2cda18ad451e-kube-api-access-wc7t4\") pod \"payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l\" (UID: \"1b969ee6-05ab-4706-9f3e-2cda18ad451e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 14:51:13.178682 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.178580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc7t4\" (UniqueName: \"kubernetes.io/projected/1b969ee6-05ab-4706-9f3e-2cda18ad451e-kube-api-access-wc7t4\") pod \"payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l\" (UID: \"1b969ee6-05ab-4706-9f3e-2cda18ad451e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 14:51:13.178682 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.178635    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn9qd\" (UniqueName: \"kubernetes.io/projected/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-kube-api-access-gn9qd\") pod \"payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m\" (UID: \"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 14:51:13.178682 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.178679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b969ee6-05ab-4706-9f3e-2cda18ad451e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l\" (UID: \"1b969ee6-05ab-4706-9f3e-2cda18ad451e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 14:51:13.178913 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.178699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m\" (UID: \"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 14:51:13.179660 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.179637    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m\" (UID: \"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 14:51:13.179705 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.179637    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b969ee6-05ab-4706-9f3e-2cda18ad451e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l\" (UID: \"1b969ee6-05ab-4706-9f3e-2cda18ad451e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 14:51:13.190971 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.190872    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc7t4\" (UniqueName: \"kubernetes.io/projected/1b969ee6-05ab-4706-9f3e-2cda18ad451e-kube-api-access-wc7t4\") pod \"payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l\" (UID: \"1b969ee6-05ab-4706-9f3e-2cda18ad451e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 14:51:13.191352 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.191245    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn9qd\" (UniqueName: \"kubernetes.io/projected/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-kube-api-access-gn9qd\") pod \"payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m\" (UID: \"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 14:51:13.239259 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.239217    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 14:51:13.275955 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.275914    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 14:51:13.519632 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.519589    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"]
Sep 08 14:51:13.520767 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:51:13.520746    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b969ee6_05ab_4706_9f3e_2cda18ad451e.slice/crio-40f08a6fb2b4061d867706b6ffac8e104b7fc66e615e0d13ae2e9195c391430e WatchSource:0}: Error finding container 40f08a6fb2b4061d867706b6ffac8e104b7fc66e615e0d13ae2e9195c391430e: Status 404 returned error can't find the container with id 40f08a6fb2b4061d867706b6ffac8e104b7fc66e615e0d13ae2e9195c391430e
Sep 08 14:51:13.569560 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:13.569412    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"]
Sep 08 14:51:13.572008 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:51:13.571978    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138abd0f_3545_4b20_9c2b_6ccc8dd6b0d3.slice/crio-7cb96b3d924f24312aa01de4b74ee896c6888149d7fca95466a254be06af7df0 WatchSource:0}: Error finding container 7cb96b3d924f24312aa01de4b74ee896c6888149d7fca95466a254be06af7df0: Status 404 returned error can't find the container with id 7cb96b3d924f24312aa01de4b74ee896c6888149d7fca95466a254be06af7df0
Sep 08 14:51:14.502909 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:14.502868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l" event={"ID":"1b969ee6-05ab-4706-9f3e-2cda18ad451e","Type":"ContainerStarted","Data":"94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5"}
Sep 08 14:51:14.503436 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:14.502936    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 14:51:14.503436 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:14.502962    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l" event={"ID":"1b969ee6-05ab-4706-9f3e-2cda18ad451e","Type":"ContainerStarted","Data":"40f08a6fb2b4061d867706b6ffac8e104b7fc66e615e0d13ae2e9195c391430e"}
Sep 08 14:51:14.504897 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:14.504864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m" event={"ID":"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3","Type":"ContainerStarted","Data":"0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5"}
Sep 08 14:51:14.505042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:14.504915    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m" event={"ID":"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3","Type":"ContainerStarted","Data":"7cb96b3d924f24312aa01de4b74ee896c6888149d7fca95466a254be06af7df0"}
Sep 08 14:51:14.505042 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:14.504941    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 14:51:14.522127 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:14.522077    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l" podStartSLOduration=2.522060885 podStartE2EDuration="2.522060885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:14.519539167 +0000 UTC m=+1018.530059166" watchObservedRunningTime="2026-09-08 14:51:14.522060885 +0000 UTC m=+1018.532580883"
Sep 08 14:51:14.548265 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:14.548208    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m" podStartSLOduration=2.548189496 podStartE2EDuration="2.548189496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:14.546393729 +0000 UTC m=+1018.556913730" watchObservedRunningTime="2026-09-08 14:51:14.548189496 +0000 UTC m=+1018.558709498"
Sep 08 14:51:20.970690 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:20.970656    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"]
Sep 08 14:51:20.975979 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:20.975958    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:20.978317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:20.978288    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-11dfb4-openshift-default-dockercfg-lh6ln\""
Sep 08 14:51:20.988699 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:20.988672    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"]
Sep 08 14:51:21.056317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.055504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-socket\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.056317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.055745    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-token\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.056317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.055826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-credential-socket\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.056317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.055881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bck6t\" (UniqueName: \"kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-kube-api-access-bck6t\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.056317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.055962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-data\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.056317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.055997    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-podinfo\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.056317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.056024    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-certs\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.056317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.056061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-envoy\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.056317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.056172    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e66c4b-39b8-44fd-91bd-d707bc65020f-istiod-ca-cert\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157321 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-envoy\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157482 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e66c4b-39b8-44fd-91bd-d707bc65020f-istiod-ca-cert\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157482 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-socket\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157482 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-token\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157482 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-credential-socket\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157711 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bck6t\" (UniqueName: \"kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-kube-api-access-bck6t\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157711 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-data\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157711 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-podinfo\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157711 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-certs\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157977 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-socket\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.157977 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.157969    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-certs\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.158361 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.158012    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-credential-socket\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.158361 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.158105    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e66c4b-39b8-44fd-91bd-d707bc65020f-istiod-ca-cert\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.158361 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.158185    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-data\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.159882 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.159861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-envoy\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.160334 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.160311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-podinfo\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.181322 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.181291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-token\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.181436 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.181404    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bck6t\" (UniqueName: \"kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-kube-api-access-bck6t\") pod \"e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") " pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.286671 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.286569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:21.567336 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.567314    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"]
Sep 08 14:51:21.569527 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:51:21.569500    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e66c4b_39b8_44fd_91bd_d707bc65020f.slice/crio-41080321d5055843074ba6bf8a9fb124bc57733574abd260339c9d2e7bf47d8f WatchSource:0}: Error finding container 41080321d5055843074ba6bf8a9fb124bc57733574abd260339c9d2e7bf47d8f: Status 404 returned error can't find the container with id 41080321d5055843074ba6bf8a9fb124bc57733574abd260339c9d2e7bf47d8f
Sep 08 14:51:21.571693 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.571662    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:51:21.571763 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.571725    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:51:21.571763 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:21.571754    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:51:22.548389 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:22.548346    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" event={"ID":"06e66c4b-39b8-44fd-91bd-d707bc65020f","Type":"ContainerStarted","Data":"5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494"}
Sep 08 14:51:22.548880 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:22.548404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" event={"ID":"06e66c4b-39b8-44fd-91bd-d707bc65020f","Type":"ContainerStarted","Data":"41080321d5055843074ba6bf8a9fb124bc57733574abd260339c9d2e7bf47d8f"}
Sep 08 14:51:22.574396 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:22.574348    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" podStartSLOduration=2.574331273 podStartE2EDuration="2.574331273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:22.572800196 +0000 UTC m=+1026.583320195" watchObservedRunningTime="2026-09-08 14:51:22.574331273 +0000 UTC m=+1026.584851333"
Sep 08 14:51:23.287259 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:23.287219    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:23.292462 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:23.292436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:23.554483 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:23.554394    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:23.555496 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:23.555480    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:25.512278 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:25.512247    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 14:51:25.512656 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:25.512417    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 14:51:41.648772 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:41.648740    2561 generic.go:356] "Generic (PLEG): container finished" podID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerID="5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494" exitCode=0
Sep 08 14:51:41.649221 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:41.648791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" event={"ID":"06e66c4b-39b8-44fd-91bd-d707bc65020f","Type":"ContainerDied","Data":"5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494"}
Sep 08 14:51:41.649268 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:41.649229    2561 scope.go:117] "RemoveContainer" containerID="5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494"
Sep 08 14:51:41.650329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:41.650293    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:51:41.650405 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:41.650369    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:51:41.650441 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:41.650408    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:51:42.655965 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:42.655926    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" event={"ID":"06e66c4b-39b8-44fd-91bd-d707bc65020f","Type":"ContainerStarted","Data":"ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e"}
Sep 08 14:51:43.286822 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:43.286779    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:43.287235 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:43.287202    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 14:51:43.287466 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:43.287439    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 14:51:44.287738 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:44.287697    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 14:51:44.288376 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:44.288339    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 14:51:45.287321 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:45.287281    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 14:51:45.287638 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:45.287608    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 14:51:46.287636 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:46.287597    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 14:51:46.288298 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:46.288260    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 14:51:47.287532 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:47.287492    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 14:51:47.287851 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:47.287817    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 14:51:48.290551 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:48.290519    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:48.291012 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:48.290857    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:48.291485 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:48.291469    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:51:54.987876 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:54.987841    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"]
Sep 08 14:51:54.991692 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:54.991675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:51:54.994556 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:54.994532    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-f8c7bd-dockercfg-56fss\""
Sep 08 14:51:54.994731 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:54.994534    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f8c7bd\""
Sep 08 14:51:55.003549 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.003524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljkrw\" (UniqueName: \"kubernetes.io/projected/b9da0fbb-257d-49b3-ab90-5f6418bad931-kube-api-access-ljkrw\") pod \"payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh\" (UID: \"b9da0fbb-257d-49b3-ab90-5f6418bad931\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:51:55.003662 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.003646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9da0fbb-257d-49b3-ab90-5f6418bad931-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh\" (UID: \"b9da0fbb-257d-49b3-ab90-5f6418bad931\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:51:55.011075 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.011049    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"]
Sep 08 14:51:55.039160 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.039100    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"]
Sep 08 14:51:55.043290 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.043262    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:51:55.057499 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.057469    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"]
Sep 08 14:51:55.106228 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.106190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9da0fbb-257d-49b3-ab90-5f6418bad931-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh\" (UID: \"b9da0fbb-257d-49b3-ab90-5f6418bad931\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:51:55.106557 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.106533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljkrw\" (UniqueName: \"kubernetes.io/projected/b9da0fbb-257d-49b3-ab90-5f6418bad931-kube-api-access-ljkrw\") pod \"payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh\" (UID: \"b9da0fbb-257d-49b3-ab90-5f6418bad931\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:51:55.107218 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.107195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9da0fbb-257d-49b3-ab90-5f6418bad931-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh\" (UID: \"b9da0fbb-257d-49b3-ab90-5f6418bad931\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:51:55.118342 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.118311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljkrw\" (UniqueName: \"kubernetes.io/projected/b9da0fbb-257d-49b3-ab90-5f6418bad931-kube-api-access-ljkrw\") pod \"payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh\" (UID: \"b9da0fbb-257d-49b3-ab90-5f6418bad931\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:51:55.207841 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.207785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr2mt\" (UniqueName: \"kubernetes.io/projected/2bddb782-c868-4e16-ac1a-f3ca27584800-kube-api-access-qr2mt\") pod \"payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng\" (UID: \"2bddb782-c868-4e16-ac1a-f3ca27584800\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:51:55.208028 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.207906    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bddb782-c868-4e16-ac1a-f3ca27584800-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng\" (UID: \"2bddb782-c868-4e16-ac1a-f3ca27584800\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:51:55.302538 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.302451    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:51:55.309082 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.309057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr2mt\" (UniqueName: \"kubernetes.io/projected/2bddb782-c868-4e16-ac1a-f3ca27584800-kube-api-access-qr2mt\") pod \"payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng\" (UID: \"2bddb782-c868-4e16-ac1a-f3ca27584800\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:51:55.309199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.309174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bddb782-c868-4e16-ac1a-f3ca27584800-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng\" (UID: \"2bddb782-c868-4e16-ac1a-f3ca27584800\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:51:55.309879 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.309849    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bddb782-c868-4e16-ac1a-f3ca27584800-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng\" (UID: \"2bddb782-c868-4e16-ac1a-f3ca27584800\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:51:55.317348 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.317323    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr2mt\" (UniqueName: \"kubernetes.io/projected/2bddb782-c868-4e16-ac1a-f3ca27584800-kube-api-access-qr2mt\") pod \"payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng\" (UID: \"2bddb782-c868-4e16-ac1a-f3ca27584800\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:51:55.355813 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.355401    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:51:55.582247 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.582159    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"]
Sep 08 14:51:55.584514 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:51:55.584486    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9da0fbb_257d_49b3_ab90_5f6418bad931.slice/crio-9b996684a77482841020e140e2b892444642666a2cf20c879042e60dd23c4dc4 WatchSource:0}: Error finding container 9b996684a77482841020e140e2b892444642666a2cf20c879042e60dd23c4dc4: Status 404 returned error can't find the container with id 9b996684a77482841020e140e2b892444642666a2cf20c879042e60dd23c4dc4
Sep 08 14:51:55.641333 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.641282    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"]
Sep 08 14:51:55.648780 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:51:55.648751    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bddb782_c868_4e16_ac1a_f3ca27584800.slice/crio-0c61799e65a4c69e5c9b264ed0bd048f222ab6dd7a4f8a3f6318ceba260b34b5 WatchSource:0}: Error finding container 0c61799e65a4c69e5c9b264ed0bd048f222ab6dd7a4f8a3f6318ceba260b34b5: Status 404 returned error can't find the container with id 0c61799e65a4c69e5c9b264ed0bd048f222ab6dd7a4f8a3f6318ceba260b34b5
Sep 08 14:51:55.730445 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.730412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh" event={"ID":"b9da0fbb-257d-49b3-ab90-5f6418bad931","Type":"ContainerStarted","Data":"e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5"}
Sep 08 14:51:55.730608 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.730470    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh" event={"ID":"b9da0fbb-257d-49b3-ab90-5f6418bad931","Type":"ContainerStarted","Data":"9b996684a77482841020e140e2b892444642666a2cf20c879042e60dd23c4dc4"}
Sep 08 14:51:55.730707 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.730639    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:51:55.732563 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.732536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng" event={"ID":"2bddb782-c868-4e16-ac1a-f3ca27584800","Type":"ContainerStarted","Data":"3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca"}
Sep 08 14:51:55.732682 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.732575    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng" event={"ID":"2bddb782-c868-4e16-ac1a-f3ca27584800","Type":"ContainerStarted","Data":"0c61799e65a4c69e5c9b264ed0bd048f222ab6dd7a4f8a3f6318ceba260b34b5"}
Sep 08 14:51:55.732682 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.732676    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:51:55.755229 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.754757    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh" podStartSLOduration=1.754735611 podStartE2EDuration="1.754735611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:55.75057324 +0000 UTC m=+1059.761093241" watchObservedRunningTime="2026-09-08 14:51:55.754735611 +0000 UTC m=+1059.765255610"
Sep 08 14:51:55.771933 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:51:55.771876    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng" podStartSLOduration=0.771856432 podStartE2EDuration="771.856432ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:55.76929905 +0000 UTC m=+1059.779819070" watchObservedRunningTime="2026-09-08 14:51:55.771856432 +0000 UTC m=+1059.782376428"
Sep 08 14:52:06.741166 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:06.741114    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:52:06.741565 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:06.741249    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:52:33.685913 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.685809    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"]
Sep 08 14:52:33.691461 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.691436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.693839 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.693815    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3bb80f8b-openshift-default-dockercfg-c97gv\""
Sep 08 14:52:33.704681 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.704657    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"]
Sep 08 14:52:33.806984 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.806926    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-credential-socket\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.807267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.807010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-podinfo\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.807267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.807041    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgdzs\" (UniqueName: \"kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-kube-api-access-pgdzs\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.807267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.807083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-socket\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.807267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.807117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-certs\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.807267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.807174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-token\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.807267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.807207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-envoy\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.807267 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.807231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-data\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.807718 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.807276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc03142d-a161-417c-b046-a6ccd071e3e7-istiod-ca-cert\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.908857 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.908821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-podinfo\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.908857 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.908860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgdzs\" (UniqueName: \"kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-kube-api-access-pgdzs\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.908884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-socket\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.908905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-certs\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.908931    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-token\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.909046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-envoy\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909108 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.909087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-data\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909430 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.909140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc03142d-a161-417c-b046-a6ccd071e3e7-istiod-ca-cert\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909430 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.909286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-credential-socket\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909430 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.909346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-socket\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909430 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.909391    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-certs\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909638 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.909481    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-data\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909695 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.909651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-credential-socket\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.909945 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.909923    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc03142d-a161-417c-b046-a6ccd071e3e7-istiod-ca-cert\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.911649 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.911628    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-envoy\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.911649 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.911643    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-podinfo\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.917631 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.917608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-token\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:33.917713 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:33.917692    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgdzs\" (UniqueName: \"kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-kube-api-access-pgdzs\") pod \"e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") " pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:34.002904 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:34.002865    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:34.280011 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:34.279982    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"]
Sep 08 14:52:34.282009 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:52:34.281983    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc03142d_a161_417c_b046_a6ccd071e3e7.slice/crio-3016426a678f990b9786c42d30786a6df4961214adb2b6be4d991a9cdbfd1d3f WatchSource:0}: Error finding container 3016426a678f990b9786c42d30786a6df4961214adb2b6be4d991a9cdbfd1d3f: Status 404 returned error can't find the container with id 3016426a678f990b9786c42d30786a6df4961214adb2b6be4d991a9cdbfd1d3f
Sep 08 14:52:34.284750 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:34.284717    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:52:34.284819 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:34.284783    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:52:34.284819 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:34.284812    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:52:34.942524 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:34.942489    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" event={"ID":"dc03142d-a161-417c-b046-a6ccd071e3e7","Type":"ContainerStarted","Data":"8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41"}
Sep 08 14:52:34.942900 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:34.942542    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" event={"ID":"dc03142d-a161-417c-b046-a6ccd071e3e7","Type":"ContainerStarted","Data":"3016426a678f990b9786c42d30786a6df4961214adb2b6be4d991a9cdbfd1d3f"}
Sep 08 14:52:34.966705 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:34.966643    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" podStartSLOduration=1.966625313 podStartE2EDuration="1.966625313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:52:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:52:34.964472465 +0000 UTC m=+1098.974992457" watchObservedRunningTime="2026-09-08 14:52:34.966625313 +0000 UTC m=+1098.977145310"
Sep 08 14:52:35.003276 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:35.003228    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:35.008932 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:35.008905    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:35.948613 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:35.948579    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:35.949758 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:35.949740    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:52:38.711612 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.711579    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"]
Sep 08 14:52:38.714737 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.714722    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:52:38.718278 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.718249    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3bb80f8b-dockercfg-6vdnr\""
Sep 08 14:52:38.718397 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.718294    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3bb80f8b\""
Sep 08 14:52:38.730914 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.730891    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"]
Sep 08 14:52:38.760562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.760521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-plugins-config-volume\") pod \"payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5\" (UID: \"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2\") " pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:52:38.760935 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.760907    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tksw6\" (UniqueName: \"kubernetes.io/projected/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-kube-api-access-tksw6\") pod \"payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5\" (UID: \"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2\") " pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:52:38.861943 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.861887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tksw6\" (UniqueName: \"kubernetes.io/projected/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-kube-api-access-tksw6\") pod \"payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5\" (UID: \"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2\") " pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:52:38.862135 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.861992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-plugins-config-volume\") pod \"payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5\" (UID: \"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2\") " pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:52:38.862704 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.862685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-plugins-config-volume\") pod \"payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5\" (UID: \"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2\") " pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:52:38.871229 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:38.871196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tksw6\" (UniqueName: \"kubernetes.io/projected/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-kube-api-access-tksw6\") pod \"payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5\" (UID: \"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2\") " pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:52:39.025374 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:39.025335    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:52:39.299911 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:39.299884    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"]
Sep 08 14:52:39.302135 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:52:39.302110    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655ad66d_2c5c_4f45_a9e7_1502d79c9ee2.slice/crio-6dcf10c43a85510cf786e6036f813761874277f2865517a8d247ac5f9425cf6b WatchSource:0}: Error finding container 6dcf10c43a85510cf786e6036f813761874277f2865517a8d247ac5f9425cf6b: Status 404 returned error can't find the container with id 6dcf10c43a85510cf786e6036f813761874277f2865517a8d247ac5f9425cf6b
Sep 08 14:52:39.971423 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:39.971391    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5" event={"ID":"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2","Type":"ContainerStarted","Data":"2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e"}
Sep 08 14:52:39.971929 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:39.971444    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5" event={"ID":"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2","Type":"ContainerStarted","Data":"6dcf10c43a85510cf786e6036f813761874277f2865517a8d247ac5f9425cf6b"}
Sep 08 14:52:39.971929 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:39.971586    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:52:39.989286 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:39.989233    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5" podStartSLOduration=1.989215177 podStartE2EDuration="1.989215177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:52:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:52:39.987679431 +0000 UTC m=+1103.998199430" watchObservedRunningTime="2026-09-08 14:52:39.989215177 +0000 UTC m=+1103.999735174"
Sep 08 14:52:50.979697 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:50.979666    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:52:58.076065 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:58.076034    2561 generic.go:356] "Generic (PLEG): container finished" podID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerID="8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41" exitCode=0
Sep 08 14:52:58.076434 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:58.076103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" event={"ID":"dc03142d-a161-417c-b046-a6ccd071e3e7","Type":"ContainerDied","Data":"8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41"}
Sep 08 14:52:58.076529 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:58.076512    2561 scope.go:117] "RemoveContainer" containerID="8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41"
Sep 08 14:52:58.077572 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:58.077538    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:52:58.077634 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:58.077617    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:52:58.077669 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:58.077652    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:52:59.085527 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:52:59.085484    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" event={"ID":"dc03142d-a161-417c-b046-a6ccd071e3e7","Type":"ContainerStarted","Data":"cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53"}
Sep 08 14:53:00.004076 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:00.004030    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:53:00.004314 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:00.004195    2561 patch_prober.go:28] interesting pod/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:53:00.004314 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:00.004247    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 14:53:01.003430 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:01.003381    2561 patch_prober.go:28] interesting pod/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:53:01.004614 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:01.004002    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 14:53:02.003873 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:02.003795    2561 patch_prober.go:28] interesting pod/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:53:02.004523 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:02.004487    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 14:53:03.004485 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:03.003985    2561 patch_prober.go:28] interesting pod/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:53:03.004485 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:03.004051    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 14:53:04.004335 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:04.004293    2561 patch_prober.go:28] interesting pod/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:53:04.004559 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:04.004372    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 08 14:53:05.008116 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:05.008081    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:53:05.008600 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:05.008380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:53:05.009138 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:05.009120    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:53:16.611409 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:16.611378    2561 scope.go:117] "RemoveContainer" containerID="a20356ff81896eea87e0b21b51c8572a8974faf66cf8df4afe433cd5e54c5da9"
Sep 08 14:53:46.689377 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:46.689291    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"]
Sep 08 14:53:46.689905 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:46.689580    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5" podUID="655ad66d-2c5c-4f45-a9e7-1502d79c9ee2" containerName="payload-processing" containerID="cri-o://2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e" gracePeriod=30
Sep 08 14:53:46.949358 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:46.949286    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:53:47.079808 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.079764    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tksw6\" (UniqueName: \"kubernetes.io/projected/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-kube-api-access-tksw6\") pod \"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2\" (UID: \"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2\") "
Sep 08 14:53:47.079993 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.079903    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-plugins-config-volume\") pod \"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2\" (UID: \"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2\") "
Sep 08 14:53:47.080362 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.080333    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "655ad66d-2c5c-4f45-a9e7-1502d79c9ee2" (UID: "655ad66d-2c5c-4f45-a9e7-1502d79c9ee2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:53:47.082075 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.082048    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-kube-api-access-tksw6" (OuterVolumeSpecName: "kube-api-access-tksw6") pod "655ad66d-2c5c-4f45-a9e7-1502d79c9ee2" (UID: "655ad66d-2c5c-4f45-a9e7-1502d79c9ee2"). InnerVolumeSpecName "kube-api-access-tksw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:53:47.181471 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.181431    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:53:47.181471 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.181460    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tksw6\" (UniqueName: \"kubernetes.io/projected/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2-kube-api-access-tksw6\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:53:47.357374 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.357343    2561 generic.go:356] "Generic (PLEG): container finished" podID="655ad66d-2c5c-4f45-a9e7-1502d79c9ee2" containerID="2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e" exitCode=0
Sep 08 14:53:47.357553 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.357392    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"
Sep 08 14:53:47.357553 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.357400    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5" event={"ID":"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2","Type":"ContainerDied","Data":"2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e"}
Sep 08 14:53:47.357553 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.357443    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5" event={"ID":"655ad66d-2c5c-4f45-a9e7-1502d79c9ee2","Type":"ContainerDied","Data":"6dcf10c43a85510cf786e6036f813761874277f2865517a8d247ac5f9425cf6b"}
Sep 08 14:53:47.357553 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.357466    2561 scope.go:117] "RemoveContainer" containerID="2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e"
Sep 08 14:53:47.375205 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.375179    2561 scope.go:117] "RemoveContainer" containerID="2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e"
Sep 08 14:53:47.375542 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:53:47.375520    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e\": container with ID starting with 2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e not found: ID does not exist" containerID="2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e"
Sep 08 14:53:47.375596 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.375551    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e"} err="failed to get container status \"2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e\": rpc error: code = NotFound desc = could not find container \"2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e\": container with ID starting with 2f884f7c62803258bfc6c4541b2afea97121201d261569936c8aa400f76c6b2e not found: ID does not exist"
Sep 08 14:53:47.384292 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.384264    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"]
Sep 08 14:53:47.387488 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:47.387462    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bb80f8b-859d8d5f77-6z9b5"]
Sep 08 14:53:48.521518 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:53:48.521485    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="655ad66d-2c5c-4f45-a9e7-1502d79c9ee2" path="/var/lib/kubelet/pods/655ad66d-2c5c-4f45-a9e7-1502d79c9ee2/volumes"
Sep 08 14:54:16.527816 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:16.527770    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:54:16.529804 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:16.529783    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:54:16.632791 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:16.632750    2561 scope.go:117] "RemoveContainer" containerID="1d38aa520ac3b582d99f8b21fd3449570231cba63dd49927756ff2f6eb04a819"
Sep 08 14:54:16.641722 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:16.641699    2561 scope.go:117] "RemoveContainer" containerID="ffd0db42ac77d3a17df4a541024fb57a82a28d722e3dec38899c4ec00c846556"
Sep 08 14:54:38.067541 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:38.067503    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"]
Sep 08 14:54:38.068078 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:38.067821    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy" containerID="cri-o://cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53" gracePeriod=30
Sep 08 14:54:43.318766 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.318738    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458001    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc03142d-a161-417c-b046-a6ccd071e3e7-istiod-ca-cert\") pod \"dc03142d-a161-417c-b046-a6ccd071e3e7\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") "
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458057    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-credential-socket\") pod \"dc03142d-a161-417c-b046-a6ccd071e3e7\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") "
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458119    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-socket\") pod \"dc03142d-a161-417c-b046-a6ccd071e3e7\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") "
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458182    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-envoy\") pod \"dc03142d-a161-417c-b046-a6ccd071e3e7\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") "
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458264    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-data\") pod \"dc03142d-a161-417c-b046-a6ccd071e3e7\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") "
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458323    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-podinfo\") pod \"dc03142d-a161-417c-b046-a6ccd071e3e7\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") "
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458375    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-token\") pod \"dc03142d-a161-417c-b046-a6ccd071e3e7\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") "
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458412    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-certs\") pod \"dc03142d-a161-417c-b046-a6ccd071e3e7\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") "
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458442    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgdzs\" (UniqueName: \"kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-kube-api-access-pgdzs\") pod \"dc03142d-a161-417c-b046-a6ccd071e3e7\" (UID: \"dc03142d-a161-417c-b046-a6ccd071e3e7\") "
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458479    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc03142d-a161-417c-b046-a6ccd071e3e7" (UID: "dc03142d-a161-417c-b046-a6ccd071e3e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:54:43.458777 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458500    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc03142d-a161-417c-b046-a6ccd071e3e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc03142d-a161-417c-b046-a6ccd071e3e7" (UID: "dc03142d-a161-417c-b046-a6ccd071e3e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:54:43.459480 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458807    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc03142d-a161-417c-b046-a6ccd071e3e7-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:54:43.459480 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458828    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:54:43.459480 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.458811    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc03142d-a161-417c-b046-a6ccd071e3e7" (UID: "dc03142d-a161-417c-b046-a6ccd071e3e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:54:43.459480 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.459007    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc03142d-a161-417c-b046-a6ccd071e3e7" (UID: "dc03142d-a161-417c-b046-a6ccd071e3e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:54:43.459763 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.459728    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc03142d-a161-417c-b046-a6ccd071e3e7" (UID: "dc03142d-a161-417c-b046-a6ccd071e3e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:54:43.461518 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.461477    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc03142d-a161-417c-b046-a6ccd071e3e7" (UID: "dc03142d-a161-417c-b046-a6ccd071e3e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:54:43.461665 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.461601    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc03142d-a161-417c-b046-a6ccd071e3e7" (UID: "dc03142d-a161-417c-b046-a6ccd071e3e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:54:43.461829 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.461808    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc03142d-a161-417c-b046-a6ccd071e3e7" (UID: "dc03142d-a161-417c-b046-a6ccd071e3e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:54:43.462078 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.462060    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-kube-api-access-pgdzs" (OuterVolumeSpecName: "kube-api-access-pgdzs") pod "dc03142d-a161-417c-b046-a6ccd071e3e7" (UID: "dc03142d-a161-417c-b046-a6ccd071e3e7"). InnerVolumeSpecName "kube-api-access-pgdzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:54:43.559961 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.559917    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:54:43.559961 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.559951    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:54:43.559961 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.559961    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgdzs\" (UniqueName: \"kubernetes.io/projected/dc03142d-a161-417c-b046-a6ccd071e3e7-kube-api-access-pgdzs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:54:43.559961 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.559970    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:54:43.560276 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.559979    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:54:43.560276 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.559986    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:54:43.560276 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.559993    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc03142d-a161-417c-b046-a6ccd071e3e7-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:54:43.664859 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.664819    2561 generic.go:356] "Generic (PLEG): container finished" podID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerID="cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53" exitCode=0
Sep 08 14:54:43.664859 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.664871    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"
Sep 08 14:54:43.665127 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.664905    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" event={"ID":"dc03142d-a161-417c-b046-a6ccd071e3e7","Type":"ContainerDied","Data":"cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53"}
Sep 08 14:54:43.665127 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.664961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc" event={"ID":"dc03142d-a161-417c-b046-a6ccd071e3e7","Type":"ContainerDied","Data":"3016426a678f990b9786c42d30786a6df4961214adb2b6be4d991a9cdbfd1d3f"}
Sep 08 14:54:43.665127 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.664992    2561 scope.go:117] "RemoveContainer" containerID="cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53"
Sep 08 14:54:43.680258 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.679694    2561 scope.go:117] "RemoveContainer" containerID="8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41"
Sep 08 14:54:43.699109 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.699085    2561 scope.go:117] "RemoveContainer" containerID="cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53"
Sep 08 14:54:43.699516 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:54:43.699491    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53\": container with ID starting with cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53 not found: ID does not exist" containerID="cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53"
Sep 08 14:54:43.699609 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.699524    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53"} err="failed to get container status \"cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53\": rpc error: code = NotFound desc = could not find container \"cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53\": container with ID starting with cdd6d208b953d88c49f5e90641689aae82c48db6cce5034b1ada54bf7d3cfc53 not found: ID does not exist"
Sep 08 14:54:43.699609 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.699544    2561 scope.go:117] "RemoveContainer" containerID="8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41"
Sep 08 14:54:43.699728 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.699626    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"]
Sep 08 14:54:43.699827 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:54:43.699798    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41\": container with ID starting with 8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41 not found: ID does not exist" containerID="8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41"
Sep 08 14:54:43.699874 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.699833    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41"} err="failed to get container status \"8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41\": rpc error: code = NotFound desc = could not find container \"8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41\": container with ID starting with 8d6bfe6a9365fde38d20cee693b0a8c9798175318aa21fc76253e59c29e53f41 not found: ID does not exist"
Sep 08 14:54:43.705854 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:43.705820    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3bb80f8b-openshift-default-55c66bcbb8-sq6jc"]
Sep 08 14:54:44.521668 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:54:44.521635    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" path="/var/lib/kubelet/pods/dc03142d-a161-417c-b046-a6ccd071e3e7/volumes"
Sep 08 14:55:16.669991 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:55:16.669907    2561 scope.go:117] "RemoveContainer" containerID="eb2b32daf3f6cd79bcf28ce7dc5aa116f2209674015d409cd1331d77363812fb"
Sep 08 14:56:01.304908 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.304869    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"]
Sep 08 14:56:01.305547 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.305522    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy"
Sep 08 14:56:01.305547 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.305544    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy"
Sep 08 14:56:01.305676 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.305575    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy"
Sep 08 14:56:01.305676 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.305585    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy"
Sep 08 14:56:01.305676 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.305601    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655ad66d-2c5c-4f45-a9e7-1502d79c9ee2" containerName="payload-processing"
Sep 08 14:56:01.305676 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.305610    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="655ad66d-2c5c-4f45-a9e7-1502d79c9ee2" containerName="payload-processing"
Sep 08 14:56:01.305869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.305709    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy"
Sep 08 14:56:01.305869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.305722    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc03142d-a161-417c-b046-a6ccd071e3e7" containerName="istio-proxy"
Sep 08 14:56:01.305869 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.305738    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="655ad66d-2c5c-4f45-a9e7-1502d79c9ee2" containerName="payload-processing"
Sep 08 14:56:01.309307 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.309272    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.311700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.311673    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4e2141-openshift-default-dockercfg-ctnhs\""
Sep 08 14:56:01.325925 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.325881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"]
Sep 08 14:56:01.353454 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.353405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-socket\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.353671 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.353498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgrfc\" (UniqueName: \"kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-kube-api-access-lgrfc\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.353671 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.353555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-data\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.353671 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.353594    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-token\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.353850 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.353675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-envoy\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.353850 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.353708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-podinfo\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.353850 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.353759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-credential-socket\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.353850 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.353793    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-certs\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.353850 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.353836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istiod-ca-cert\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455007 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.454968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-socket\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455228 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455016    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgrfc\" (UniqueName: \"kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-kube-api-access-lgrfc\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455228 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-data\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455228 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-token\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455228 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-envoy\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455228 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-podinfo\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455228 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-credential-socket\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455228 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-certs\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455683 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istiod-ca-cert\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455683 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-data\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455820 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455775    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-credential-socket\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.455880 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.455822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-certs\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.456229 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.456209    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istiod-ca-cert\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.456323 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.456269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-socket\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.457783 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.457759    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-envoy\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.458182 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.458129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-podinfo\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.463524 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.463494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-token\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.464473 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.464449    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgrfc\" (UniqueName: \"kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-kube-api-access-lgrfc\") pod \"e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") " pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.623077 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.622980    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:01.905876 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.905849    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"]
Sep 08 14:56:01.907796 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:56:01.907760    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fe9f53_d1ce_4438_a2e3_4e8cc0a36cb1.slice/crio-75a08ee4eb89f1b1207c20cea991d11d33e1cb240dfb57b67a7261dd730a5ebf WatchSource:0}: Error finding container 75a08ee4eb89f1b1207c20cea991d11d33e1cb240dfb57b67a7261dd730a5ebf: Status 404 returned error can't find the container with id 75a08ee4eb89f1b1207c20cea991d11d33e1cb240dfb57b67a7261dd730a5ebf
Sep 08 14:56:01.910234 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.910198    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:56:01.910320 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.910275    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:56:01.910320 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:01.910306    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:56:02.081750 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:02.081712    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" event={"ID":"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1","Type":"ContainerStarted","Data":"a2a6a048f86e8ac0be97dd7716d3971eb5344422e9ad79e17d56c2441d62132d"}
Sep 08 14:56:02.081958 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:02.081769    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" event={"ID":"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1","Type":"ContainerStarted","Data":"75a08ee4eb89f1b1207c20cea991d11d33e1cb240dfb57b67a7261dd730a5ebf"}
Sep 08 14:56:02.105583 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:02.105513    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" podStartSLOduration=1.105489937 podStartE2EDuration="1.105489937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:02.10295443 +0000 UTC m=+1306.113474430" watchObservedRunningTime="2026-09-08 14:56:02.105489937 +0000 UTC m=+1306.116009937"
Sep 08 14:56:02.623953 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:02.623909    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:02.629479 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:02.629450    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:03.090501 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:03.090447    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:03.092410 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:03.092373    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:05.079084 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.079045    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"]
Sep 08 14:56:05.083552 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.083525    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.086021 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.085994    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4e2141-serving-cert\""
Sep 08 14:56:05.086510 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.086489    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k5czt\""
Sep 08 14:56:05.086628 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.086492    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 14:56:05.098127 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.098088    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"]
Sep 08 14:56:05.195857 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.195798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754800c4-b464-43d0-86b0-df13b77e541f-openshift-service-ca\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.196235 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.196211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-maas-api-tls\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.196378 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.196360    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mzh\" (UniqueName: \"kubernetes.io/projected/754800c4-b464-43d0-86b0-df13b77e541f-kube-api-access-65mzh\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.196592 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.196574    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-metrics-certs\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.298075 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.298035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-metrics-certs\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.298293 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.298099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754800c4-b464-43d0-86b0-df13b77e541f-openshift-service-ca\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.298293 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.298173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-maas-api-tls\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.298293 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:56:05.298245    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-serving-cert: secret "maas-api-e2e-api-b-4e2141-serving-cert" not found
Sep 08 14:56:05.298454 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:56:05.298302    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-maas-api-tls podName:754800c4-b464-43d0-86b0-df13b77e541f nodeName:}" failed. No retries permitted until 2026-09-08 14:56:05.798283347 +0000 UTC m=+1309.808803331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-maas-api-tls") pod "maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg" (UID: "754800c4-b464-43d0-86b0-df13b77e541f") : secret "maas-api-e2e-api-b-4e2141-serving-cert" not found
Sep 08 14:56:05.298454 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.298303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mzh\" (UniqueName: \"kubernetes.io/projected/754800c4-b464-43d0-86b0-df13b77e541f-kube-api-access-65mzh\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.299005 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.298979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754800c4-b464-43d0-86b0-df13b77e541f-openshift-service-ca\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.300849 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.300827    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-metrics-certs\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.306727 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.306696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mzh\" (UniqueName: \"kubernetes.io/projected/754800c4-b464-43d0-86b0-df13b77e541f-kube-api-access-65mzh\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.803995 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.803957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-maas-api-tls\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.806745 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.806719    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-maas-api-tls\") pod \"maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:05.827060 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.827018    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"]
Sep 08 14:56:05.830825 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.830801    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:56:05.833458 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.833433    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-4e2141\""
Sep 08 14:56:05.833606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.833479    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-4e2141-dockercfg-stb68\""
Sep 08 14:56:05.842381 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.842356    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"]
Sep 08 14:56:05.909172 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.905518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19ac558f-a160-440f-a86c-a9d2a107b5ec-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px\" (UID: \"19ac558f-a160-440f-a86c-a9d2a107b5ec\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:56:05.909172 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.905570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmpfk\" (UniqueName: \"kubernetes.io/projected/19ac558f-a160-440f-a86c-a9d2a107b5ec-kube-api-access-gmpfk\") pod \"payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px\" (UID: \"19ac558f-a160-440f-a86c-a9d2a107b5ec\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:56:05.998120 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:05.998076    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:06.007167 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:06.007118    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19ac558f-a160-440f-a86c-a9d2a107b5ec-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px\" (UID: \"19ac558f-a160-440f-a86c-a9d2a107b5ec\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:56:06.007253 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:06.007192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpfk\" (UniqueName: \"kubernetes.io/projected/19ac558f-a160-440f-a86c-a9d2a107b5ec-kube-api-access-gmpfk\") pod \"payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px\" (UID: \"19ac558f-a160-440f-a86c-a9d2a107b5ec\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:56:06.007815 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:06.007779    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19ac558f-a160-440f-a86c-a9d2a107b5ec-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px\" (UID: \"19ac558f-a160-440f-a86c-a9d2a107b5ec\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:56:06.016679 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:06.016648    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmpfk\" (UniqueName: \"kubernetes.io/projected/19ac558f-a160-440f-a86c-a9d2a107b5ec-kube-api-access-gmpfk\") pod \"payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px\" (UID: \"19ac558f-a160-440f-a86c-a9d2a107b5ec\") " pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:56:06.144114 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:06.144073    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:56:06.277302 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:06.277276    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"]
Sep 08 14:56:06.278462 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:56:06.278438    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754800c4_b464_43d0_86b0_df13b77e541f.slice/crio-995cc60e3f6baaf5580a5e0ebc4ba779e54674fa0738f4d8cca52fa7edf4e07a WatchSource:0}: Error finding container 995cc60e3f6baaf5580a5e0ebc4ba779e54674fa0738f4d8cca52fa7edf4e07a: Status 404 returned error can't find the container with id 995cc60e3f6baaf5580a5e0ebc4ba779e54674fa0738f4d8cca52fa7edf4e07a
Sep 08 14:56:06.279918 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:06.279900    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:56:06.422685 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:06.422650    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"]
Sep 08 14:56:06.423350 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:56:06.423322    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ac558f_a160_440f_a86c_a9d2a107b5ec.slice/crio-29a1ec72f911743947d770757aa824974d6a89c6f872b20f46f53c0dbbe975a5 WatchSource:0}: Error finding container 29a1ec72f911743947d770757aa824974d6a89c6f872b20f46f53c0dbbe975a5: Status 404 returned error can't find the container with id 29a1ec72f911743947d770757aa824974d6a89c6f872b20f46f53c0dbbe975a5
Sep 08 14:56:07.115609 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:07.115558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px" event={"ID":"19ac558f-a160-440f-a86c-a9d2a107b5ec","Type":"ContainerStarted","Data":"d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d"}
Sep 08 14:56:07.115818 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:07.115623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px" event={"ID":"19ac558f-a160-440f-a86c-a9d2a107b5ec","Type":"ContainerStarted","Data":"29a1ec72f911743947d770757aa824974d6a89c6f872b20f46f53c0dbbe975a5"}
Sep 08 14:56:07.115818 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:07.115742    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:56:07.116948 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:07.116913    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg" event={"ID":"754800c4-b464-43d0-86b0-df13b77e541f","Type":"ContainerStarted","Data":"995cc60e3f6baaf5580a5e0ebc4ba779e54674fa0738f4d8cca52fa7edf4e07a"}
Sep 08 14:56:07.134231 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:07.134163    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px" podStartSLOduration=2.134129577 podStartE2EDuration="2.134129577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:07.131963163 +0000 UTC m=+1311.142483162" watchObservedRunningTime="2026-09-08 14:56:07.134129577 +0000 UTC m=+1311.144649771"
Sep 08 14:56:08.126770 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:08.126673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg" event={"ID":"754800c4-b464-43d0-86b0-df13b77e541f","Type":"ContainerStarted","Data":"3b650ca18b668cdc0bfaf64de596925c4852272107675032a6cd54730aaf4531"}
Sep 08 14:56:08.127237 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:08.126827    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:08.144321 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:08.144257    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg" podStartSLOduration=1.678703285 podStartE2EDuration="3.14423843s" totalImagesPullingTime="1.465535145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:08.143984805 +0000 UTC m=+1312.154504807" watchObservedRunningTime="2026-09-08 14:56:08.14423843 +0000 UTC m=+1312.154758480"
Sep 08 14:56:14.138314 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:14.138285    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:56:16.694476 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:16.694448    2561 scope.go:117] "RemoveContainer" containerID="446ddcff0f5b8a15cae3f979f480de7fdda619e7a56982331d9bff5a899793ba"
Sep 08 14:56:18.129343 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:18.129309    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:56:26.231986 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:26.231947    2561 generic.go:356] "Generic (PLEG): container finished" podID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerID="a2a6a048f86e8ac0be97dd7716d3971eb5344422e9ad79e17d56c2441d62132d" exitCode=0
Sep 08 14:56:26.232422 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:26.232026    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" event={"ID":"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1","Type":"ContainerDied","Data":"a2a6a048f86e8ac0be97dd7716d3971eb5344422e9ad79e17d56c2441d62132d"}
Sep 08 14:56:26.232497 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:26.232480    2561 scope.go:117] "RemoveContainer" containerID="a2a6a048f86e8ac0be97dd7716d3971eb5344422e9ad79e17d56c2441d62132d"
Sep 08 14:56:26.233700 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:26.233672    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:56:26.233760 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:26.233747    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:56:26.233798 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:26.233781    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:56:27.240135 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:27.240102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" event={"ID":"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1","Type":"ContainerStarted","Data":"020f4a1959549e4dcda8fea683074ec411f32027e7fa7577dd3e9e633c17f912"}
Sep 08 14:56:27.624296 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:27.624200    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:27.624481 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:27.624459    2561 patch_prober.go:28] interesting pod/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 08 14:56:27.624528 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:27.624511    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 08 14:56:28.624329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:28.624289    2561 patch_prober.go:28] interesting pod/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 08 14:56:28.624741 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:28.624371    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 08 14:56:29.624398 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:29.624356    2561 patch_prober.go:28] interesting pod/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 08 14:56:29.624810 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:29.624424    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 08 14:56:30.623948 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:30.623906    2561 patch_prober.go:28] interesting pod/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 08 14:56:30.624177 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:30.623966    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 08 14:56:31.623666 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:31.623624    2561 patch_prober.go:28] interesting pod/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 08 14:56:31.624077 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:31.623685    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 08 14:56:32.635317 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:32.635283    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:32.635815 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:32.635776    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:56:32.637028 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:56:32.637004    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:57:10.335683 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.335644    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"]
Sep 08 14:57:10.336266 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.335926    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg" podUID="754800c4-b464-43d0-86b0-df13b77e541f" containerName="maas-api" containerID="cri-o://3b650ca18b668cdc0bfaf64de596925c4852272107675032a6cd54730aaf4531" gracePeriod=30
Sep 08 14:57:10.394319 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.394280    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"]
Sep 08 14:57:10.394646 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.394608    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px" podUID="19ac558f-a160-440f-a86c-a9d2a107b5ec" containerName="payload-processing" containerID="cri-o://d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d" gracePeriod=30
Sep 08 14:57:10.471845 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.471798    2561 generic.go:356] "Generic (PLEG): container finished" podID="754800c4-b464-43d0-86b0-df13b77e541f" containerID="3b650ca18b668cdc0bfaf64de596925c4852272107675032a6cd54730aaf4531" exitCode=0
Sep 08 14:57:10.472009 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.471873    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg" event={"ID":"754800c4-b464-43d0-86b0-df13b77e541f","Type":"ContainerDied","Data":"3b650ca18b668cdc0bfaf64de596925c4852272107675032a6cd54730aaf4531"}
Sep 08 14:57:10.680036 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.679997    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:57:10.685232 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.685194    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:57:10.713687 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.713659    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmpfk\" (UniqueName: \"kubernetes.io/projected/19ac558f-a160-440f-a86c-a9d2a107b5ec-kube-api-access-gmpfk\") pod \"19ac558f-a160-440f-a86c-a9d2a107b5ec\" (UID: \"19ac558f-a160-440f-a86c-a9d2a107b5ec\") "
Sep 08 14:57:10.713845 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.713711    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754800c4-b464-43d0-86b0-df13b77e541f-openshift-service-ca\") pod \"754800c4-b464-43d0-86b0-df13b77e541f\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") "
Sep 08 14:57:10.713845 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.713764    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65mzh\" (UniqueName: \"kubernetes.io/projected/754800c4-b464-43d0-86b0-df13b77e541f-kube-api-access-65mzh\") pod \"754800c4-b464-43d0-86b0-df13b77e541f\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") "
Sep 08 14:57:10.713958 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.713843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-metrics-certs\") pod \"754800c4-b464-43d0-86b0-df13b77e541f\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") "
Sep 08 14:57:10.713958 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.713870    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19ac558f-a160-440f-a86c-a9d2a107b5ec-plugins-config-volume\") pod \"19ac558f-a160-440f-a86c-a9d2a107b5ec\" (UID: \"19ac558f-a160-440f-a86c-a9d2a107b5ec\") "
Sep 08 14:57:10.714071 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.714050    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-maas-api-tls\") pod \"754800c4-b464-43d0-86b0-df13b77e541f\" (UID: \"754800c4-b464-43d0-86b0-df13b77e541f\") "
Sep 08 14:57:10.714183 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.714137    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/754800c4-b464-43d0-86b0-df13b77e541f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "754800c4-b464-43d0-86b0-df13b77e541f" (UID: "754800c4-b464-43d0-86b0-df13b77e541f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:10.714304 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.714231    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19ac558f-a160-440f-a86c-a9d2a107b5ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "19ac558f-a160-440f-a86c-a9d2a107b5ec" (UID: "19ac558f-a160-440f-a86c-a9d2a107b5ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:10.716495 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.716466    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19ac558f-a160-440f-a86c-a9d2a107b5ec-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:10.716675 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.716660    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754800c4-b464-43d0-86b0-df13b77e541f-openshift-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:10.717218 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.717089    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "754800c4-b464-43d0-86b0-df13b77e541f" (UID: "754800c4-b464-43d0-86b0-df13b77e541f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:10.717218 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.717080    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "754800c4-b464-43d0-86b0-df13b77e541f" (UID: "754800c4-b464-43d0-86b0-df13b77e541f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:10.717558 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.717534    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/754800c4-b464-43d0-86b0-df13b77e541f-kube-api-access-65mzh" (OuterVolumeSpecName: "kube-api-access-65mzh") pod "754800c4-b464-43d0-86b0-df13b77e541f" (UID: "754800c4-b464-43d0-86b0-df13b77e541f"). InnerVolumeSpecName "kube-api-access-65mzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:10.717644 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.717592    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ac558f-a160-440f-a86c-a9d2a107b5ec-kube-api-access-gmpfk" (OuterVolumeSpecName: "kube-api-access-gmpfk") pod "19ac558f-a160-440f-a86c-a9d2a107b5ec" (UID: "19ac558f-a160-440f-a86c-a9d2a107b5ec"). InnerVolumeSpecName "kube-api-access-gmpfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:10.817545 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.817507    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-maas-api-tls\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:10.817545 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.817539    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmpfk\" (UniqueName: \"kubernetes.io/projected/19ac558f-a160-440f-a86c-a9d2a107b5ec-kube-api-access-gmpfk\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:10.817545 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.817549    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65mzh\" (UniqueName: \"kubernetes.io/projected/754800c4-b464-43d0-86b0-df13b77e541f-kube-api-access-65mzh\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:10.817798 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:10.817558    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/754800c4-b464-43d0-86b0-df13b77e541f-metrics-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:11.479440 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.479400    2561 generic.go:356] "Generic (PLEG): container finished" podID="19ac558f-a160-440f-a86c-a9d2a107b5ec" containerID="d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d" exitCode=0
Sep 08 14:57:11.479891 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.479451    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"
Sep 08 14:57:11.479891 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.479482    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px" event={"ID":"19ac558f-a160-440f-a86c-a9d2a107b5ec","Type":"ContainerDied","Data":"d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d"}
Sep 08 14:57:11.479891 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.479537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px" event={"ID":"19ac558f-a160-440f-a86c-a9d2a107b5ec","Type":"ContainerDied","Data":"29a1ec72f911743947d770757aa824974d6a89c6f872b20f46f53c0dbbe975a5"}
Sep 08 14:57:11.479891 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.479568    2561 scope.go:117] "RemoveContainer" containerID="d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d"
Sep 08 14:57:11.481275 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.481190    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg" event={"ID":"754800c4-b464-43d0-86b0-df13b77e541f","Type":"ContainerDied","Data":"995cc60e3f6baaf5580a5e0ebc4ba779e54674fa0738f4d8cca52fa7edf4e07a"}
Sep 08 14:57:11.481275 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.481231    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"
Sep 08 14:57:11.492136 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.492116    2561 scope.go:117] "RemoveContainer" containerID="d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d"
Sep 08 14:57:11.492604 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:57:11.492570    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d\": container with ID starting with d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d not found: ID does not exist" containerID="d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d"
Sep 08 14:57:11.492705 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.492614    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d"} err="failed to get container status \"d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d\": rpc error: code = NotFound desc = could not find container \"d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d\": container with ID starting with d97f1829d1d3a6f3ac5e929b5c23495a68e52df67a2e9b7415eb753934ab5c8d not found: ID does not exist"
Sep 08 14:57:11.492705 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.492638    2561 scope.go:117] "RemoveContainer" containerID="3b650ca18b668cdc0bfaf64de596925c4852272107675032a6cd54730aaf4531"
Sep 08 14:57:11.503479 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.503453    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"]
Sep 08 14:57:11.509606 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.509580    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4e2141-754cf59b99-qm5px"]
Sep 08 14:57:11.519464 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.519435    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"]
Sep 08 14:57:11.523406 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:11.523380    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e2141-d8b8c5499-kxdpg"]
Sep 08 14:57:12.520952 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:12.520918    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19ac558f-a160-440f-a86c-a9d2a107b5ec" path="/var/lib/kubelet/pods/19ac558f-a160-440f-a86c-a9d2a107b5ec/volumes"
Sep 08 14:57:12.521370 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:12.521355    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="754800c4-b464-43d0-86b0-df13b77e541f" path="/var/lib/kubelet/pods/754800c4-b464-43d0-86b0-df13b77e541f/volumes"
Sep 08 14:57:16.717865 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:16.717825    2561 scope.go:117] "RemoveContainer" containerID="4fd55c6c5ba76e07be3accbb7afc22c41610cb93a8919c400210cd7c0ae72ce2"
Sep 08 14:57:17.414941 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:17.414899    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"]
Sep 08 14:57:17.415237 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:17.415191    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy" containerID="cri-o://020f4a1959549e4dcda8fea683074ec411f32027e7fa7577dd3e9e633c17f912" gracePeriod=30
Sep 08 14:57:17.638424 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:17.638381    2561 patch_prober.go:28] interesting pod/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:57:17.638600 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:17.638456    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:57:22.546660 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.546628    2561 generic.go:356] "Generic (PLEG): container finished" podID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerID="020f4a1959549e4dcda8fea683074ec411f32027e7fa7577dd3e9e633c17f912" exitCode=0
Sep 08 14:57:22.547018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.546844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" event={"ID":"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1","Type":"ContainerDied","Data":"020f4a1959549e4dcda8fea683074ec411f32027e7fa7577dd3e9e633c17f912"}
Sep 08 14:57:22.547018 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.546927    2561 scope.go:117] "RemoveContainer" containerID="a2a6a048f86e8ac0be97dd7716d3971eb5344422e9ad79e17d56c2441d62132d"
Sep 08 14:57:22.683023 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.682959    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:57:22.743447 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.743413    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istiod-ca-cert\") pod \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") "
Sep 08 14:57:22.743624 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.743495    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-podinfo\") pod \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") "
Sep 08 14:57:22.743624 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.743516    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgrfc\" (UniqueName: \"kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-kube-api-access-lgrfc\") pod \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") "
Sep 08 14:57:22.743624 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.743542    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-envoy\") pod \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") "
Sep 08 14:57:22.743624 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.743584    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-credential-socket\") pod \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") "
Sep 08 14:57:22.743624 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.743615    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-data\") pod \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") "
Sep 08 14:57:22.743864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.743654    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-socket\") pod \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") "
Sep 08 14:57:22.743864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.743700    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-token\") pod \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") "
Sep 08 14:57:22.743864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.743732    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-certs\") pod \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\" (UID: \"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1\") "
Sep 08 14:57:22.743864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.743792    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" (UID: "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:22.744075 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.744026    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" (UID: "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:22.744131 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.744047    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" (UID: "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:22.744258 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.744241    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.744311 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.744254    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" (UID: "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:22.744311 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.744263    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.744431 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.744332    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.744491 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.744267    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" (UID: "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:22.745968 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.745947    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" (UID: "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:22.746064 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.746041    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" (UID: "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:57:22.746439 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.746419    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-kube-api-access-lgrfc" (OuterVolumeSpecName: "kube-api-access-lgrfc") pod "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" (UID: "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1"). InnerVolumeSpecName "kube-api-access-lgrfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:22.746537 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.746445    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" (UID: "a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:22.845407 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.845342    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.845407 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.845385    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgrfc\" (UniqueName: \"kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-kube-api-access-lgrfc\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.845407 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.845401    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.845407 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.845412    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.845780 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.845422    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:22.845780 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:22.845433    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:23.553431 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:23.553405    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"
Sep 08 14:57:23.553907 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:23.553446    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn" event={"ID":"a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1","Type":"ContainerDied","Data":"75a08ee4eb89f1b1207c20cea991d11d33e1cb240dfb57b67a7261dd730a5ebf"}
Sep 08 14:57:23.553907 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:23.553508    2561 scope.go:117] "RemoveContainer" containerID="020f4a1959549e4dcda8fea683074ec411f32027e7fa7577dd3e9e633c17f912"
Sep 08 14:57:23.576233 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:23.576200    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"]
Sep 08 14:57:23.580294 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:23.580270    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4e2141-openshift-default-76bf95f98d-nk9kn"]
Sep 08 14:57:24.523521 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:24.523488    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" path="/var/lib/kubelet/pods/a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1/volumes"
Sep 08 14:57:34.973630 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:34.973592    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"]
Sep 08 14:57:34.974079 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:34.973871    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy" containerID="cri-o://ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e" gracePeriod=30
Sep 08 14:57:40.226074 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.226046    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:57:40.326587 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326498    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bck6t\" (UniqueName: \"kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-kube-api-access-bck6t\") pod \"06e66c4b-39b8-44fd-91bd-d707bc65020f\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") "
Sep 08 14:57:40.326587 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326540    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-certs\") pod \"06e66c4b-39b8-44fd-91bd-d707bc65020f\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") "
Sep 08 14:57:40.326587 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326569    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-socket\") pod \"06e66c4b-39b8-44fd-91bd-d707bc65020f\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") "
Sep 08 14:57:40.326864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326597    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-data\") pod \"06e66c4b-39b8-44fd-91bd-d707bc65020f\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") "
Sep 08 14:57:40.326864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326721    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-token\") pod \"06e66c4b-39b8-44fd-91bd-d707bc65020f\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") "
Sep 08 14:57:40.326864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326755    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-envoy\") pod \"06e66c4b-39b8-44fd-91bd-d707bc65020f\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") "
Sep 08 14:57:40.326864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326812    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e66c4b-39b8-44fd-91bd-d707bc65020f-istiod-ca-cert\") pod \"06e66c4b-39b8-44fd-91bd-d707bc65020f\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") "
Sep 08 14:57:40.326864 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326851    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06e66c4b-39b8-44fd-91bd-d707bc65020f" (UID: "06e66c4b-39b8-44fd-91bd-d707bc65020f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:40.327130 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326880    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-data" (OuterVolumeSpecName: "istio-data") pod "06e66c4b-39b8-44fd-91bd-d707bc65020f" (UID: "06e66c4b-39b8-44fd-91bd-d707bc65020f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:40.327130 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326898    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-credential-socket\") pod \"06e66c4b-39b8-44fd-91bd-d707bc65020f\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") "
Sep 08 14:57:40.327130 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.326964    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-podinfo\") pod \"06e66c4b-39b8-44fd-91bd-d707bc65020f\" (UID: \"06e66c4b-39b8-44fd-91bd-d707bc65020f\") "
Sep 08 14:57:40.327130 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.327012    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06e66c4b-39b8-44fd-91bd-d707bc65020f" (UID: "06e66c4b-39b8-44fd-91bd-d707bc65020f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:40.327430 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.327403    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06e66c4b-39b8-44fd-91bd-d707bc65020f" (UID: "06e66c4b-39b8-44fd-91bd-d707bc65020f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:40.327430 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.327411    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e66c4b-39b8-44fd-91bd-d707bc65020f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06e66c4b-39b8-44fd-91bd-d707bc65020f" (UID: "06e66c4b-39b8-44fd-91bd-d707bc65020f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:40.327616 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.327599    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:40.327672 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.327624    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:40.327672 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.327639    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:40.329209 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.329183    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-kube-api-access-bck6t" (OuterVolumeSpecName: "kube-api-access-bck6t") pod "06e66c4b-39b8-44fd-91bd-d707bc65020f" (UID: "06e66c4b-39b8-44fd-91bd-d707bc65020f"). InnerVolumeSpecName "kube-api-access-bck6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:40.329329 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.329217    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-token" (OuterVolumeSpecName: "istio-token") pod "06e66c4b-39b8-44fd-91bd-d707bc65020f" (UID: "06e66c4b-39b8-44fd-91bd-d707bc65020f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:40.329654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.329619    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06e66c4b-39b8-44fd-91bd-d707bc65020f" (UID: "06e66c4b-39b8-44fd-91bd-d707bc65020f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:40.329654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.329640    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06e66c4b-39b8-44fd-91bd-d707bc65020f" (UID: "06e66c4b-39b8-44fd-91bd-d707bc65020f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:57:40.428564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.428524    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bck6t\" (UniqueName: \"kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-kube-api-access-bck6t\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:40.428564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.428557    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:40.428564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.428565    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:40.428564 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.428574    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e66c4b-39b8-44fd-91bd-d707bc65020f-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:40.428855 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.428585    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e66c4b-39b8-44fd-91bd-d707bc65020f-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:40.428855 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.428593    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e66c4b-39b8-44fd-91bd-d707bc65020f-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:40.646716 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.646624    2561 generic.go:356] "Generic (PLEG): container finished" podID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerID="ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e" exitCode=0
Sep 08 14:57:40.646716 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.646680    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"
Sep 08 14:57:40.646893 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.646714    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" event={"ID":"06e66c4b-39b8-44fd-91bd-d707bc65020f","Type":"ContainerDied","Data":"ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e"}
Sep 08 14:57:40.646893 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.646777    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4" event={"ID":"06e66c4b-39b8-44fd-91bd-d707bc65020f","Type":"ContainerDied","Data":"41080321d5055843074ba6bf8a9fb124bc57733574abd260339c9d2e7bf47d8f"}
Sep 08 14:57:40.646893 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.646800    2561 scope.go:117] "RemoveContainer" containerID="ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e"
Sep 08 14:57:40.655647 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.655628    2561 scope.go:117] "RemoveContainer" containerID="5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494"
Sep 08 14:57:40.663726 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.663680    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"]
Sep 08 14:57:40.665295 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.665275    2561 scope.go:117] "RemoveContainer" containerID="ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e"
Sep 08 14:57:40.665589 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:57:40.665567    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e\": container with ID starting with ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e not found: ID does not exist" containerID="ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e"
Sep 08 14:57:40.665679 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.665600    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e"} err="failed to get container status \"ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e\": rpc error: code = NotFound desc = could not find container \"ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e\": container with ID starting with ad00c62d7c27c3a4e958df7b905e9ae674245756dc52876ea4b1f03f5a827e8e not found: ID does not exist"
Sep 08 14:57:40.665679 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.665620    2561 scope.go:117] "RemoveContainer" containerID="5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494"
Sep 08 14:57:40.665890 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:57:40.665872    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494\": container with ID starting with 5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494 not found: ID does not exist" containerID="5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494"
Sep 08 14:57:40.665952 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.665895    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494"} err="failed to get container status \"5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494\": rpc error: code = NotFound desc = could not find container \"5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494\": container with ID starting with 5c7d0cf18a08b27eeaed831a274f340bdb9fbd86dcd7824f61790074f8fc6494 not found: ID does not exist"
Sep 08 14:57:40.666127 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:40.666108    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-11dfb4-openshift-default-595695669d-nc9j4"]
Sep 08 14:57:42.521470 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:42.521432    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" path="/var/lib/kubelet/pods/06e66c4b-39b8-44fd-91bd-d707bc65020f/volumes"
Sep 08 14:57:45.897307 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:45.897272    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"]
Sep 08 14:57:45.897810 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:45.897553    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh" podUID="b9da0fbb-257d-49b3-ab90-5f6418bad931" containerName="payload-processing" containerID="cri-o://e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5" gracePeriod=30
Sep 08 14:57:45.906872 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:45.906839    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"]
Sep 08 14:57:45.907444 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:45.907084    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng" podUID="2bddb782-c868-4e16-ac1a-f3ca27584800" containerName="payload-pre-processing" containerID="cri-o://3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca" gracePeriod=30
Sep 08 14:57:46.207220 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.207193    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:57:46.209971 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.209951    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:57:46.280233 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.280127    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljkrw\" (UniqueName: \"kubernetes.io/projected/b9da0fbb-257d-49b3-ab90-5f6418bad931-kube-api-access-ljkrw\") pod \"b9da0fbb-257d-49b3-ab90-5f6418bad931\" (UID: \"b9da0fbb-257d-49b3-ab90-5f6418bad931\") "
Sep 08 14:57:46.280409 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.280253    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bddb782-c868-4e16-ac1a-f3ca27584800-plugins-config-volume\") pod \"2bddb782-c868-4e16-ac1a-f3ca27584800\" (UID: \"2bddb782-c868-4e16-ac1a-f3ca27584800\") "
Sep 08 14:57:46.280409 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.280298    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr2mt\" (UniqueName: \"kubernetes.io/projected/2bddb782-c868-4e16-ac1a-f3ca27584800-kube-api-access-qr2mt\") pod \"2bddb782-c868-4e16-ac1a-f3ca27584800\" (UID: \"2bddb782-c868-4e16-ac1a-f3ca27584800\") "
Sep 08 14:57:46.280409 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.280329    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9da0fbb-257d-49b3-ab90-5f6418bad931-plugins-config-volume\") pod \"b9da0fbb-257d-49b3-ab90-5f6418bad931\" (UID: \"b9da0fbb-257d-49b3-ab90-5f6418bad931\") "
Sep 08 14:57:46.280729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.280695    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bddb782-c868-4e16-ac1a-f3ca27584800-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2bddb782-c868-4e16-ac1a-f3ca27584800" (UID: "2bddb782-c868-4e16-ac1a-f3ca27584800"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:46.280729 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.280716    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9da0fbb-257d-49b3-ab90-5f6418bad931-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b9da0fbb-257d-49b3-ab90-5f6418bad931" (UID: "b9da0fbb-257d-49b3-ab90-5f6418bad931"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:46.282553 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.282524    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9da0fbb-257d-49b3-ab90-5f6418bad931-kube-api-access-ljkrw" (OuterVolumeSpecName: "kube-api-access-ljkrw") pod "b9da0fbb-257d-49b3-ab90-5f6418bad931" (UID: "b9da0fbb-257d-49b3-ab90-5f6418bad931"). InnerVolumeSpecName "kube-api-access-ljkrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:46.282666 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.282610    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bddb782-c868-4e16-ac1a-f3ca27584800-kube-api-access-qr2mt" (OuterVolumeSpecName: "kube-api-access-qr2mt") pod "2bddb782-c868-4e16-ac1a-f3ca27584800" (UID: "2bddb782-c868-4e16-ac1a-f3ca27584800"). InnerVolumeSpecName "kube-api-access-qr2mt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:46.381391 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.381349    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljkrw\" (UniqueName: \"kubernetes.io/projected/b9da0fbb-257d-49b3-ab90-5f6418bad931-kube-api-access-ljkrw\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:46.381391 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.381378    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bddb782-c868-4e16-ac1a-f3ca27584800-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:46.381391 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.381387    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr2mt\" (UniqueName: \"kubernetes.io/projected/2bddb782-c868-4e16-ac1a-f3ca27584800-kube-api-access-qr2mt\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:46.381391 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.381396    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9da0fbb-257d-49b3-ab90-5f6418bad931-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 14:57:46.678343 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.678307    2561 generic.go:356] "Generic (PLEG): container finished" podID="2bddb782-c868-4e16-ac1a-f3ca27584800" containerID="3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca" exitCode=0
Sep 08 14:57:46.678549 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.678368    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"
Sep 08 14:57:46.678549 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.678430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng" event={"ID":"2bddb782-c868-4e16-ac1a-f3ca27584800","Type":"ContainerDied","Data":"3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca"}
Sep 08 14:57:46.678549 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.678479    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng" event={"ID":"2bddb782-c868-4e16-ac1a-f3ca27584800","Type":"ContainerDied","Data":"0c61799e65a4c69e5c9b264ed0bd048f222ab6dd7a4f8a3f6318ceba260b34b5"}
Sep 08 14:57:46.678549 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.678504    2561 scope.go:117] "RemoveContainer" containerID="3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca"
Sep 08 14:57:46.679904 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.679868    2561 generic.go:356] "Generic (PLEG): container finished" podID="b9da0fbb-257d-49b3-ab90-5f6418bad931" containerID="e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5" exitCode=0
Sep 08 14:57:46.680022 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.679910    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"
Sep 08 14:57:46.680022 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.679959    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh" event={"ID":"b9da0fbb-257d-49b3-ab90-5f6418bad931","Type":"ContainerDied","Data":"e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5"}
Sep 08 14:57:46.680022 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.680017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh" event={"ID":"b9da0fbb-257d-49b3-ab90-5f6418bad931","Type":"ContainerDied","Data":"9b996684a77482841020e140e2b892444642666a2cf20c879042e60dd23c4dc4"}
Sep 08 14:57:46.687648 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.687628    2561 scope.go:117] "RemoveContainer" containerID="3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca"
Sep 08 14:57:46.688003 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:57:46.687980    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca\": container with ID starting with 3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca not found: ID does not exist" containerID="3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca"
Sep 08 14:57:46.688055 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.688007    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca"} err="failed to get container status \"3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca\": rpc error: code = NotFound desc = could not find container \"3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca\": container with ID starting with 3cb0a036c8443637a9f2423ce3fd3fa0a69ce768852c7977419b371ff2e062ca not found: ID does not exist"
Sep 08 14:57:46.688055 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.688024    2561 scope.go:117] "RemoveContainer" containerID="e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5"
Sep 08 14:57:46.696218 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.696193    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"]
Sep 08 14:57:46.696546 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.696528    2561 scope.go:117] "RemoveContainer" containerID="e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5"
Sep 08 14:57:46.696832 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:57:46.696812    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5\": container with ID starting with e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5 not found: ID does not exist" containerID="e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5"
Sep 08 14:57:46.696891 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.696843    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5"} err="failed to get container status \"e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5\": rpc error: code = NotFound desc = could not find container \"e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5\": container with ID starting with e2a07db2f7f8df119c6aabb49b5773fa141bec8a3cba9c67141a0494d4702ce5 not found: ID does not exist"
Sep 08 14:57:46.701478 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.701456    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f8c7bd-68b77d59ff-z7pnh"]
Sep 08 14:57:46.710363 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.710338    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"]
Sep 08 14:57:46.716433 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:46.716409    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8c7bd-7c64b4c8fd-52hng"]
Sep 08 14:57:48.521713 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:48.521682    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bddb782-c868-4e16-ac1a-f3ca27584800" path="/var/lib/kubelet/pods/2bddb782-c868-4e16-ac1a-f3ca27584800/volumes"
Sep 08 14:57:48.522284 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:57:48.522264    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9da0fbb-257d-49b3-ab90-5f6418bad931" path="/var/lib/kubelet/pods/b9da0fbb-257d-49b3-ab90-5f6418bad931/volumes"
Sep 08 14:58:03.831104 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831069    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"]
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831475    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831487    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831501    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9da0fbb-257d-49b3-ab90-5f6418bad931" containerName="payload-processing"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831506    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9da0fbb-257d-49b3-ab90-5f6418bad931" containerName="payload-processing"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831512    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bddb782-c868-4e16-ac1a-f3ca27584800" containerName="payload-pre-processing"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831518    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bddb782-c868-4e16-ac1a-f3ca27584800" containerName="payload-pre-processing"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831527    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ac558f-a160-440f-a86c-a9d2a107b5ec" containerName="payload-processing"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831533    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ac558f-a160-440f-a86c-a9d2a107b5ec" containerName="payload-processing"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831544    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="754800c4-b464-43d0-86b0-df13b77e541f" containerName="maas-api"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831550    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="754800c4-b464-43d0-86b0-df13b77e541f" containerName="maas-api"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831558    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831562    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831574    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831579    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831630    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ac558f-a160-440f-a86c-a9d2a107b5ec" containerName="payload-processing"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831638    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831644    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="754800c4-b464-43d0-86b0-df13b77e541f" containerName="maas-api"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831651    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831657    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy"
Sep 08 14:58:03.831645 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831663    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bddb782-c868-4e16-ac1a-f3ca27584800" containerName="payload-pre-processing"
Sep 08 14:58:03.832698 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831668    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e66c4b-39b8-44fd-91bd-d707bc65020f" containerName="istio-proxy"
Sep 08 14:58:03.832698 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.831674    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9da0fbb-257d-49b3-ab90-5f6418bad931" containerName="payload-processing"
Sep 08 14:58:03.835880 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.835855    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:03.838359 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.838338    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-28eb2c-openshift-default-dockercfg-tvmvn\""
Sep 08 14:58:03.847573 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.847540    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"]
Sep 08 14:58:03.957576 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.957535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-envoy\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:03.957767 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.957658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99nqv\" (UniqueName: \"kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-kube-api-access-99nqv\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:03.957767 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.957717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4478fec-0122-4617-95de-c1c156f6c451-istiod-ca-cert\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:03.957919 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.957768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-istio-token\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:03.957919 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.957802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-credential-socket\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:03.957919 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.957854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-socket\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:03.957919 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.957882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-data\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:03.958177 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.957962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4478fec-0122-4617-95de-c1c156f6c451-istio-podinfo\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:03.958177 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:03.958036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-certs\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.059639 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.059593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4478fec-0122-4617-95de-c1c156f6c451-istio-podinfo\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.059920 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.059898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-certs\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.060021 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.059971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-envoy\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.060078 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.060028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99nqv\" (UniqueName: \"kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-kube-api-access-99nqv\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.060261 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.060230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4478fec-0122-4617-95de-c1c156f6c451-istiod-ca-cert\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.060366 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.060280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-istio-token\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.060366 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.060312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-credential-socket\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.060483 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.060382    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-socket\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.060483 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.060411    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-data\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.060953 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.060309    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-certs\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.060953 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.060898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-credential-socket\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.061098 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.060987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-socket\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.061098 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.061027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4478fec-0122-4617-95de-c1c156f6c451-istiod-ca-cert\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.061098 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.061061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-data\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.062562 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.062532    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-envoy\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.062654 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.062632    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4478fec-0122-4617-95de-c1c156f6c451-istio-podinfo\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.068290 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.068256    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-istio-token\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.068390 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.068354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99nqv\" (UniqueName: \"kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-kube-api-access-99nqv\") pod \"e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") " pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.148544 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.148440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:04.427084 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.427058    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"]
Sep 08 14:58:04.428851 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:58:04.428821    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4478fec_0122_4617_95de_c1c156f6c451.slice/crio-1171c72fad34e6ce842b92ea4b07b44366e51cba2170be59e9622cef3a7d363c WatchSource:0}: Error finding container 1171c72fad34e6ce842b92ea4b07b44366e51cba2170be59e9622cef3a7d363c: Status 404 returned error can't find the container with id 1171c72fad34e6ce842b92ea4b07b44366e51cba2170be59e9622cef3a7d363c
Sep 08 14:58:04.431126 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.431089    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:58:04.431238 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.431183    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:58:04.431238 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.431213    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:58:04.778593 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.778556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" event={"ID":"d4478fec-0122-4617-95de-c1c156f6c451","Type":"ContainerStarted","Data":"1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209"}
Sep 08 14:58:04.778794 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.778620    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" event={"ID":"d4478fec-0122-4617-95de-c1c156f6c451","Type":"ContainerStarted","Data":"1171c72fad34e6ce842b92ea4b07b44366e51cba2170be59e9622cef3a7d363c"}
Sep 08 14:58:04.799503 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:04.799446    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" podStartSLOduration=1.7994273779999999 podStartE2EDuration="1.799427378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:58:04.797476628 +0000 UTC m=+1428.807996628" watchObservedRunningTime="2026-09-08 14:58:04.799427378 +0000 UTC m=+1428.809947377"
Sep 08 14:58:05.149280 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:05.149188    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:05.150609 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:05.150581    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:58:05.150746 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:05.150644    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 14:58:06.153802 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:06.153765    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:06.789005 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:06.788975    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:06.789998 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:06.789963    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:08.672428 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.672340    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"]
Sep 08 14:58:08.672817 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.672800    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy"
Sep 08 14:58:08.672876 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.672820    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5fe9f53-d1ce-4438-a2e3-4e8cc0a36cb1" containerName="istio-proxy"
Sep 08 14:58:08.676199 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.676180    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 14:58:08.678579 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.678547    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-28eb2c\""
Sep 08 14:58:08.687574 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.687542    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"]
Sep 08 14:58:08.733062 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.733026    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"]
Sep 08 14:58:08.736412 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.736394    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 14:58:08.739511 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.739486    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-28eb2c-dockercfg-t9fn7\""
Sep 08 14:58:08.750992 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.750956    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"]
Sep 08 14:58:08.812713 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.812682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsz88\" (UniqueName: \"kubernetes.io/projected/24066295-d53c-4135-8388-e5efe34ec8f8-kube-api-access-qsz88\") pod \"payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj\" (UID: \"24066295-d53c-4135-8388-e5efe34ec8f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 14:58:08.812897 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.812743    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2e36ade-1782-4065-82a9-5c05fa5d8782-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd\" (UID: \"f2e36ade-1782-4065-82a9-5c05fa5d8782\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 14:58:08.812985 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.812931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjrh5\" (UniqueName: \"kubernetes.io/projected/f2e36ade-1782-4065-82a9-5c05fa5d8782-kube-api-access-sjrh5\") pod \"payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd\" (UID: \"f2e36ade-1782-4065-82a9-5c05fa5d8782\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 14:58:08.813051 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.813010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24066295-d53c-4135-8388-e5efe34ec8f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj\" (UID: \"24066295-d53c-4135-8388-e5efe34ec8f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 14:58:08.914216 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.914178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsz88\" (UniqueName: \"kubernetes.io/projected/24066295-d53c-4135-8388-e5efe34ec8f8-kube-api-access-qsz88\") pod \"payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj\" (UID: \"24066295-d53c-4135-8388-e5efe34ec8f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 14:58:08.914438 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.914238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2e36ade-1782-4065-82a9-5c05fa5d8782-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd\" (UID: \"f2e36ade-1782-4065-82a9-5c05fa5d8782\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 14:58:08.914438 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.914317    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjrh5\" (UniqueName: \"kubernetes.io/projected/f2e36ade-1782-4065-82a9-5c05fa5d8782-kube-api-access-sjrh5\") pod \"payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd\" (UID: \"f2e36ade-1782-4065-82a9-5c05fa5d8782\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 14:58:08.914571 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.914514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24066295-d53c-4135-8388-e5efe34ec8f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj\" (UID: \"24066295-d53c-4135-8388-e5efe34ec8f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 14:58:08.915087 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.915064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2e36ade-1782-4065-82a9-5c05fa5d8782-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd\" (UID: \"f2e36ade-1782-4065-82a9-5c05fa5d8782\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 14:58:08.915206 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.915097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24066295-d53c-4135-8388-e5efe34ec8f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj\" (UID: \"24066295-d53c-4135-8388-e5efe34ec8f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 14:58:08.921696 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.921669    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjrh5\" (UniqueName: \"kubernetes.io/projected/f2e36ade-1782-4065-82a9-5c05fa5d8782-kube-api-access-sjrh5\") pod \"payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd\" (UID: \"f2e36ade-1782-4065-82a9-5c05fa5d8782\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 14:58:08.921836 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.921743    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsz88\" (UniqueName: \"kubernetes.io/projected/24066295-d53c-4135-8388-e5efe34ec8f8-kube-api-access-qsz88\") pod \"payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj\" (UID: \"24066295-d53c-4135-8388-e5efe34ec8f8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 14:58:08.988415 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:08.988368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 14:58:09.046724 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.046415    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 14:58:09.262705 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.262678    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"]
Sep 08 14:58:09.264522 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:58:09.264492    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24066295_d53c_4135_8388_e5efe34ec8f8.slice/crio-062ba560e07fc54bbaca0542a51dcb332ab74a64300ff1cddd3542ccf518354b WatchSource:0}: Error finding container 062ba560e07fc54bbaca0542a51dcb332ab74a64300ff1cddd3542ccf518354b: Status 404 returned error can't find the container with id 062ba560e07fc54bbaca0542a51dcb332ab74a64300ff1cddd3542ccf518354b
Sep 08 14:58:09.331583 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.331558    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"]
Sep 08 14:58:09.333513 ip-10-0-129-248 kubenswrapper[2561]: W0908 14:58:09.333485    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e36ade_1782_4065_82a9_5c05fa5d8782.slice/crio-e96c3b7184781060498d3bbff169f7dd49bbf7e69f45ef55b0daf71d3c6e8969 WatchSource:0}: Error finding container e96c3b7184781060498d3bbff169f7dd49bbf7e69f45ef55b0daf71d3c6e8969: Status 404 returned error can't find the container with id e96c3b7184781060498d3bbff169f7dd49bbf7e69f45ef55b0daf71d3c6e8969
Sep 08 14:58:09.819361 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.819324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj" event={"ID":"24066295-d53c-4135-8388-e5efe34ec8f8","Type":"ContainerStarted","Data":"a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80"}
Sep 08 14:58:09.819831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.819390    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 14:58:09.819831 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.819416    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj" event={"ID":"24066295-d53c-4135-8388-e5efe34ec8f8","Type":"ContainerStarted","Data":"062ba560e07fc54bbaca0542a51dcb332ab74a64300ff1cddd3542ccf518354b"}
Sep 08 14:58:09.820896 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.820871    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd" event={"ID":"f2e36ade-1782-4065-82a9-5c05fa5d8782","Type":"ContainerStarted","Data":"14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c"}
Sep 08 14:58:09.821014 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.820914    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd" event={"ID":"f2e36ade-1782-4065-82a9-5c05fa5d8782","Type":"ContainerStarted","Data":"e96c3b7184781060498d3bbff169f7dd49bbf7e69f45ef55b0daf71d3c6e8969"}
Sep 08 14:58:09.821014 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.821003    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 14:58:09.839300 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.839232    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj" podStartSLOduration=1.8392148069999998 podStartE2EDuration="1.839214807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:58:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:58:09.837321084 +0000 UTC m=+1433.847841074" watchObservedRunningTime="2026-09-08 14:58:09.839214807 +0000 UTC m=+1433.849734806"
Sep 08 14:58:09.857273 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:09.857212    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd" podStartSLOduration=1.8571915140000002 podStartE2EDuration="1.857191514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:58:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:58:09.854130725 +0000 UTC m=+1433.864650725" watchObservedRunningTime="2026-09-08 14:58:09.857191514 +0000 UTC m=+1433.867711513"
Sep 08 14:58:20.828388 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:20.828350    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 14:58:20.828839 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:20.828526    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 14:58:22.830362 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:22.830321    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 14:58:22.830757 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:22.830399    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 14:58:24.905919 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:24.905884    2561 generic.go:356] "Generic (PLEG): container finished" podID="d4478fec-0122-4617-95de-c1c156f6c451" containerID="1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209" exitCode=0
Sep 08 14:58:24.906368 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:24.905960    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" event={"ID":"d4478fec-0122-4617-95de-c1c156f6c451","Type":"ContainerDied","Data":"1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209"}
Sep 08 14:58:24.906450 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:24.906434    2561 scope.go:117] "RemoveContainer" containerID="1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209"
Sep 08 14:58:24.907567 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:24.907537    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:58:24.907623 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:24.907609    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:58:24.907667 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:24.907640    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 08 14:58:25.913552 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:25.913522    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" event={"ID":"d4478fec-0122-4617-95de-c1c156f6c451","Type":"ContainerStarted","Data":"9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b"}
Sep 08 14:58:26.149399 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:26.149359    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:26.149648 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:26.149624    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:58:26.149699 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:26.149676    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 14:58:27.149013 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:27.148978    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:58:27.149419 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:27.149034    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 14:58:28.149201 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:28.149131    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:58:28.149584 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:28.149251    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 14:58:29.149586 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:29.149542    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:58:29.149977 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:29.149616    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 14:58:30.149637 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:30.149596    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:58:30.150050 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:30.149658    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 14:58:31.298276 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:31.298238    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:31.298782 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:31.298717    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:58:31.299452 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:58:31.299433    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 14:59:16.561448 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:16.561413    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:59:16.565252 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:16.565227    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 14:59:54.303871 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:54.303840    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd_f2e36ade-1782-4065-82a9-5c05fa5d8782/payload-processing/0.log"
Sep 08 14:59:59.480660 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.480622    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"]
Sep 08 14:59:59.484845 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.484821    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.487132 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.487107    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 14:59:59.487712 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.487684    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-7f92a9-serving-cert\""
Sep 08 14:59:59.487825 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.487720    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k5czt\""
Sep 08 14:59:59.498576 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.498547    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"]
Sep 08 14:59:59.639445 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.639408    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8498990a-241c-4529-8cf5-3ee80633162a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.639666 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.639475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.639666 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.639541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.639666 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.639593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx7c2\" (UniqueName: \"kubernetes.io/projected/8498990a-241c-4529-8cf5-3ee80633162a-kube-api-access-nx7c2\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.740818 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.740716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8498990a-241c-4529-8cf5-3ee80633162a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.740818 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.740784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.740818 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.740803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.741106 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.740838    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx7c2\" (UniqueName: \"kubernetes.io/projected/8498990a-241c-4529-8cf5-3ee80633162a-kube-api-access-nx7c2\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.741106 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:59:59.740962    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-serving-cert: secret "maas-api-e2e-ipp-cleanup-7f92a9-serving-cert" not found
Sep 08 14:59:59.741106 ip-10-0-129-248 kubenswrapper[2561]: E0908 14:59:59.741045    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-maas-api-tls podName:8498990a-241c-4529-8cf5-3ee80633162a nodeName:}" failed. No retries permitted until 2026-09-08 15:00:00.241021366 +0000 UTC m=+1544.251541343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb" (UID: "8498990a-241c-4529-8cf5-3ee80633162a") : secret "maas-api-e2e-ipp-cleanup-7f92a9-serving-cert" not found
Sep 08 14:59:59.741529 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.741509    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8498990a-241c-4529-8cf5-3ee80633162a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.743505 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.743479    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 14:59:59.749468 ip-10-0-129-248 kubenswrapper[2561]: I0908 14:59:59.749443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx7c2\" (UniqueName: \"kubernetes.io/projected/8498990a-241c-4529-8cf5-3ee80633162a-kube-api-access-nx7c2\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 15:00:00.159616 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.159532    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng"]
Sep 08 15:00:00.163756 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.163726    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz"]
Sep 08 15:00:00.163943 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.163858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng"
Sep 08 15:00:00.167953 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.167930    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz"
Sep 08 15:00:00.168722 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.168702    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pdpbl\""
Sep 08 15:00:00.175181 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.175164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng"
Sep 08 15:00:00.181802 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.181738    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng"]
Sep 08 15:00:00.184964 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.184939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz"
Sep 08 15:00:00.185309 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.185286    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz"]
Sep 08 15:00:00.256173 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.250370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 15:00:00.256173 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.254129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 15:00:00.396792 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.396759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 15:00:00.511234 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.508625    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng"]
Sep 08 15:00:00.511234 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.510618    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz"]
Sep 08 15:00:00.512005 ip-10-0-129-248 kubenswrapper[2561]: W0908 15:00:00.511823    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b451e4_084b_45b5_a846_59c39a279f1b.slice/crio-8a96c065b8ff4312f033dec022b97faf7464a1a308a88753b292320ff5c6bb8a WatchSource:0}: Error finding container 8a96c065b8ff4312f033dec022b97faf7464a1a308a88753b292320ff5c6bb8a: Status 404 returned error can't find the container with id 8a96c065b8ff4312f033dec022b97faf7464a1a308a88753b292320ff5c6bb8a
Sep 08 15:00:00.513600 ip-10-0-129-248 kubenswrapper[2561]: W0908 15:00:00.513576    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26c4e5e_0149_40eb_9b8a_d5bffd74b018.slice/crio-adb1b84d13cd4dcd81af666a1d441ce3bbc75fa60f9bfb0481a668a034f06f8a WatchSource:0}: Error finding container adb1b84d13cd4dcd81af666a1d441ce3bbc75fa60f9bfb0481a668a034f06f8a: Status 404 returned error can't find the container with id adb1b84d13cd4dcd81af666a1d441ce3bbc75fa60f9bfb0481a668a034f06f8a
Sep 08 15:00:00.671784 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:00.671750    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"]
Sep 08 15:00:00.673585 ip-10-0-129-248 kubenswrapper[2561]: W0908 15:00:00.673555    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8498990a_241c_4529_8cf5_3ee80633162a.slice/crio-9796437839f7790999031e0ba79ee66efeca0c1cbd2c53d185894b73b094122b WatchSource:0}: Error finding container 9796437839f7790999031e0ba79ee66efeca0c1cbd2c53d185894b73b094122b: Status 404 returned error can't find the container with id 9796437839f7790999031e0ba79ee66efeca0c1cbd2c53d185894b73b094122b
Sep 08 15:00:01.389212 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:01.389176    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng" event={"ID":"c26c4e5e-0149-40eb-9b8a-d5bffd74b018","Type":"ContainerStarted","Data":"c4b61801661895a12cd072bc25eca4b82936465abd23c5a9b02abf420b1bbff1"}
Sep 08 15:00:01.389510 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:01.389240    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng" event={"ID":"c26c4e5e-0149-40eb-9b8a-d5bffd74b018","Type":"ContainerStarted","Data":"adb1b84d13cd4dcd81af666a1d441ce3bbc75fa60f9bfb0481a668a034f06f8a"}
Sep 08 15:00:01.390615 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:01.390590    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb" event={"ID":"8498990a-241c-4529-8cf5-3ee80633162a","Type":"ContainerStarted","Data":"9796437839f7790999031e0ba79ee66efeca0c1cbd2c53d185894b73b094122b"}
Sep 08 15:00:01.392041 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:01.392020    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz" event={"ID":"a9b451e4-084b-45b5-a846-59c39a279f1b","Type":"ContainerStarted","Data":"3a94e869e9572bc16f23809bf1814cc33f1bff59cfa402a75aee0b90a5d44a19"}
Sep 08 15:00:01.392129 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:01.392057    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz" event={"ID":"a9b451e4-084b-45b5-a846-59c39a279f1b","Type":"ContainerStarted","Data":"8a96c065b8ff4312f033dec022b97faf7464a1a308a88753b292320ff5c6bb8a"}
Sep 08 15:00:01.411289 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:01.411238    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng" podStartSLOduration=1.4112234049999999 podStartE2EDuration="1.411223405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:00:01.41094471 +0000 UTC m=+1545.421464714" watchObservedRunningTime="2026-09-08 15:00:01.411223405 +0000 UTC m=+1545.421743403"
Sep 08 15:00:01.428007 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:01.427961    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz" podStartSLOduration=1.427946841 podStartE2EDuration="1.427946841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:00:01.426739065 +0000 UTC m=+1545.437259063" watchObservedRunningTime="2026-09-08 15:00:01.427946841 +0000 UTC m=+1545.438466840"
Sep 08 15:00:02.398812 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:02.398777    2561 generic.go:356] "Generic (PLEG): container finished" podID="c26c4e5e-0149-40eb-9b8a-d5bffd74b018" containerID="c4b61801661895a12cd072bc25eca4b82936465abd23c5a9b02abf420b1bbff1" exitCode=0
Sep 08 15:00:02.399308 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:02.398872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng" event={"ID":"c26c4e5e-0149-40eb-9b8a-d5bffd74b018","Type":"ContainerDied","Data":"c4b61801661895a12cd072bc25eca4b82936465abd23c5a9b02abf420b1bbff1"}
Sep 08 15:00:02.400555 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:02.400525    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb" event={"ID":"8498990a-241c-4529-8cf5-3ee80633162a","Type":"ContainerStarted","Data":"4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe"}
Sep 08 15:00:02.400681 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:02.400619    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 15:00:02.402007 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:02.401981    2561 generic.go:356] "Generic (PLEG): container finished" podID="a9b451e4-084b-45b5-a846-59c39a279f1b" containerID="3a94e869e9572bc16f23809bf1814cc33f1bff59cfa402a75aee0b90a5d44a19" exitCode=0
Sep 08 15:00:02.402107 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:02.402020    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz" event={"ID":"a9b451e4-084b-45b5-a846-59c39a279f1b","Type":"ContainerDied","Data":"3a94e869e9572bc16f23809bf1814cc33f1bff59cfa402a75aee0b90a5d44a19"}
Sep 08 15:00:02.433778 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:02.433721    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb" podStartSLOduration=2.490345354 podStartE2EDuration="3.433701725s" totalImagesPullingTime="943.356371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:00:02.432932053 +0000 UTC m=+1546.443452051" watchObservedRunningTime="2026-09-08 15:00:02.433701725 +0000 UTC m=+1546.444221725"
Sep 08 15:00:03.545650 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:03.545561    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng"
Sep 08 15:00:03.583356 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:03.583328    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz"
Sep 08 15:00:04.413257 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:04.413221    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng"
Sep 08 15:00:04.413463 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:04.413277    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng" event={"ID":"c26c4e5e-0149-40eb-9b8a-d5bffd74b018","Type":"ContainerDied","Data":"adb1b84d13cd4dcd81af666a1d441ce3bbc75fa60f9bfb0481a668a034f06f8a"}
Sep 08 15:00:04.413463 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:04.413333    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adb1b84d13cd4dcd81af666a1d441ce3bbc75fa60f9bfb0481a668a034f06f8a"
Sep 08 15:00:04.414582 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:04.414560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz" event={"ID":"a9b451e4-084b-45b5-a846-59c39a279f1b","Type":"ContainerDied","Data":"8a96c065b8ff4312f033dec022b97faf7464a1a308a88753b292320ff5c6bb8a"}
Sep 08 15:00:04.414698 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:04.414596    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz"
Sep 08 15:00:04.414698 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:04.414601    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a96c065b8ff4312f033dec022b97faf7464a1a308a88753b292320ff5c6bb8a"
Sep 08 15:00:08.413112 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:08.413079    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 15:00:29.917779 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:29.917741    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"]
Sep 08 15:00:29.918400 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:29.918004    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb" podUID="8498990a-241c-4529-8cf5-3ee80633162a" containerName="maas-api" containerID="cri-o://4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe" gracePeriod=30
Sep 08 15:00:30.166319 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.166291    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 15:00:30.262881 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.262851    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx7c2\" (UniqueName: \"kubernetes.io/projected/8498990a-241c-4529-8cf5-3ee80633162a-kube-api-access-nx7c2\") pod \"8498990a-241c-4529-8cf5-3ee80633162a\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") "
Sep 08 15:00:30.263096 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.262955    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8498990a-241c-4529-8cf5-3ee80633162a-openshift-service-ca\") pod \"8498990a-241c-4529-8cf5-3ee80633162a\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") "
Sep 08 15:00:30.263096 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.262980    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-maas-api-tls\") pod \"8498990a-241c-4529-8cf5-3ee80633162a\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") "
Sep 08 15:00:30.263096 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.263031    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-metrics-certs\") pod \"8498990a-241c-4529-8cf5-3ee80633162a\" (UID: \"8498990a-241c-4529-8cf5-3ee80633162a\") "
Sep 08 15:00:30.263379 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.263350    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8498990a-241c-4529-8cf5-3ee80633162a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8498990a-241c-4529-8cf5-3ee80633162a" (UID: "8498990a-241c-4529-8cf5-3ee80633162a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:00:30.265190 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.265137    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8498990a-241c-4529-8cf5-3ee80633162a-kube-api-access-nx7c2" (OuterVolumeSpecName: "kube-api-access-nx7c2") pod "8498990a-241c-4529-8cf5-3ee80633162a" (UID: "8498990a-241c-4529-8cf5-3ee80633162a"). InnerVolumeSpecName "kube-api-access-nx7c2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:00:30.265312 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.265244    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8498990a-241c-4529-8cf5-3ee80633162a" (UID: "8498990a-241c-4529-8cf5-3ee80633162a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:00:30.265382 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.265323    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8498990a-241c-4529-8cf5-3ee80633162a" (UID: "8498990a-241c-4529-8cf5-3ee80633162a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:00:30.364715 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.364678    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx7c2\" (UniqueName: \"kubernetes.io/projected/8498990a-241c-4529-8cf5-3ee80633162a-kube-api-access-nx7c2\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:00:30.364715 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.364708    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8498990a-241c-4529-8cf5-3ee80633162a-openshift-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:00:30.364715 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.364718    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-maas-api-tls\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:00:30.364715 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.364727    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8498990a-241c-4529-8cf5-3ee80633162a-metrics-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:00:30.551029 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.551001    2561 generic.go:356] "Generic (PLEG): container finished" podID="8498990a-241c-4529-8cf5-3ee80633162a" containerID="4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe" exitCode=0
Sep 08 15:00:30.551228 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.551049    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"
Sep 08 15:00:30.551228 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.551089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb" event={"ID":"8498990a-241c-4529-8cf5-3ee80633162a","Type":"ContainerDied","Data":"4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe"}
Sep 08 15:00:30.551228 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.551169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb" event={"ID":"8498990a-241c-4529-8cf5-3ee80633162a","Type":"ContainerDied","Data":"9796437839f7790999031e0ba79ee66efeca0c1cbd2c53d185894b73b094122b"}
Sep 08 15:00:30.551228 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.551199    2561 scope.go:117] "RemoveContainer" containerID="4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe"
Sep 08 15:00:30.559927 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.559911    2561 scope.go:117] "RemoveContainer" containerID="4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe"
Sep 08 15:00:30.560270 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:00:30.560245    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe\": container with ID starting with 4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe not found: ID does not exist" containerID="4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe"
Sep 08 15:00:30.560340 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.560282    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe"} err="failed to get container status \"4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe\": rpc error: code = NotFound desc = could not find container \"4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe\": container with ID starting with 4512b4e0cc024a92f58ab4b7b46f8c81550ee864146179ea3d364708eab22efe not found: ID does not exist"
Sep 08 15:00:30.570895 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.570872    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"]
Sep 08 15:00:30.575482 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:30.575463    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7f92a9-64448448f7-kvxwb"]
Sep 08 15:00:32.521237 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:32.521204    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8498990a-241c-4529-8cf5-3ee80633162a" path="/var/lib/kubelet/pods/8498990a-241c-4529-8cf5-3ee80633162a/volumes"
Sep 08 15:00:56.123447 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.123405    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"]
Sep 08 15:00:56.123902 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.123781    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd" podUID="f2e36ade-1782-4065-82a9-5c05fa5d8782" containerName="payload-processing" containerID="cri-o://14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c" gracePeriod=30
Sep 08 15:00:56.131825 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.131785    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"]
Sep 08 15:00:56.132273 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.132011    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj" podUID="24066295-d53c-4135-8388-e5efe34ec8f8" containerName="payload-pre-processing" containerID="cri-o://a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80" gracePeriod=30
Sep 08 15:00:56.414802 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.414714    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 15:00:56.449001 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.448972    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 15:00:56.531740 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.531714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24066295-d53c-4135-8388-e5efe34ec8f8-plugins-config-volume\") pod \"24066295-d53c-4135-8388-e5efe34ec8f8\" (UID: \"24066295-d53c-4135-8388-e5efe34ec8f8\") "
Sep 08 15:00:56.531924 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.531759    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjrh5\" (UniqueName: \"kubernetes.io/projected/f2e36ade-1782-4065-82a9-5c05fa5d8782-kube-api-access-sjrh5\") pod \"f2e36ade-1782-4065-82a9-5c05fa5d8782\" (UID: \"f2e36ade-1782-4065-82a9-5c05fa5d8782\") "
Sep 08 15:00:56.531924 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.531794    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2e36ade-1782-4065-82a9-5c05fa5d8782-plugins-config-volume\") pod \"f2e36ade-1782-4065-82a9-5c05fa5d8782\" (UID: \"f2e36ade-1782-4065-82a9-5c05fa5d8782\") "
Sep 08 15:00:56.532027 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.531962    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsz88\" (UniqueName: \"kubernetes.io/projected/24066295-d53c-4135-8388-e5efe34ec8f8-kube-api-access-qsz88\") pod \"24066295-d53c-4135-8388-e5efe34ec8f8\" (UID: \"24066295-d53c-4135-8388-e5efe34ec8f8\") "
Sep 08 15:00:56.532187 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.532132    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24066295-d53c-4135-8388-e5efe34ec8f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24066295-d53c-4135-8388-e5efe34ec8f8" (UID: "24066295-d53c-4135-8388-e5efe34ec8f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:00:56.532296 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.532187    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2e36ade-1782-4065-82a9-5c05fa5d8782-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2e36ade-1782-4065-82a9-5c05fa5d8782" (UID: "f2e36ade-1782-4065-82a9-5c05fa5d8782"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:00:56.532431 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.532399    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24066295-d53c-4135-8388-e5efe34ec8f8-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:00:56.532431 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.532419    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2e36ade-1782-4065-82a9-5c05fa5d8782-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:00:56.534174 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.534130    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24066295-d53c-4135-8388-e5efe34ec8f8-kube-api-access-qsz88" (OuterVolumeSpecName: "kube-api-access-qsz88") pod "24066295-d53c-4135-8388-e5efe34ec8f8" (UID: "24066295-d53c-4135-8388-e5efe34ec8f8"). InnerVolumeSpecName "kube-api-access-qsz88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:00:56.534174 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.534141    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2e36ade-1782-4065-82a9-5c05fa5d8782-kube-api-access-sjrh5" (OuterVolumeSpecName: "kube-api-access-sjrh5") pod "f2e36ade-1782-4065-82a9-5c05fa5d8782" (UID: "f2e36ade-1782-4065-82a9-5c05fa5d8782"). InnerVolumeSpecName "kube-api-access-sjrh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:00:56.633622 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.633583    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjrh5\" (UniqueName: \"kubernetes.io/projected/f2e36ade-1782-4065-82a9-5c05fa5d8782-kube-api-access-sjrh5\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:00:56.633622 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.633615    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsz88\" (UniqueName: \"kubernetes.io/projected/24066295-d53c-4135-8388-e5efe34ec8f8-kube-api-access-qsz88\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:00:56.685421 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.685339    2561 generic.go:356] "Generic (PLEG): container finished" podID="f2e36ade-1782-4065-82a9-5c05fa5d8782" containerID="14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c" exitCode=0
Sep 08 15:00:56.685421 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.685404    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"
Sep 08 15:00:56.685619 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.685433    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd" event={"ID":"f2e36ade-1782-4065-82a9-5c05fa5d8782","Type":"ContainerDied","Data":"14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c"}
Sep 08 15:00:56.685619 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.685497    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd" event={"ID":"f2e36ade-1782-4065-82a9-5c05fa5d8782","Type":"ContainerDied","Data":"e96c3b7184781060498d3bbff169f7dd49bbf7e69f45ef55b0daf71d3c6e8969"}
Sep 08 15:00:56.685619 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.685521    2561 scope.go:117] "RemoveContainer" containerID="14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c"
Sep 08 15:00:56.686771 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.686752    2561 generic.go:356] "Generic (PLEG): container finished" podID="24066295-d53c-4135-8388-e5efe34ec8f8" containerID="a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80" exitCode=0
Sep 08 15:00:56.686850 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.686789    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"
Sep 08 15:00:56.686901 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.686843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj" event={"ID":"24066295-d53c-4135-8388-e5efe34ec8f8","Type":"ContainerDied","Data":"a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80"}
Sep 08 15:00:56.686901 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.686883    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj" event={"ID":"24066295-d53c-4135-8388-e5efe34ec8f8","Type":"ContainerDied","Data":"062ba560e07fc54bbaca0542a51dcb332ab74a64300ff1cddd3542ccf518354b"}
Sep 08 15:00:56.695181 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.695159    2561 scope.go:117] "RemoveContainer" containerID="14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c"
Sep 08 15:00:56.695474 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:00:56.695454    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c\": container with ID starting with 14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c not found: ID does not exist" containerID="14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c"
Sep 08 15:00:56.695568 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.695482    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c"} err="failed to get container status \"14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c\": rpc error: code = NotFound desc = could not find container \"14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c\": container with ID starting with 14de35eac708d359a77628e23a18bfdde170d93b3433c5e8549b752d78731a2c not found: ID does not exist"
Sep 08 15:00:56.695568 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.695498    2561 scope.go:117] "RemoveContainer" containerID="a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80"
Sep 08 15:00:56.703730 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.703713    2561 scope.go:117] "RemoveContainer" containerID="a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80"
Sep 08 15:00:56.704003 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:00:56.703985    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80\": container with ID starting with a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80 not found: ID does not exist" containerID="a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80"
Sep 08 15:00:56.704058 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.704011    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80"} err="failed to get container status \"a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80\": rpc error: code = NotFound desc = could not find container \"a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80\": container with ID starting with a9c0ef1fd2f88c8b17053ec3393c62fc1738681b752a840d6cfa11513f1add80 not found: ID does not exist"
Sep 08 15:00:56.710197 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.710175    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"]
Sep 08 15:00:56.717136 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.717115    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-28eb2c-d9b656657-thnrd"]
Sep 08 15:00:56.734891 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.734866    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"]
Sep 08 15:00:56.737603 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:56.737583    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-28eb2c-6c85d69f74-sntdj"]
Sep 08 15:00:58.521473 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:58.521435    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24066295-d53c-4135-8388-e5efe34ec8f8" path="/var/lib/kubelet/pods/24066295-d53c-4135-8388-e5efe34ec8f8/volumes"
Sep 08 15:00:58.521879 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:00:58.521863    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2e36ade-1782-4065-82a9-5c05fa5d8782" path="/var/lib/kubelet/pods/f2e36ade-1782-4065-82a9-5c05fa5d8782/volumes"
Sep 08 15:01:54.674557 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:54.674521    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"]
Sep 08 15:01:54.675059 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:54.674821    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy" containerID="cri-o://9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b" gracePeriod=30
Sep 08 15:01:59.923447 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.923424    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 15:01:59.971283 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971250    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4478fec-0122-4617-95de-c1c156f6c451-istiod-ca-cert\") pod \"d4478fec-0122-4617-95de-c1c156f6c451\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") "
Sep 08 15:01:59.971469 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971317    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-istio-token\") pod \"d4478fec-0122-4617-95de-c1c156f6c451\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") "
Sep 08 15:01:59.971469 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971348    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-certs\") pod \"d4478fec-0122-4617-95de-c1c156f6c451\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") "
Sep 08 15:01:59.971469 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971380    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-data\") pod \"d4478fec-0122-4617-95de-c1c156f6c451\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") "
Sep 08 15:01:59.971469 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971398    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-envoy\") pod \"d4478fec-0122-4617-95de-c1c156f6c451\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") "
Sep 08 15:01:59.971469 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971420    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99nqv\" (UniqueName: \"kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-kube-api-access-99nqv\") pod \"d4478fec-0122-4617-95de-c1c156f6c451\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") "
Sep 08 15:01:59.971743 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971498    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-socket\") pod \"d4478fec-0122-4617-95de-c1c156f6c451\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") "
Sep 08 15:01:59.971743 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971533    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4478fec-0122-4617-95de-c1c156f6c451-istio-podinfo\") pod \"d4478fec-0122-4617-95de-c1c156f6c451\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") "
Sep 08 15:01:59.971743 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971560    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-credential-socket\") pod \"d4478fec-0122-4617-95de-c1c156f6c451\" (UID: \"d4478fec-0122-4617-95de-c1c156f6c451\") "
Sep 08 15:01:59.971743 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971680    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4478fec-0122-4617-95de-c1c156f6c451" (UID: "d4478fec-0122-4617-95de-c1c156f6c451"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:01:59.971743 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971731    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4478fec-0122-4617-95de-c1c156f6c451-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4478fec-0122-4617-95de-c1c156f6c451" (UID: "d4478fec-0122-4617-95de-c1c156f6c451"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:01:59.971995 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971760    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4478fec-0122-4617-95de-c1c156f6c451" (UID: "d4478fec-0122-4617-95de-c1c156f6c451"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:01:59.971995 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.971892    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4478fec-0122-4617-95de-c1c156f6c451" (UID: "d4478fec-0122-4617-95de-c1c156f6c451"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:01:59.972118 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.972022    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:01:59.972118 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.972043    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:01:59.972118 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.972058    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:01:59.972118 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.972073    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4478fec-0122-4617-95de-c1c156f6c451-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:01:59.972118 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.972022    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4478fec-0122-4617-95de-c1c156f6c451" (UID: "d4478fec-0122-4617-95de-c1c156f6c451"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:01:59.973833 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.973802    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4478fec-0122-4617-95de-c1c156f6c451" (UID: "d4478fec-0122-4617-95de-c1c156f6c451"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:01:59.973958 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.973835    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4478fec-0122-4617-95de-c1c156f6c451-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4478fec-0122-4617-95de-c1c156f6c451" (UID: "d4478fec-0122-4617-95de-c1c156f6c451"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:01:59.974071 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.974056    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-kube-api-access-99nqv" (OuterVolumeSpecName: "kube-api-access-99nqv") pod "d4478fec-0122-4617-95de-c1c156f6c451" (UID: "d4478fec-0122-4617-95de-c1c156f6c451"). InnerVolumeSpecName "kube-api-access-99nqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:01:59.974239 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.974226    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4478fec-0122-4617-95de-c1c156f6c451" (UID: "d4478fec-0122-4617-95de-c1c156f6c451"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:01:59.996241 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.996212    2561 generic.go:356] "Generic (PLEG): container finished" podID="d4478fec-0122-4617-95de-c1c156f6c451" containerID="9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b" exitCode=0
Sep 08 15:01:59.996385 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.996266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" event={"ID":"d4478fec-0122-4617-95de-c1c156f6c451","Type":"ContainerDied","Data":"9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b"}
Sep 08 15:01:59.996385 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.996269    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"
Sep 08 15:01:59.996385 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.996337    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt" event={"ID":"d4478fec-0122-4617-95de-c1c156f6c451","Type":"ContainerDied","Data":"1171c72fad34e6ce842b92ea4b07b44366e51cba2170be59e9622cef3a7d363c"}
Sep 08 15:01:59.996385 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:01:59.996358    2561 scope.go:117] "RemoveContainer" containerID="9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b"
Sep 08 15:02:00.005501 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.005485    2561 scope.go:117] "RemoveContainer" containerID="1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209"
Sep 08 15:02:00.013380 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.013305    2561 scope.go:117] "RemoveContainer" containerID="9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b"
Sep 08 15:02:00.013643 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:02:00.013625    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b\": container with ID starting with 9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b not found: ID does not exist" containerID="9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b"
Sep 08 15:02:00.013702 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.013652    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b"} err="failed to get container status \"9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b\": rpc error: code = NotFound desc = could not find container \"9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b\": container with ID starting with 9a161a329d647ea100fb0c31f35200a7baf49381daa982271c909b2277413b0b not found: ID does not exist"
Sep 08 15:02:00.013702 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.013671    2561 scope.go:117] "RemoveContainer" containerID="1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209"
Sep 08 15:02:00.013922 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:02:00.013906    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209\": container with ID starting with 1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209 not found: ID does not exist" containerID="1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209"
Sep 08 15:02:00.013956 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.013930    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209"} err="failed to get container status \"1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209\": rpc error: code = NotFound desc = could not find container \"1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209\": container with ID starting with 1fb18d7b5368bbc11a29d9dd66c26cde31d37ab6460d561f4a7c7e5957db7209 not found: ID does not exist"
Sep 08 15:02:00.017891 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.017870    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"]
Sep 08 15:02:00.021035 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.021015    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-28eb2c-openshift-default-7fcbf74698-lwxkt"]
Sep 08 15:02:00.073393 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.073372    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:00.073393 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.073393    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4478fec-0122-4617-95de-c1c156f6c451-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:00.073540 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.073401    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99nqv\" (UniqueName: \"kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-kube-api-access-99nqv\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:00.073540 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.073410    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4478fec-0122-4617-95de-c1c156f6c451-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:00.073540 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.073418    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4478fec-0122-4617-95de-c1c156f6c451-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:00.521105 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:00.521072    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4478fec-0122-4617-95de-c1c156f6c451" path="/var/lib/kubelet/pods/d4478fec-0122-4617-95de-c1c156f6c451/volumes"
Sep 08 15:02:12.945231 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945194    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"]
Sep 08 15:02:12.945623 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945555    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2e36ade-1782-4065-82a9-5c05fa5d8782" containerName="payload-processing"
Sep 08 15:02:12.945623 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945566    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2e36ade-1782-4065-82a9-5c05fa5d8782" containerName="payload-processing"
Sep 08 15:02:12.945623 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945574    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26c4e5e-0149-40eb-9b8a-d5bffd74b018" containerName="cleanup"
Sep 08 15:02:12.945623 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945579    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26c4e5e-0149-40eb-9b8a-d5bffd74b018" containerName="cleanup"
Sep 08 15:02:12.945623 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945595    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9b451e4-084b-45b5-a846-59c39a279f1b" containerName="cleanup"
Sep 08 15:02:12.945623 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945600    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9b451e4-084b-45b5-a846-59c39a279f1b" containerName="cleanup"
Sep 08 15:02:12.945623 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945610    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy"
Sep 08 15:02:12.945623 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945615    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy"
Sep 08 15:02:12.945623 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945621    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8498990a-241c-4529-8cf5-3ee80633162a" containerName="maas-api"
Sep 08 15:02:12.945623 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945626    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8498990a-241c-4529-8cf5-3ee80633162a" containerName="maas-api"
Sep 08 15:02:12.945952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945635    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy"
Sep 08 15:02:12.945952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945640    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy"
Sep 08 15:02:12.945952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945647    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24066295-d53c-4135-8388-e5efe34ec8f8" containerName="payload-pre-processing"
Sep 08 15:02:12.945952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945652    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="24066295-d53c-4135-8388-e5efe34ec8f8" containerName="payload-pre-processing"
Sep 08 15:02:12.945952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945704    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy"
Sep 08 15:02:12.945952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945712    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="24066295-d53c-4135-8388-e5efe34ec8f8" containerName="payload-pre-processing"
Sep 08 15:02:12.945952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945719    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2e36ade-1782-4065-82a9-5c05fa5d8782" containerName="payload-processing"
Sep 08 15:02:12.945952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945728    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9b451e4-084b-45b5-a846-59c39a279f1b" containerName="cleanup"
Sep 08 15:02:12.945952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945732    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c26c4e5e-0149-40eb-9b8a-d5bffd74b018" containerName="cleanup"
Sep 08 15:02:12.945952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.945739    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8498990a-241c-4529-8cf5-3ee80633162a" containerName="maas-api"
Sep 08 15:02:12.950258 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.950236    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"
Sep 08 15:02:12.957294 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.957272    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pdpbl\""
Sep 08 15:02:12.958399 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:12.958378    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"]
Sep 08 15:02:13.105212 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:13.105178    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7f49b30-4967-44ec-a42c-e2ec6c922a1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk\" (UID: \"a7f49b30-4967-44ec-a42c-e2ec6c922a1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"
Sep 08 15:02:13.206637 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:13.206549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7f49b30-4967-44ec-a42c-e2ec6c922a1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk\" (UID: \"a7f49b30-4967-44ec-a42c-e2ec6c922a1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"
Sep 08 15:02:13.207208 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:13.207191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7f49b30-4967-44ec-a42c-e2ec6c922a1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk\" (UID: \"a7f49b30-4967-44ec-a42c-e2ec6c922a1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"
Sep 08 15:02:13.260878 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:13.260853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"
Sep 08 15:02:13.537105 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:13.537082    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"]
Sep 08 15:02:13.539201 ip-10-0-129-248 kubenswrapper[2561]: W0908 15:02:13.539176    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f49b30_4967_44ec_a42c_e2ec6c922a1c.slice/crio-88b4d28896113797f911982e2540f6ab8a8b54cf422647d3b2d7fbbc27d5babb WatchSource:0}: Error finding container 88b4d28896113797f911982e2540f6ab8a8b54cf422647d3b2d7fbbc27d5babb: Status 404 returned error can't find the container with id 88b4d28896113797f911982e2540f6ab8a8b54cf422647d3b2d7fbbc27d5babb
Sep 08 15:02:14.066975 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:14.066871    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk" event={"ID":"a7f49b30-4967-44ec-a42c-e2ec6c922a1c","Type":"ContainerStarted","Data":"b5a3c9c6ffe4ddada2b3559e7de3877bed8ddb121c611107edd8befe54d5b975"}
Sep 08 15:02:14.066975 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:14.066937    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk" event={"ID":"a7f49b30-4967-44ec-a42c-e2ec6c922a1c","Type":"ContainerStarted","Data":"88b4d28896113797f911982e2540f6ab8a8b54cf422647d3b2d7fbbc27d5babb"}
Sep 08 15:02:14.087619 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:14.087567    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk" podStartSLOduration=2.087552656 podStartE2EDuration="2.087552656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:02:14.085610205 +0000 UTC m=+1678.096130208" watchObservedRunningTime="2026-09-08 15:02:14.087552656 +0000 UTC m=+1678.098072653"
Sep 08 15:02:15.073221 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:15.073185    2561 generic.go:356] "Generic (PLEG): container finished" podID="a7f49b30-4967-44ec-a42c-e2ec6c922a1c" containerID="b5a3c9c6ffe4ddada2b3559e7de3877bed8ddb121c611107edd8befe54d5b975" exitCode=0
Sep 08 15:02:15.073584 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:15.073228    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk" event={"ID":"a7f49b30-4967-44ec-a42c-e2ec6c922a1c","Type":"ContainerDied","Data":"b5a3c9c6ffe4ddada2b3559e7de3877bed8ddb121c611107edd8befe54d5b975"}
Sep 08 15:02:16.211104 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:16.211081    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"
Sep 08 15:02:16.338438 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:16.338350    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7f49b30-4967-44ec-a42c-e2ec6c922a1c-maas-api-service-ca\") pod \"a7f49b30-4967-44ec-a42c-e2ec6c922a1c\" (UID: \"a7f49b30-4967-44ec-a42c-e2ec6c922a1c\") "
Sep 08 15:02:16.338706 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:16.338684    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7f49b30-4967-44ec-a42c-e2ec6c922a1c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a7f49b30-4967-44ec-a42c-e2ec6c922a1c" (UID: "a7f49b30-4967-44ec-a42c-e2ec6c922a1c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:16.439074 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:16.439039    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7f49b30-4967-44ec-a42c-e2ec6c922a1c-maas-api-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:17.086547 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:17.086459    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"
Sep 08 15:02:17.086547 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:17.086472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk" event={"ID":"a7f49b30-4967-44ec-a42c-e2ec6c922a1c","Type":"ContainerDied","Data":"88b4d28896113797f911982e2540f6ab8a8b54cf422647d3b2d7fbbc27d5babb"}
Sep 08 15:02:17.086547 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:17.086516    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88b4d28896113797f911982e2540f6ab8a8b54cf422647d3b2d7fbbc27d5babb"
Sep 08 15:02:23.543841 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:23.543797    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng"]
Sep 08 15:02:23.547745 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:23.547708    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-ef8f61-29814660-dr2ng"]
Sep 08 15:02:23.572413 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:23.572382    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"]
Sep 08 15:02:23.572628 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:23.572585    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6" podUID="b828aec2-65e6-4011-8a97-067eb69a1792" containerName="payload-processing" containerID="cri-o://635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f" gracePeriod=30
Sep 08 15:02:23.775108 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:23.775076    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"]
Sep 08 15:02:23.777700 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:23.777676    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-ef8f61-f9dbk"]
Sep 08 15:02:23.829014 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:23.828991    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 15:02:24.011507 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.011475    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b828aec2-65e6-4011-8a97-067eb69a1792-plugins-config-volume\") pod \"b828aec2-65e6-4011-8a97-067eb69a1792\" (UID: \"b828aec2-65e6-4011-8a97-067eb69a1792\") "
Sep 08 15:02:24.011679 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.011575    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knzpf\" (UniqueName: \"kubernetes.io/projected/b828aec2-65e6-4011-8a97-067eb69a1792-kube-api-access-knzpf\") pod \"b828aec2-65e6-4011-8a97-067eb69a1792\" (UID: \"b828aec2-65e6-4011-8a97-067eb69a1792\") "
Sep 08 15:02:24.011892 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.011866    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b828aec2-65e6-4011-8a97-067eb69a1792-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b828aec2-65e6-4011-8a97-067eb69a1792" (UID: "b828aec2-65e6-4011-8a97-067eb69a1792"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:24.013719 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.013698    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b828aec2-65e6-4011-8a97-067eb69a1792-kube-api-access-knzpf" (OuterVolumeSpecName: "kube-api-access-knzpf") pod "b828aec2-65e6-4011-8a97-067eb69a1792" (UID: "b828aec2-65e6-4011-8a97-067eb69a1792"). InnerVolumeSpecName "kube-api-access-knzpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:24.112517 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.112441    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b828aec2-65e6-4011-8a97-067eb69a1792-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:24.112517 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.112465    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knzpf\" (UniqueName: \"kubernetes.io/projected/b828aec2-65e6-4011-8a97-067eb69a1792-kube-api-access-knzpf\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:24.122563 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.122538    2561 generic.go:356] "Generic (PLEG): container finished" podID="b828aec2-65e6-4011-8a97-067eb69a1792" containerID="635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f" exitCode=0
Sep 08 15:02:24.122719 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.122581    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"
Sep 08 15:02:24.122719 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.122628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6" event={"ID":"b828aec2-65e6-4011-8a97-067eb69a1792","Type":"ContainerDied","Data":"635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f"}
Sep 08 15:02:24.122719 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.122685    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6" event={"ID":"b828aec2-65e6-4011-8a97-067eb69a1792","Type":"ContainerDied","Data":"279715a1dbff2387ed8d3b3cbe6e91e49ee965b0954853296648b2e69bf0fe2c"}
Sep 08 15:02:24.122719 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.122712    2561 scope.go:117] "RemoveContainer" containerID="635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f"
Sep 08 15:02:24.131530 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.131511    2561 scope.go:117] "RemoveContainer" containerID="635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f"
Sep 08 15:02:24.131859 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:02:24.131826    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f\": container with ID starting with 635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f not found: ID does not exist" containerID="635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f"
Sep 08 15:02:24.131916 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.131871    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f"} err="failed to get container status \"635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f\": rpc error: code = NotFound desc = could not find container \"635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f\": container with ID starting with 635b3f3e6468214073508aeb2273eb215038b6cea6923006278eebc07e14b56f not found: ID does not exist"
Sep 08 15:02:24.149159 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.149121    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"]
Sep 08 15:02:24.154034 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.154013    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ef8f61-dd4b678c9-nx4q6"]
Sep 08 15:02:24.520892 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.520858    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7f49b30-4967-44ec-a42c-e2ec6c922a1c" path="/var/lib/kubelet/pods/a7f49b30-4967-44ec-a42c-e2ec6c922a1c/volumes"
Sep 08 15:02:24.521254 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.521241    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b828aec2-65e6-4011-8a97-067eb69a1792" path="/var/lib/kubelet/pods/b828aec2-65e6-4011-8a97-067eb69a1792/volumes"
Sep 08 15:02:24.521481 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:24.521470    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c26c4e5e-0149-40eb-9b8a-d5bffd74b018" path="/var/lib/kubelet/pods/c26c4e5e-0149-40eb-9b8a-d5bffd74b018/volumes"
Sep 08 15:02:31.885317 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:31.885282    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"]
Sep 08 15:02:31.885835 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:31.885473    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy" containerID="cri-o://3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af" gracePeriod=30
Sep 08 15:02:32.739058 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:32.739019    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:02:32.739257 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:32.739089    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:02:37.130239 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.130209    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 15:02:37.191589 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.191520    2561 generic.go:356] "Generic (PLEG): container finished" podID="30723475-874e-40fd-aa27-3b91cd129fcb" containerID="3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af" exitCode=0
Sep 08 15:02:37.191589 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.191563    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"
Sep 08 15:02:37.191772 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.191596    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" event={"ID":"30723475-874e-40fd-aa27-3b91cd129fcb","Type":"ContainerDied","Data":"3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af"}
Sep 08 15:02:37.191772 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.191648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw" event={"ID":"30723475-874e-40fd-aa27-3b91cd129fcb","Type":"ContainerDied","Data":"7f7447951654c8f9b2f1a2e018767759a6923d22e63675a1113460427db52429"}
Sep 08 15:02:37.191772 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.191670    2561 scope.go:117] "RemoveContainer" containerID="3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af"
Sep 08 15:02:37.200118 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.200093    2561 scope.go:117] "RemoveContainer" containerID="7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2"
Sep 08 15:02:37.207963 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.207947    2561 scope.go:117] "RemoveContainer" containerID="3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af"
Sep 08 15:02:37.208235 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:02:37.208218    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af\": container with ID starting with 3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af not found: ID does not exist" containerID="3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af"
Sep 08 15:02:37.208279 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.208245    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af"} err="failed to get container status \"3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af\": rpc error: code = NotFound desc = could not find container \"3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af\": container with ID starting with 3e46c22700439db9ab7a6299430ec58c29f35c029ecf597b02383494b06c30af not found: ID does not exist"
Sep 08 15:02:37.208279 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.208261    2561 scope.go:117] "RemoveContainer" containerID="7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2"
Sep 08 15:02:37.208517 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:02:37.208497    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2\": container with ID starting with 7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2 not found: ID does not exist" containerID="7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2"
Sep 08 15:02:37.208559 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.208528    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2"} err="failed to get container status \"7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2\": rpc error: code = NotFound desc = could not find container \"7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2\": container with ID starting with 7e04af87579d184d7cb9a867c87a8772576fa6fb317c4704121190ae0d8163d2 not found: ID does not exist"
Sep 08 15:02:37.225971 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.225954    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30723475-874e-40fd-aa27-3b91cd129fcb-istio-podinfo\") pod \"30723475-874e-40fd-aa27-3b91cd129fcb\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") "
Sep 08 15:02:37.226071 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.225982    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-data\") pod \"30723475-874e-40fd-aa27-3b91cd129fcb\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") "
Sep 08 15:02:37.226071 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226027    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30723475-874e-40fd-aa27-3b91cd129fcb-istiod-ca-cert\") pod \"30723475-874e-40fd-aa27-3b91cd129fcb\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") "
Sep 08 15:02:37.226197 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226176    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-istio-token\") pod \"30723475-874e-40fd-aa27-3b91cd129fcb\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") "
Sep 08 15:02:37.226261 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226232    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-credential-socket\") pod \"30723475-874e-40fd-aa27-3b91cd129fcb\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") "
Sep 08 15:02:37.226261 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226247    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-data" (OuterVolumeSpecName: "istio-data") pod "30723475-874e-40fd-aa27-3b91cd129fcb" (UID: "30723475-874e-40fd-aa27-3b91cd129fcb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:37.226365 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226261    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-certs\") pod \"30723475-874e-40fd-aa27-3b91cd129fcb\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") "
Sep 08 15:02:37.226365 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226323    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtlpb\" (UniqueName: \"kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-kube-api-access-rtlpb\") pod \"30723475-874e-40fd-aa27-3b91cd129fcb\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") "
Sep 08 15:02:37.226365 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226334    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30723475-874e-40fd-aa27-3b91cd129fcb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "30723475-874e-40fd-aa27-3b91cd129fcb" (UID: "30723475-874e-40fd-aa27-3b91cd129fcb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:37.226508 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226374    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-socket\") pod \"30723475-874e-40fd-aa27-3b91cd129fcb\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") "
Sep 08 15:02:37.226508 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226438    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-envoy\") pod \"30723475-874e-40fd-aa27-3b91cd129fcb\" (UID: \"30723475-874e-40fd-aa27-3b91cd129fcb\") "
Sep 08 15:02:37.226508 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226454    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "30723475-874e-40fd-aa27-3b91cd129fcb" (UID: "30723475-874e-40fd-aa27-3b91cd129fcb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:37.226644 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226502    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "30723475-874e-40fd-aa27-3b91cd129fcb" (UID: "30723475-874e-40fd-aa27-3b91cd129fcb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:37.226770 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226747    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-data\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:37.226834 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226772    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30723475-874e-40fd-aa27-3b91cd129fcb-istiod-ca-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:37.226834 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226785    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-credential-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:37.226834 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226797    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:37.226834 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.226786    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "30723475-874e-40fd-aa27-3b91cd129fcb" (UID: "30723475-874e-40fd-aa27-3b91cd129fcb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:37.228286 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.228263    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-istio-token" (OuterVolumeSpecName: "istio-token") pod "30723475-874e-40fd-aa27-3b91cd129fcb" (UID: "30723475-874e-40fd-aa27-3b91cd129fcb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:37.228397 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.228318    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/30723475-874e-40fd-aa27-3b91cd129fcb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "30723475-874e-40fd-aa27-3b91cd129fcb" (UID: "30723475-874e-40fd-aa27-3b91cd129fcb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:02:37.228467 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.228410    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-kube-api-access-rtlpb" (OuterVolumeSpecName: "kube-api-access-rtlpb") pod "30723475-874e-40fd-aa27-3b91cd129fcb" (UID: "30723475-874e-40fd-aa27-3b91cd129fcb"). InnerVolumeSpecName "kube-api-access-rtlpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:37.228670 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.228643    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "30723475-874e-40fd-aa27-3b91cd129fcb" (UID: "30723475-874e-40fd-aa27-3b91cd129fcb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:37.327847 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.327814    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30723475-874e-40fd-aa27-3b91cd129fcb-istio-podinfo\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:37.327847 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.327840    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-istio-token\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:37.327847 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.327851    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtlpb\" (UniqueName: \"kubernetes.io/projected/30723475-874e-40fd-aa27-3b91cd129fcb-kube-api-access-rtlpb\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:37.328010 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.327859    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-workload-socket\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:37.328010 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.327868    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30723475-874e-40fd-aa27-3b91cd129fcb-istio-envoy\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:37.519497 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.519467    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"]
Sep 08 15:02:37.524190 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:37.524165    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ef8f61-openshift-default-684fbcf648-r2cnw"]
Sep 08 15:02:38.522638 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:38.522606    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" path="/var/lib/kubelet/pods/30723475-874e-40fd-aa27-3b91cd129fcb/volumes"
Sep 08 15:02:42.768024 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:42.767985    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz"]
Sep 08 15:02:42.772541 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:42.772512    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f83533-29814660-dzchz"]
Sep 08 15:02:42.794102 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:42.794072    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"]
Sep 08 15:02:42.794650 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:42.794614    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m" podUID="138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3" containerName="payload-processing" containerID="cri-o://0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5" gracePeriod=30
Sep 08 15:02:42.802716 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:42.802685    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"]
Sep 08 15:02:42.802939 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:42.802901    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l" podUID="1b969ee6-05ab-4706-9f3e-2cda18ad451e" containerName="payload-pre-processing" containerID="cri-o://94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5" gracePeriod=30
Sep 08 15:02:43.071355 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.071333    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 15:02:43.074111 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.074090    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 15:02:43.181925 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.181885    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc7t4\" (UniqueName: \"kubernetes.io/projected/1b969ee6-05ab-4706-9f3e-2cda18ad451e-kube-api-access-wc7t4\") pod \"1b969ee6-05ab-4706-9f3e-2cda18ad451e\" (UID: \"1b969ee6-05ab-4706-9f3e-2cda18ad451e\") "
Sep 08 15:02:43.182100 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.181962    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn9qd\" (UniqueName: \"kubernetes.io/projected/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-kube-api-access-gn9qd\") pod \"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3\" (UID: \"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3\") "
Sep 08 15:02:43.182100 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.182007    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b969ee6-05ab-4706-9f3e-2cda18ad451e-plugins-config-volume\") pod \"1b969ee6-05ab-4706-9f3e-2cda18ad451e\" (UID: \"1b969ee6-05ab-4706-9f3e-2cda18ad451e\") "
Sep 08 15:02:43.182100 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.182051    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-plugins-config-volume\") pod \"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3\" (UID: \"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3\") "
Sep 08 15:02:43.182474 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.182445    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b969ee6-05ab-4706-9f3e-2cda18ad451e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b969ee6-05ab-4706-9f3e-2cda18ad451e" (UID: "1b969ee6-05ab-4706-9f3e-2cda18ad451e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:43.182474 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.182466    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3" (UID: "138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:43.184240 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.184211    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-kube-api-access-gn9qd" (OuterVolumeSpecName: "kube-api-access-gn9qd") pod "138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3" (UID: "138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3"). InnerVolumeSpecName "kube-api-access-gn9qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:43.184240 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.184218    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b969ee6-05ab-4706-9f3e-2cda18ad451e-kube-api-access-wc7t4" (OuterVolumeSpecName: "kube-api-access-wc7t4") pod "1b969ee6-05ab-4706-9f3e-2cda18ad451e" (UID: "1b969ee6-05ab-4706-9f3e-2cda18ad451e"). InnerVolumeSpecName "kube-api-access-wc7t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:43.221515 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.221479    2561 generic.go:356] "Generic (PLEG): container finished" podID="1b969ee6-05ab-4706-9f3e-2cda18ad451e" containerID="94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5" exitCode=0
Sep 08 15:02:43.221662 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.221531    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"
Sep 08 15:02:43.221662 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.221531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l" event={"ID":"1b969ee6-05ab-4706-9f3e-2cda18ad451e","Type":"ContainerDied","Data":"94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5"}
Sep 08 15:02:43.221662 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.221591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l" event={"ID":"1b969ee6-05ab-4706-9f3e-2cda18ad451e","Type":"ContainerDied","Data":"40f08a6fb2b4061d867706b6ffac8e104b7fc66e615e0d13ae2e9195c391430e"}
Sep 08 15:02:43.221662 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.221620    2561 scope.go:117] "RemoveContainer" containerID="94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5"
Sep 08 15:02:43.222987 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.222964    2561 generic.go:356] "Generic (PLEG): container finished" podID="138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3" containerID="0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5" exitCode=0
Sep 08 15:02:43.223200 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.222999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m" event={"ID":"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3","Type":"ContainerDied","Data":"0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5"}
Sep 08 15:02:43.223200 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.223004    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"
Sep 08 15:02:43.223200 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.223038    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m" event={"ID":"138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3","Type":"ContainerDied","Data":"7cb96b3d924f24312aa01de4b74ee896c6888149d7fca95466a254be06af7df0"}
Sep 08 15:02:43.231104 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.231084    2561 scope.go:117] "RemoveContainer" containerID="94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5"
Sep 08 15:02:43.231410 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:02:43.231383    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5\": container with ID starting with 94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5 not found: ID does not exist" containerID="94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5"
Sep 08 15:02:43.231515 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.231423    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5"} err="failed to get container status \"94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5\": rpc error: code = NotFound desc = could not find container \"94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5\": container with ID starting with 94c009105328485bc284250278157bb2a1ac709cada3587f0d24943e0826f3f5 not found: ID does not exist"
Sep 08 15:02:43.231515 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.231447    2561 scope.go:117] "RemoveContainer" containerID="0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5"
Sep 08 15:02:43.239446 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.239428    2561 scope.go:117] "RemoveContainer" containerID="0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5"
Sep 08 15:02:43.239697 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:02:43.239680    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5\": container with ID starting with 0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5 not found: ID does not exist" containerID="0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5"
Sep 08 15:02:43.239745 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.239703    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5"} err="failed to get container status \"0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5\": rpc error: code = NotFound desc = could not find container \"0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5\": container with ID starting with 0411b47f5ec87b5c08a2b22a36248fd91554108d552bf8e0b9e16222cffcdee5 not found: ID does not exist"
Sep 08 15:02:43.247676 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.247654    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"]
Sep 08 15:02:43.253969 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.253949    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-f83533-56d6979ccc-msf5m"]
Sep 08 15:02:43.264881 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.264857    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"]
Sep 08 15:02:43.267240 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.267220    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f83533-6878b45558-qd75l"]
Sep 08 15:02:43.283736 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.283716    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b969ee6-05ab-4706-9f3e-2cda18ad451e-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:43.283805 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.283735    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-plugins-config-volume\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:43.283805 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.283745    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc7t4\" (UniqueName: \"kubernetes.io/projected/1b969ee6-05ab-4706-9f3e-2cda18ad451e-kube-api-access-wc7t4\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:43.283805 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:43.283754    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn9qd\" (UniqueName: \"kubernetes.io/projected/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3-kube-api-access-gn9qd\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:02:44.521289 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:44.521258    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3" path="/var/lib/kubelet/pods/138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3/volumes"
Sep 08 15:02:44.521671 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:44.521624    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b969ee6-05ab-4706-9f3e-2cda18ad451e" path="/var/lib/kubelet/pods/1b969ee6-05ab-4706-9f3e-2cda18ad451e/volumes"
Sep 08 15:02:44.521855 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:02:44.521842    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9b451e4-084b-45b5-a846-59c39a279f1b" path="/var/lib/kubelet/pods/a9b451e4-084b-45b5-a846-59c39a279f1b/volumes"
Sep 08 15:03:54.274787 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.274756    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b46c4bd46-85nv2"]
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275088    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275099    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275116    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275121    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275128    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7f49b30-4967-44ec-a42c-e2ec6c922a1c" containerName="revoke-keys"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275133    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7f49b30-4967-44ec-a42c-e2ec6c922a1c" containerName="revoke-keys"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275140    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b969ee6-05ab-4706-9f3e-2cda18ad451e" containerName="payload-pre-processing"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275162    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b969ee6-05ab-4706-9f3e-2cda18ad451e" containerName="payload-pre-processing"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275170    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3" containerName="payload-processing"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275175    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3" containerName="payload-processing"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275181    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b828aec2-65e6-4011-8a97-067eb69a1792" containerName="payload-processing"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275186    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b828aec2-65e6-4011-8a97-067eb69a1792" containerName="payload-processing"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275238    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7f49b30-4967-44ec-a42c-e2ec6c922a1c" containerName="revoke-keys"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275246    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4478fec-0122-4617-95de-c1c156f6c451" containerName="istio-proxy"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275255    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b969ee6-05ab-4706-9f3e-2cda18ad451e" containerName="payload-pre-processing"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275261    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275267    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b828aec2-65e6-4011-8a97-067eb69a1792" containerName="payload-processing"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275272    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="30723475-874e-40fd-aa27-3b91cd129fcb" containerName="istio-proxy"
Sep 08 15:03:54.277186 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.275277    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="138abd0f-3545-4b20-9c2b-6ccc8dd6b0d3" containerName="payload-processing"
Sep 08 15:03:54.278066 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.278051    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.280350 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.280328    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:03:54.280945 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.280920    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xvj5m\""
Sep 08 15:03:54.280945 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.280930    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 15:03:54.281109 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.281021    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 15:03:54.289806 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.289782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-85nv2"]
Sep 08 15:03:54.367721 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.367673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-webhook-cert\") pod \"maas-controller-b46c4bd46-85nv2\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") " pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.367721 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.367729    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dksn\" (UniqueName: \"kubernetes.io/projected/ab2c9054-7e13-4b16-b3a5-c740466ae785-kube-api-access-2dksn\") pod \"maas-controller-b46c4bd46-85nv2\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") " pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.367958 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.367887    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-metrics-certs\") pod \"maas-controller-b46c4bd46-85nv2\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") " pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.469012 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.468953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-webhook-cert\") pod \"maas-controller-b46c4bd46-85nv2\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") " pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.469012 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.469011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dksn\" (UniqueName: \"kubernetes.io/projected/ab2c9054-7e13-4b16-b3a5-c740466ae785-kube-api-access-2dksn\") pod \"maas-controller-b46c4bd46-85nv2\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") " pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.469281 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.469083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-metrics-certs\") pod \"maas-controller-b46c4bd46-85nv2\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") " pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.471753 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.471723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-metrics-certs\") pod \"maas-controller-b46c4bd46-85nv2\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") " pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.471887 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.471763    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-webhook-cert\") pod \"maas-controller-b46c4bd46-85nv2\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") " pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.477921 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.477898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dksn\" (UniqueName: \"kubernetes.io/projected/ab2c9054-7e13-4b16-b3a5-c740466ae785-kube-api-access-2dksn\") pod \"maas-controller-b46c4bd46-85nv2\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") " pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.588208 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.588098    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:54.859755 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.859728    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-85nv2"]
Sep 08 15:03:54.861931 ip-10-0-129-248 kubenswrapper[2561]: W0908 15:03:54.861900    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2c9054_7e13_4b16_b3a5_c740466ae785.slice/crio-642d3b642da3a5cae60390adb33636a178ddddbf4c86a7c3d2b7d5b60a4df425 WatchSource:0}: Error finding container 642d3b642da3a5cae60390adb33636a178ddddbf4c86a7c3d2b7d5b60a4df425: Status 404 returned error can't find the container with id 642d3b642da3a5cae60390adb33636a178ddddbf4c86a7c3d2b7d5b60a4df425
Sep 08 15:03:54.863337 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:54.863317    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:03:55.571311 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:55.571275    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b46c4bd46-85nv2" event={"ID":"ab2c9054-7e13-4b16-b3a5-c740466ae785","Type":"ContainerStarted","Data":"0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396"}
Sep 08 15:03:55.571759 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:55.571331    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b46c4bd46-85nv2" event={"ID":"ab2c9054-7e13-4b16-b3a5-c740466ae785","Type":"ContainerStarted","Data":"642d3b642da3a5cae60390adb33636a178ddddbf4c86a7c3d2b7d5b60a4df425"}
Sep 08 15:03:55.571759 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:55.571377    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:03:55.589948 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:03:55.589855    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b46c4bd46-85nv2" podStartSLOduration=1.1233661640000001 podStartE2EDuration="1.589836474s" totalImagesPullingTime="466.47031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:03:55.588460637 +0000 UTC m=+1779.598980637" watchObservedRunningTime="2026-09-08 15:03:55.589836474 +0000 UTC m=+1779.600356472"
Sep 08 15:04:06.578633 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:06.578600    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:04:13.955594 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:13.955504    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-85nv2"]
Sep 08 15:04:13.956070 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:13.955768    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b46c4bd46-85nv2" podUID="ab2c9054-7e13-4b16-b3a5-c740466ae785" containerName="manager" containerID="cri-o://0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396" gracePeriod=30
Sep 08 15:04:14.195208 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.195184    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:04:14.357907 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.357868    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dksn\" (UniqueName: \"kubernetes.io/projected/ab2c9054-7e13-4b16-b3a5-c740466ae785-kube-api-access-2dksn\") pod \"ab2c9054-7e13-4b16-b3a5-c740466ae785\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") "
Sep 08 15:04:14.358088 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.357928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-webhook-cert\") pod \"ab2c9054-7e13-4b16-b3a5-c740466ae785\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") "
Sep 08 15:04:14.358088 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.358063    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-metrics-certs\") pod \"ab2c9054-7e13-4b16-b3a5-c740466ae785\" (UID: \"ab2c9054-7e13-4b16-b3a5-c740466ae785\") "
Sep 08 15:04:14.360233 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.360202    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ab2c9054-7e13-4b16-b3a5-c740466ae785" (UID: "ab2c9054-7e13-4b16-b3a5-c740466ae785"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:04:14.360233 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.360218    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab2c9054-7e13-4b16-b3a5-c740466ae785-kube-api-access-2dksn" (OuterVolumeSpecName: "kube-api-access-2dksn") pod "ab2c9054-7e13-4b16-b3a5-c740466ae785" (UID: "ab2c9054-7e13-4b16-b3a5-c740466ae785"). InnerVolumeSpecName "kube-api-access-2dksn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:04:14.360389 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.360301    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ab2c9054-7e13-4b16-b3a5-c740466ae785" (UID: "ab2c9054-7e13-4b16-b3a5-c740466ae785"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:04:14.459130 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.459079    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dksn\" (UniqueName: \"kubernetes.io/projected/ab2c9054-7e13-4b16-b3a5-c740466ae785-kube-api-access-2dksn\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:04:14.459130 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.459123    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-webhook-cert\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:04:14.459130 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.459132    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2c9054-7e13-4b16-b3a5-c740466ae785-metrics-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:04:14.665040 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.665005    2561 generic.go:356] "Generic (PLEG): container finished" podID="ab2c9054-7e13-4b16-b3a5-c740466ae785" containerID="0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396" exitCode=0
Sep 08 15:04:14.665040 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.665049    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b46c4bd46-85nv2"
Sep 08 15:04:14.665359 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.665085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b46c4bd46-85nv2" event={"ID":"ab2c9054-7e13-4b16-b3a5-c740466ae785","Type":"ContainerDied","Data":"0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396"}
Sep 08 15:04:14.665359 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.665183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b46c4bd46-85nv2" event={"ID":"ab2c9054-7e13-4b16-b3a5-c740466ae785","Type":"ContainerDied","Data":"642d3b642da3a5cae60390adb33636a178ddddbf4c86a7c3d2b7d5b60a4df425"}
Sep 08 15:04:14.665359 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.665214    2561 scope.go:117] "RemoveContainer" containerID="0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396"
Sep 08 15:04:14.674631 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.674607    2561 scope.go:117] "RemoveContainer" containerID="0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396"
Sep 08 15:04:14.674954 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:04:14.674934    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396\": container with ID starting with 0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396 not found: ID does not exist" containerID="0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396"
Sep 08 15:04:14.675023 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.674964    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396"} err="failed to get container status \"0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396\": rpc error: code = NotFound desc = could not find container \"0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396\": container with ID starting with 0baa818cf87dc4b98ed0c04310666c1de7ae0c17ce38003dbbc38a00b7ade396 not found: ID does not exist"
Sep 08 15:04:14.681780 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.681757    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-85nv2"]
Sep 08 15:04:14.686318 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:14.686292    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-85nv2"]
Sep 08 15:04:15.639032 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.638991    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b46c4bd46-xv6xt"]
Sep 08 15:04:15.639562 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.639539    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab2c9054-7e13-4b16-b3a5-c740466ae785" containerName="manager"
Sep 08 15:04:15.639644 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.639565    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab2c9054-7e13-4b16-b3a5-c740466ae785" containerName="manager"
Sep 08 15:04:15.639707 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.639679    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab2c9054-7e13-4b16-b3a5-c740466ae785" containerName="manager"
Sep 08 15:04:15.642723 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.642700    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:15.644806 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.644783    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 15:04:15.645692 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.645671    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xvj5m\""
Sep 08 15:04:15.646013 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.645997    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:04:15.646277 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.646261    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 15:04:15.652184 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.652140    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-xv6xt"]
Sep 08 15:04:15.773038 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.772989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/540cf373-3dba-44a8-b182-bec07e26dab1-metrics-certs\") pod \"maas-controller-b46c4bd46-xv6xt\" (UID: \"540cf373-3dba-44a8-b182-bec07e26dab1\") " pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:15.773038 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.773033    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmckc\" (UniqueName: \"kubernetes.io/projected/540cf373-3dba-44a8-b182-bec07e26dab1-kube-api-access-kmckc\") pod \"maas-controller-b46c4bd46-xv6xt\" (UID: \"540cf373-3dba-44a8-b182-bec07e26dab1\") " pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:15.773318 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.773122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/540cf373-3dba-44a8-b182-bec07e26dab1-webhook-cert\") pod \"maas-controller-b46c4bd46-xv6xt\" (UID: \"540cf373-3dba-44a8-b182-bec07e26dab1\") " pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:15.874538 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.874495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/540cf373-3dba-44a8-b182-bec07e26dab1-metrics-certs\") pod \"maas-controller-b46c4bd46-xv6xt\" (UID: \"540cf373-3dba-44a8-b182-bec07e26dab1\") " pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:15.874538 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.874538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmckc\" (UniqueName: \"kubernetes.io/projected/540cf373-3dba-44a8-b182-bec07e26dab1-kube-api-access-kmckc\") pod \"maas-controller-b46c4bd46-xv6xt\" (UID: \"540cf373-3dba-44a8-b182-bec07e26dab1\") " pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:15.874775 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.874573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/540cf373-3dba-44a8-b182-bec07e26dab1-webhook-cert\") pod \"maas-controller-b46c4bd46-xv6xt\" (UID: \"540cf373-3dba-44a8-b182-bec07e26dab1\") " pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:15.877235 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.877201    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/540cf373-3dba-44a8-b182-bec07e26dab1-metrics-certs\") pod \"maas-controller-b46c4bd46-xv6xt\" (UID: \"540cf373-3dba-44a8-b182-bec07e26dab1\") " pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:15.877370 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.877285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/540cf373-3dba-44a8-b182-bec07e26dab1-webhook-cert\") pod \"maas-controller-b46c4bd46-xv6xt\" (UID: \"540cf373-3dba-44a8-b182-bec07e26dab1\") " pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:15.882455 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.882428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmckc\" (UniqueName: \"kubernetes.io/projected/540cf373-3dba-44a8-b182-bec07e26dab1-kube-api-access-kmckc\") pod \"maas-controller-b46c4bd46-xv6xt\" (UID: \"540cf373-3dba-44a8-b182-bec07e26dab1\") " pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:15.955577 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:15.955479    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:16.233983 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:16.233955    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-xv6xt"]
Sep 08 15:04:16.235719 ip-10-0-129-248 kubenswrapper[2561]: W0908 15:04:16.235687    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540cf373_3dba_44a8_b182_bec07e26dab1.slice/crio-ac1b4ad8927d4bfec231bfcea1f8553ba1d441ebdab2d19be3ae6975a8252c24 WatchSource:0}: Error finding container ac1b4ad8927d4bfec231bfcea1f8553ba1d441ebdab2d19be3ae6975a8252c24: Status 404 returned error can't find the container with id ac1b4ad8927d4bfec231bfcea1f8553ba1d441ebdab2d19be3ae6975a8252c24
Sep 08 15:04:16.522424 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:16.522345    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab2c9054-7e13-4b16-b3a5-c740466ae785" path="/var/lib/kubelet/pods/ab2c9054-7e13-4b16-b3a5-c740466ae785/volumes"
Sep 08 15:04:16.589966 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:16.589936    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 15:04:16.594622 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:16.594595    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 15:04:16.683127 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:16.683089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b46c4bd46-xv6xt" event={"ID":"540cf373-3dba-44a8-b182-bec07e26dab1","Type":"ContainerStarted","Data":"ac1b4ad8927d4bfec231bfcea1f8553ba1d441ebdab2d19be3ae6975a8252c24"}
Sep 08 15:04:20.870445 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:20.870420    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:04:21.710603 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:21.710555    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b46c4bd46-xv6xt" event={"ID":"540cf373-3dba-44a8-b182-bec07e26dab1","Type":"ContainerStarted","Data":"cf627cd4a58babfa686b9fae18312251e6189052f41b8913d11df60b31959127"}
Sep 08 15:04:21.710800 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:21.710650    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:32.717588 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:32.717554    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b46c4bd46-xv6xt"
Sep 08 15:04:32.737723 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:04:32.737669    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b46c4bd46-xv6xt" podStartSLOduration=13.106505117 podStartE2EDuration="17.737653406s" totalImagesPullingTime="4.631148289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:04:21.726819861 +0000 UTC m=+1805.737339862" watchObservedRunningTime="2026-09-08 15:04:32.737653406 +0000 UTC m=+1816.748173434"
Sep 08 15:06:16.858048 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:06:16.858015    2561 scope.go:117] "RemoveContainer" containerID="c4b61801661895a12cd072bc25eca4b82936465abd23c5a9b02abf420b1bbff1"
Sep 08 15:06:16.866654 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:06:16.866628    2561 scope.go:117] "RemoveContainer" containerID="3a94e869e9572bc16f23809bf1814cc33f1bff59cfa402a75aee0b90a5d44a19"
Sep 08 15:08:11.169774 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.169728    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"]
Sep 08 15:08:11.173427 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.173402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.176072 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.176046    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k5czt\""
Sep 08 15:08:11.176212 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.176046    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 15:08:11.176212 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.176111    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 15:08:11.185773 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.185742    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"]
Sep 08 15:08:11.311219 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.311181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-metrics-certs\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.311219 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.311219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-openshift-service-ca\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.311453 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.311247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p75k\" (UniqueName: \"kubernetes.io/projected/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-kube-api-access-4p75k\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.311453 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.311404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-maas-api-tls\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.412073 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.412026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p75k\" (UniqueName: \"kubernetes.io/projected/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-kube-api-access-4p75k\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.412314 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.412185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-maas-api-tls\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.412314 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.412247    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-metrics-certs\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.412441 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.412351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-openshift-service-ca\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.413097 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.412990    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-openshift-service-ca\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.414859 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.414836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-metrics-certs\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.414978 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.414956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-maas-api-tls\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.419895 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.419833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p75k\" (UniqueName: \"kubernetes.io/projected/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-kube-api-access-4p75k\") pod \"maas-api-84d9df9944-kttgv\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.484128 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.484092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:11.762084 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.762055    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"]
Sep 08 15:08:11.763708 ip-10-0-129-248 kubenswrapper[2561]: W0908 15:08:11.763669    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50fee599_97cb_4ca2_a94b_3a4c7f832d8b.slice/crio-32a740fa649ac6c250e701b5b44f1d2d5d1567134aea9930c9399627e6dbe5b4 WatchSource:0}: Error finding container 32a740fa649ac6c250e701b5b44f1d2d5d1567134aea9930c9399627e6dbe5b4: Status 404 returned error can't find the container with id 32a740fa649ac6c250e701b5b44f1d2d5d1567134aea9930c9399627e6dbe5b4
Sep 08 15:08:11.830465 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:11.830424    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv" event={"ID":"50fee599-97cb-4ca2-a94b-3a4c7f832d8b","Type":"ContainerStarted","Data":"32a740fa649ac6c250e701b5b44f1d2d5d1567134aea9930c9399627e6dbe5b4"}
Sep 08 15:08:12.836920 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:12.836824    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv" event={"ID":"50fee599-97cb-4ca2-a94b-3a4c7f832d8b","Type":"ContainerStarted","Data":"2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a"}
Sep 08 15:08:12.836920 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:12.836885    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:12.859707 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:12.859654    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv" podStartSLOduration=1.104717871 podStartE2EDuration="1.859635689s" totalImagesPullingTime="754.917818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:12.858546031 +0000 UTC m=+2036.869066030" watchObservedRunningTime="2026-09-08 15:08:12.859635689 +0000 UTC m=+2036.870155691"
Sep 08 15:08:16.901911 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:16.901879    2561 scope.go:117] "RemoveContainer" containerID="b5a3c9c6ffe4ddada2b3559e7de3877bed8ddb121c611107edd8befe54d5b975"
Sep 08 15:08:18.847271 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:18.847240    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:19.220437 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.220407    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"]
Sep 08 15:08:19.223830 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.223809    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.235434 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.235401    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"]
Sep 08 15:08:19.392544 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.392503    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb7a1843-0d24-4775-817e-d71886f63986-openshift-service-ca\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.392712 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.392564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv8q5\" (UniqueName: \"kubernetes.io/projected/cb7a1843-0d24-4775-817e-d71886f63986-kube-api-access-dv8q5\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.392712 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.392631    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7a1843-0d24-4775-817e-d71886f63986-metrics-certs\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.392712 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.392691    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb7a1843-0d24-4775-817e-d71886f63986-maas-api-tls\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.493572 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.493463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb7a1843-0d24-4775-817e-d71886f63986-openshift-service-ca\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.493572 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.493525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv8q5\" (UniqueName: \"kubernetes.io/projected/cb7a1843-0d24-4775-817e-d71886f63986-kube-api-access-dv8q5\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.493814 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.493590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7a1843-0d24-4775-817e-d71886f63986-metrics-certs\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.493814 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.493633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb7a1843-0d24-4775-817e-d71886f63986-maas-api-tls\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.494179 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.494126    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb7a1843-0d24-4775-817e-d71886f63986-openshift-service-ca\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.496281 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.496259    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb7a1843-0d24-4775-817e-d71886f63986-maas-api-tls\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.496371 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.496348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb7a1843-0d24-4775-817e-d71886f63986-metrics-certs\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.501575 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.501548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv8q5\" (UniqueName: \"kubernetes.io/projected/cb7a1843-0d24-4775-817e-d71886f63986-kube-api-access-dv8q5\") pod \"maas-api-86dc7466b4-9xwj7\" (UID: \"cb7a1843-0d24-4775-817e-d71886f63986\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.534878 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.534839    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:19.819685 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.819649    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"]
Sep 08 15:08:19.820359 ip-10-0-129-248 kubenswrapper[2561]: W0908 15:08:19.820326    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7a1843_0d24_4775_817e_d71886f63986.slice/crio-7f402784ed2a66309614ae311369003101e188b0be2aacc3079fc4ecab3ce679 WatchSource:0}: Error finding container 7f402784ed2a66309614ae311369003101e188b0be2aacc3079fc4ecab3ce679: Status 404 returned error can't find the container with id 7f402784ed2a66309614ae311369003101e188b0be2aacc3079fc4ecab3ce679
Sep 08 15:08:19.870874 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:19.870831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7" event={"ID":"cb7a1843-0d24-4775-817e-d71886f63986","Type":"ContainerStarted","Data":"7f402784ed2a66309614ae311369003101e188b0be2aacc3079fc4ecab3ce679"}
Sep 08 15:08:20.877560 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:20.877519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7" event={"ID":"cb7a1843-0d24-4775-817e-d71886f63986","Type":"ContainerStarted","Data":"ec5cc233a2d9db7e3b4441eb0e5d95df5f3d26443a3ce787b9223494bd625281"}
Sep 08 15:08:20.877962 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:20.877629    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:20.895328 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:20.895277    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7" podStartSLOduration=1.4360385390000001 podStartE2EDuration="1.895259901s" totalImagesPullingTime="459.221362ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:20.894140935 +0000 UTC m=+2044.904660931" watchObservedRunningTime="2026-09-08 15:08:20.895259901 +0000 UTC m=+2044.905779899"
Sep 08 15:08:26.889198 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:26.889139    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-9xwj7"
Sep 08 15:08:26.941365 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:26.941325    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"]
Sep 08 15:08:26.941615 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:26.941588    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv" podUID="50fee599-97cb-4ca2-a94b-3a4c7f832d8b" containerName="maas-api" containerID="cri-o://2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a" gracePeriod=30
Sep 08 15:08:28.197468 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.197439    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:28.279790 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.279690    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p75k\" (UniqueName: \"kubernetes.io/projected/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-kube-api-access-4p75k\") pod \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") "
Sep 08 15:08:28.279790 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.279743    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-openshift-service-ca\") pod \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") "
Sep 08 15:08:28.279790 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.279785    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-maas-api-tls\") pod \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") "
Sep 08 15:08:28.280107 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.279864    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-metrics-certs\") pod \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\" (UID: \"50fee599-97cb-4ca2-a94b-3a4c7f832d8b\") "
Sep 08 15:08:28.280248 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.280221    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "50fee599-97cb-4ca2-a94b-3a4c7f832d8b" (UID: "50fee599-97cb-4ca2-a94b-3a4c7f832d8b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:08:28.281982 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.281959    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-kube-api-access-4p75k" (OuterVolumeSpecName: "kube-api-access-4p75k") pod "50fee599-97cb-4ca2-a94b-3a4c7f832d8b" (UID: "50fee599-97cb-4ca2-a94b-3a4c7f832d8b"). InnerVolumeSpecName "kube-api-access-4p75k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:08:28.282042 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.282014    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "50fee599-97cb-4ca2-a94b-3a4c7f832d8b" (UID: "50fee599-97cb-4ca2-a94b-3a4c7f832d8b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:08:28.282168 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.282132    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "50fee599-97cb-4ca2-a94b-3a4c7f832d8b" (UID: "50fee599-97cb-4ca2-a94b-3a4c7f832d8b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:08:28.381417 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.381374    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p75k\" (UniqueName: \"kubernetes.io/projected/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-kube-api-access-4p75k\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:08:28.381417 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.381408    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-openshift-service-ca\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:08:28.381417 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.381419    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-maas-api-tls\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:08:28.381417 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.381428    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50fee599-97cb-4ca2-a94b-3a4c7f832d8b-metrics-certs\") on node \"ip-10-0-129-248.ec2.internal\" DevicePath \"\""
Sep 08 15:08:28.916734 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.916637    2561 generic.go:356] "Generic (PLEG): container finished" podID="50fee599-97cb-4ca2-a94b-3a4c7f832d8b" containerID="2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a" exitCode=0
Sep 08 15:08:28.916734 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.916683    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"
Sep 08 15:08:28.917022 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.916726    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv" event={"ID":"50fee599-97cb-4ca2-a94b-3a4c7f832d8b","Type":"ContainerDied","Data":"2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a"}
Sep 08 15:08:28.917022 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.916787    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84d9df9944-kttgv" event={"ID":"50fee599-97cb-4ca2-a94b-3a4c7f832d8b","Type":"ContainerDied","Data":"32a740fa649ac6c250e701b5b44f1d2d5d1567134aea9930c9399627e6dbe5b4"}
Sep 08 15:08:28.917022 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.916819    2561 scope.go:117] "RemoveContainer" containerID="2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a"
Sep 08 15:08:28.925671 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.925653    2561 scope.go:117] "RemoveContainer" containerID="2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a"
Sep 08 15:08:28.925937 ip-10-0-129-248 kubenswrapper[2561]: E0908 15:08:28.925919    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a\": container with ID starting with 2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a not found: ID does not exist" containerID="2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a"
Sep 08 15:08:28.925980 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.925950    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a"} err="failed to get container status \"2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a\": rpc error: code = NotFound desc = could not find container \"2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a\": container with ID starting with 2bcf496e346455220fac34f2dcca6940da00bcf097c4d16b17e4ac342dd8178a not found: ID does not exist"
Sep 08 15:08:28.931683 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.931657    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"]
Sep 08 15:08:28.933909 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:28.933889    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-kttgv"]
Sep 08 15:08:30.521312 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:30.521280    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50fee599-97cb-4ca2-a94b-3a4c7f832d8b" path="/var/lib/kubelet/pods/50fee599-97cb-4ca2-a94b-3a4c7f832d8b/volumes"
Sep 08 15:08:48.621377 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:48.621294    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b46c4bd46-xv6xt_540cf373-3dba-44a8-b182-bec07e26dab1/manager/0.log"
Sep 08 15:08:48.849767 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:48.849726    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8hj74_f32d411f-ac32-4372-9bd6-8fd8393fcf5a/manager/0.log"
Sep 08 15:08:48.959026 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:48.958946    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-766f77f8db-5tvhp_cc991882-2984-40f2-953b-c8a2858714d2/copy-manifests/0.log"
Sep 08 15:08:48.979069 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:48.979040    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-766f77f8db-5tvhp_cc991882-2984-40f2-953b-c8a2858714d2/manager/0.log"
Sep 08 15:08:49.541954 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:49.541781    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-86dc7466b4-9xwj7_cb7a1843-0d24-4775-817e-d71886f63986/maas-api/0.log"
Sep 08 15:08:49.760791 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:49.760751    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29814645-t7mhf_9cf84ddc-1f6b-4cd9-af94-37d610d5e965/cleanup/0.log"
Sep 08 15:08:49.983903 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:49.983872    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ngndh_c36b18cb-5643-4666-86b0-a2ff407c1aed/postgres/0.log"
Sep 08 15:08:51.748388 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:51.748355    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8_72dc156a-871f-465d-ad38-977c8725857e/istio-proxy/0.log"
Sep 08 15:08:51.875390 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:51.875361    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-r7pgn_91cafd67-b259-49c4-bae3-45b0986fbc03/discovery/0.log"
Sep 08 15:08:52.220219 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:52.220187    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mm2f9_d5b7992a-ef04-4088-b506-255d966c7dfa/istio-proxy/1.log"
Sep 08 15:08:52.901834 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:52.901796    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pkk6j_9e5ff97a-0489-412e-8a1b-30436289aab3/main/0.log"
Sep 08 15:08:53.114684 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:08:53.114640    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-p4wcs_f66de2e2-976b-41c0-9a3e-8db3dea6e6e3/main/0.log"
Sep 08 15:09:04.270829 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:04.270791    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-shnpn_c3334c9c-8df4-4eef-a4e5-dfb55276c3f1/global-pull-secret-syncer/0.log"
Sep 08 15:09:04.357563 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:04.357524    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g5n9d_21ac6106-7a51-4276-8324-0645aa8a32f8/konnectivity-agent/0.log"
Sep 08 15:09:04.417494 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:04.417462    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-248.ec2.internal_aaee42d2e078b0aa5a0ca900ffc90198/haproxy/0.log"
Sep 08 15:09:10.980952 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:10.980913    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-bc599d54b-z97mq_86217df2-2491-42fb-a428-7ea8119feda3/metrics-server/0.log"
Sep 08 15:09:11.012309 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.012274    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-8wmpb_d90be506-b58c-4239-bfe6-44cd5aecec11/monitoring-plugin/0.log"
Sep 08 15:09:11.164070 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.164027    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cb4jl_81289f78-5e33-428f-b578-76e96a12f126/node-exporter/0.log"
Sep 08 15:09:11.186266 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.186234    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cb4jl_81289f78-5e33-428f-b578-76e96a12f126/kube-rbac-proxy/0.log"
Sep 08 15:09:11.204841 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.204765    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cb4jl_81289f78-5e33-428f-b578-76e96a12f126/init-textfile/0.log"
Sep 08 15:09:11.406272 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.406241    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8/prometheus/0.log"
Sep 08 15:09:11.426067 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.426036    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8/config-reloader/0.log"
Sep 08 15:09:11.452996 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.452960    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8/thanos-sidecar/0.log"
Sep 08 15:09:11.479516 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.479489    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8/kube-rbac-proxy-web/0.log"
Sep 08 15:09:11.502489 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.502466    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8/kube-rbac-proxy/0.log"
Sep 08 15:09:11.531017 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.530979    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8/kube-rbac-proxy-thanos/0.log"
Sep 08 15:09:11.564725 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.564697    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01655af4-16c8-4ebe-9e1a-65dbd2d9e0e8/init-config-reloader/0.log"
Sep 08 15:09:11.609835 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.609810    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-b75h5_bb48f451-4152-4b4b-adac-535b9f3db19f/prometheus-operator/0.log"
Sep 08 15:09:11.641503 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:11.641474    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-b75h5_bb48f451-4152-4b4b-adac-535b9f3db19f/kube-rbac-proxy/0.log"
Sep 08 15:09:13.778493 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:13.778461    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 15:09:13.785469 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:13.785441    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/3.log"
Sep 08 15:09:14.949161 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:14.949123    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-mt2hr_74358fc4-0e9c-4f0f-b22d-c3552227e0c6/volume-data-source-validator/0.log"
Sep 08 15:09:16.208610 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.208574    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"]
Sep 08 15:09:16.208983 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.208916    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50fee599-97cb-4ca2-a94b-3a4c7f832d8b" containerName="maas-api"
Sep 08 15:09:16.208983 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.208926    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="50fee599-97cb-4ca2-a94b-3a4c7f832d8b" containerName="maas-api"
Sep 08 15:09:16.209063 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.208999    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="50fee599-97cb-4ca2-a94b-3a4c7f832d8b" containerName="maas-api"
Sep 08 15:09:16.212233 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.212213    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.214619 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.214599    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gjjks\"/\"default-dockercfg-vpdf8\""
Sep 08 15:09:16.215513 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.215496    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjjks\"/\"openshift-service-ca.crt\""
Sep 08 15:09:16.215580 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.215510    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjjks\"/\"kube-root-ca.crt\""
Sep 08 15:09:16.223681 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.223658    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"]
Sep 08 15:09:16.301948 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.301907    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-szrgb_0ddd618f-e729-4985-b013-c6dbbb8931c2/dns/0.log"
Sep 08 15:09:16.345272 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.345244    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-szrgb_0ddd618f-e729-4985-b013-c6dbbb8931c2/kube-rbac-proxy/0.log"
Sep 08 15:09:16.353397 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.353369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-lib-modules\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.353537 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.353424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-podres\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.353537 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.353454    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-sys\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.353537 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.353497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-proc\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.353981 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.353589    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmg2k\" (UniqueName: \"kubernetes.io/projected/786e8327-02f2-4cb9-b650-7bcfa5c3830e-kube-api-access-vmg2k\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.387047 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.387020    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h672j_63d7944c-15c0-4ff2-ac22-6cf9afdae1d2/dns-node-resolver/0.log"
Sep 08 15:09:16.455048 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.455019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-lib-modules\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.455261 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.455062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-podres\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.455261 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.455080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-sys\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.455261 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.455120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-proc\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.455261 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.455173    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-sys\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.455261 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.455180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmg2k\" (UniqueName: \"kubernetes.io/projected/786e8327-02f2-4cb9-b650-7bcfa5c3830e-kube-api-access-vmg2k\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.455261 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.455185    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-podres\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.455261 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.455197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-lib-modules\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.455261 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.455236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/786e8327-02f2-4cb9-b650-7bcfa5c3830e-proc\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.463765 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.463707    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjjks\"/\"kube-root-ca.crt\""
Sep 08 15:09:16.474229 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.474202    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjjks\"/\"openshift-service-ca.crt\""
Sep 08 15:09:16.485402 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.485376    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmg2k\" (UniqueName: \"kubernetes.io/projected/786e8327-02f2-4cb9-b650-7bcfa5c3830e-kube-api-access-vmg2k\") pod \"perf-node-gather-daemonset-pfgk9\" (UID: \"786e8327-02f2-4cb9-b650-7bcfa5c3830e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.524374 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.524354    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gjjks\"/\"default-dockercfg-vpdf8\""
Sep 08 15:09:16.533218 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.533196    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:16.630743 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.630713    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 15:09:16.633992 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.633969    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-4ccf5_9b2e05c9-ce24-4ebc-90dc-365bddac7688/console-operator/2.log"
Sep 08 15:09:16.803236 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:16.803196    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"]
Sep 08 15:09:16.804653 ip-10-0-129-248 kubenswrapper[2561]: W0908 15:09:16.804624    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod786e8327_02f2_4cb9_b650_7bcfa5c3830e.slice/crio-3b2db740fc225fa09495ae625c2f3d66d8bedb48736eb65e8c7a46888c0b4793 WatchSource:0}: Error finding container 3b2db740fc225fa09495ae625c2f3d66d8bedb48736eb65e8c7a46888c0b4793: Status 404 returned error can't find the container with id 3b2db740fc225fa09495ae625c2f3d66d8bedb48736eb65e8c7a46888c0b4793
Sep 08 15:09:17.020288 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:17.020259    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-856cfd6cc-tvg9t_e313ff21-c430-4647-9bfd-221ece98c548/registry/0.log"
Sep 08 15:09:17.048205 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:17.048176    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bx5tq_06012240-3a1e-44ac-baf8-4648f6b640cf/node-ca/0.log"
Sep 08 15:09:17.145977 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:17.145883    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9" event={"ID":"786e8327-02f2-4cb9-b650-7bcfa5c3830e","Type":"ContainerStarted","Data":"17680c3b4365b5e586120108b396e843c0b903560abdc407d062eed185ebf4af"}
Sep 08 15:09:17.145977 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:17.145931    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9" event={"ID":"786e8327-02f2-4cb9-b650-7bcfa5c3830e","Type":"ContainerStarted","Data":"3b2db740fc225fa09495ae625c2f3d66d8bedb48736eb65e8c7a46888c0b4793"}
Sep 08 15:09:17.146243 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:17.146004    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:17.164189 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:17.164124    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9" podStartSLOduration=1.164111002 podStartE2EDuration="1.164111002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:17.161413807 +0000 UTC m=+2101.171933808" watchObservedRunningTime="2026-09-08 15:09:17.164111002 +0000 UTC m=+2101.174631002"
Sep 08 15:09:17.990201 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:17.990138    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8_72dc156a-871f-465d-ad38-977c8725857e/istio-proxy/0.log"
Sep 08 15:09:18.512785 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:18.512741    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-r7pgn_91cafd67-b259-49c4-bae3-45b0986fbc03/discovery/0.log"
Sep 08 15:09:18.604948 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:18.604914    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mm2f9_d5b7992a-ef04-4088-b506-255d966c7dfa/istio-proxy/0.log"
Sep 08 15:09:18.622392 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:18.622365    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mm2f9_d5b7992a-ef04-4088-b506-255d966c7dfa/istio-proxy/1.log"
Sep 08 15:09:19.629057 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:19.629024    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w6pcq_2546d478-fdbf-4358-bd11-a3b07cef8fb4/serve-healthcheck-canary/0.log"
Sep 08 15:09:20.085905 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:20.085853    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-h95lg_29018d4b-c9e9-403b-97d3-94b36bd94401/insights-operator/0.log"
Sep 08 15:09:20.086187 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:20.086116    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-h95lg_29018d4b-c9e9-403b-97d3-94b36bd94401/insights-operator/1.log"
Sep 08 15:09:20.109358 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:20.109334    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kc8lh_554fe1a1-4bed-43fc-839e-c60a6a0ef795/kube-rbac-proxy/0.log"
Sep 08 15:09:20.130527 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:20.130494    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kc8lh_554fe1a1-4bed-43fc-839e-c60a6a0ef795/exporter/0.log"
Sep 08 15:09:20.154896 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:20.154870    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kc8lh_554fe1a1-4bed-43fc-839e-c60a6a0ef795/extractor/0.log"
Sep 08 15:09:22.936725 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:22.936681    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b46c4bd46-xv6xt_540cf373-3dba-44a8-b182-bec07e26dab1/manager/0.log"
Sep 08 15:09:23.092174 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:23.092118    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8hj74_f32d411f-ac32-4372-9bd6-8fd8393fcf5a/manager/0.log"
Sep 08 15:09:23.164377 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:23.164347    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-pfgk9"
Sep 08 15:09:23.226972 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:23.226929    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-766f77f8db-5tvhp_cc991882-2984-40f2-953b-c8a2858714d2/manager/0.log"
Sep 08 15:09:23.253131 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:23.253108    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-766f77f8db-5tvhp_cc991882-2984-40f2-953b-c8a2858714d2/copy-manifests/0.log"
Sep 08 15:09:23.993584 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:23.993552    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8_72dc156a-871f-465d-ad38-977c8725857e/istio-proxy/0.log"
Sep 08 15:09:24.480168 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:24.480117    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84fb6884f5-zk28g_a2f849d2-b865-439b-8e7a-75bdb15d4fcb/manager/0.log"
Sep 08 15:09:24.519019 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:24.518989    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-r7pgn_91cafd67-b259-49c4-bae3-45b0986fbc03/discovery/0.log"
Sep 08 15:09:24.578958 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:24.578928    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mm2f9_d5b7992a-ef04-4088-b506-255d966c7dfa/istio-proxy/0.log"
Sep 08 15:09:24.596614 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:24.596581    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mm2f9_d5b7992a-ef04-4088-b506-255d966c7dfa/istio-proxy/1.log"
Sep 08 15:09:26.305660 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:26.305625    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-czjh8_72dc156a-871f-465d-ad38-977c8725857e/istio-proxy/0.log"
Sep 08 15:09:26.835343 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:26.835305    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-r7pgn_91cafd67-b259-49c4-bae3-45b0986fbc03/discovery/0.log"
Sep 08 15:09:26.894480 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:26.894447    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mm2f9_d5b7992a-ef04-4088-b506-255d966c7dfa/istio-proxy/0.log"
Sep 08 15:09:26.912197 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:26.912174    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-mm2f9_d5b7992a-ef04-4088-b506-255d966c7dfa/istio-proxy/1.log"
Sep 08 15:09:31.412930 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:31.412900    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mjrhr_98985ec1-7b3c-4c2a-add7-be624aca2b36/kube-multus-additional-cni-plugins/0.log"
Sep 08 15:09:31.433196 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:31.433168    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mjrhr_98985ec1-7b3c-4c2a-add7-be624aca2b36/egress-router-binary-copy/0.log"
Sep 08 15:09:31.453250 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:31.453226    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mjrhr_98985ec1-7b3c-4c2a-add7-be624aca2b36/cni-plugins/0.log"
Sep 08 15:09:31.472432 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:31.472401    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mjrhr_98985ec1-7b3c-4c2a-add7-be624aca2b36/bond-cni-plugin/0.log"
Sep 08 15:09:31.492458 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:31.492433    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mjrhr_98985ec1-7b3c-4c2a-add7-be624aca2b36/routeoverride-cni/0.log"
Sep 08 15:09:31.511587 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:31.511560    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mjrhr_98985ec1-7b3c-4c2a-add7-be624aca2b36/whereabouts-cni-bincopy/0.log"
Sep 08 15:09:31.535410 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:31.535380    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mjrhr_98985ec1-7b3c-4c2a-add7-be624aca2b36/whereabouts-cni/0.log"
Sep 08 15:09:31.628933 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:31.628897    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rsz42_77f2080a-f31d-4b30-a798-33e9861d8a2e/kube-multus/0.log"
Sep 08 15:09:31.693496 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:31.693409    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qzw9s_fc907ff2-af58-4c71-9031-fddfbd162573/network-metrics-daemon/0.log"
Sep 08 15:09:31.717114 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:31.717083    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qzw9s_fc907ff2-af58-4c71-9031-fddfbd162573/kube-rbac-proxy/0.log"
Sep 08 15:09:32.876642 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:32.876603    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkmmk_f6e9a02e-c20b-4fc7-bdef-4d11df4eb280/ovn-controller/0.log"
Sep 08 15:09:32.897266 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:32.897225    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkmmk_f6e9a02e-c20b-4fc7-bdef-4d11df4eb280/ovn-acl-logging/0.log"
Sep 08 15:09:32.931880 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:32.931840    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkmmk_f6e9a02e-c20b-4fc7-bdef-4d11df4eb280/kube-rbac-proxy-node/0.log"
Sep 08 15:09:32.961022 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:32.960991    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkmmk_f6e9a02e-c20b-4fc7-bdef-4d11df4eb280/kube-rbac-proxy-ovn-metrics/0.log"
Sep 08 15:09:32.986559 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:32.986529    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkmmk_f6e9a02e-c20b-4fc7-bdef-4d11df4eb280/northd/0.log"
Sep 08 15:09:33.007558 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:33.007530    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkmmk_f6e9a02e-c20b-4fc7-bdef-4d11df4eb280/nbdb/0.log"
Sep 08 15:09:33.031516 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:33.031490    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkmmk_f6e9a02e-c20b-4fc7-bdef-4d11df4eb280/sbdb/0.log"
Sep 08 15:09:33.123412 ip-10-0-129-248 kubenswrapper[2561]: I0908 15:09:33.123380    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nkmmk_f6e9a02e-c20b-4fc7-bdef-4d11df4eb280/ovnkube-controller/0.log"